DebaucheryLibrarian
|
07f0249717
|
Upgraded pg, knex and postgraphile. Updated nvmrc version to latest node LTS. Fixed Gamma scraper not passing request headers to new http module.
|
2020-12-14 03:16:47 +01:00 |
|
DebaucheryLibrarian
|
80b0f9ee0f
|
1.145.0
|
2020-12-05 02:44:54 +01:00 |
|
DebaucheryLibrarian
|
71196688ae
|
Removed console log.
|
2020-12-05 02:44:39 +01:00 |
|
DebaucheryLibrarian
|
f0bec85ef8
|
Added Fuck'n'Drive and Jizz On Teens latest layouts to First Anal Quest scraper.
|
2020-12-05 02:24:31 +01:00 |
|
DebaucheryLibrarian
|
2e0fba3de9
|
Added First Anal Quest and Double View Casting profile scrapers.
|
2020-12-04 23:53:20 +01:00 |
|
DebaucheryLibrarian
|
be1821b9eb
|
Changed --inspect to --report to avoid conflict with Node's own debug tools.
|
2020-12-02 21:26:55 +01:00 |
|
DebaucheryLibrarian
|
f5939c81d3
|
1.144.0
|
2020-12-02 03:17:42 +01:00 |
|
DebaucheryLibrarian
|
2656e3adb0
|
Added First Anal Quest and Double View Casting latest and scene scraper.
|
2020-12-02 03:17:32 +01:00 |
|
DebaucheryLibrarian
|
bfbfa761ef
|
1.143.2
|
2020-12-01 23:00:24 +01:00 |
|
DebaucheryLibrarian
|
6f19a8a642
|
Using ageFromBirth for age on scene date. Using infinite depth and colors for inspect.
|
2020-12-01 23:00:14 +01:00 |
|
DebaucheryLibrarian
|
bfbd2ddc00
|
1.143.1
|
2020-11-30 03:09:37 +01:00 |
|
DebaucheryLibrarian
|
eaa40190cc
|
Fixed entity link in search results.
|
2020-11-30 03:09:31 +01:00 |
|
DebaucheryLibrarian
|
2758b90019
|
1.143.0
|
2020-11-29 04:00:12 +01:00 |
|
DebaucheryLibrarian
|
9a61d2305c
|
Added fixed actor age. Added male profiles to Littlr Caprice Dreams scraper. Added various tag photos.
|
2020-11-29 03:59:47 +01:00 |
|
DebaucheryLibrarian
|
71c884fe48
|
Improved Little Caprice Dreams scraper.
|
2020-11-28 00:46:30 +01:00 |
|
DebaucheryLibrarian
|
9a183c7ffb
|
Added channel matching to Little Caprice Dreams.
|
2020-11-27 03:23:12 +01:00 |
|
DebaucheryLibrarian
|
60485751e2
|
Added support for upcoming scenes to Bang scraper.
|
2020-11-26 22:07:54 +01:00 |
|
DebaucheryLibrarian
|
4e559f63e3
|
Including all children of included networks, separated included children into dedicated property.
|
2020-11-26 04:26:52 +01:00 |
|
DebaucheryLibrarian
|
1b407254a7
|
Increased hard limit in release API.
|
2020-11-26 04:01:01 +01:00 |
|
DebaucheryLibrarian
|
0b86def315
|
Ignoring non-scene page (possible CF or similar protection) in Vixen scraper.
|
2020-11-26 03:27:21 +01:00 |
|
DebaucheryLibrarian
|
6633ce78d0
|
Returning empty array instead of null from empty Vixen page.
|
2020-11-26 03:14:32 +01:00 |
|
DebaucheryLibrarian
|
54df9d0c78
|
Fixed empty page breaking Vixen scraper.
|
2020-11-26 03:13:43 +01:00 |
|
DebaucheryLibrarian
|
980efbc93d
|
Added series as channels with logos and photo album scraping to Little Caprice. Added various tag photos.
|
2020-11-24 04:29:44 +01:00 |
|
DebaucheryLibrarian
|
711a9441a6
|
Added Little Caprice Dreams scraped (WIP).
|
2020-11-23 04:32:56 +01:00 |
|
DebaucheryLibrarian
|
eae9ee3cbe
|
1.142.2
|
2020-11-23 00:38:30 +01:00 |
|
DebaucheryLibrarian
|
8688c28d0f
|
Replaced queueMethod in media sources for new interval/concurrency options.
|
2020-11-23 00:38:22 +01:00 |
|
DebaucheryLibrarian
|
aa1bba84aa
|
1.142.1
|
2020-11-23 00:30:28 +01:00 |
|
DebaucheryLibrarian
|
ca7c8f0afd
|
Updated place resolve module to use new HTTP module.
|
2020-11-23 00:30:20 +01:00 |
|
DebaucheryLibrarian
|
d4c5da2a76
|
1.142.0
|
2020-11-23 00:05:16 +01:00 |
|
DebaucheryLibrarian
|
0633197793
|
Removed direct bhttp usage from scrapers in favor of local http module. Deleted legacy scrapers, as old code is available via git repo history.
|
2020-11-23 00:05:02 +01:00 |
|
DebaucheryLibrarian
|
3d427f7e1d
|
Allowing HTTP rate limits to be set by configuration or argument.
|
2020-11-22 23:50:24 +01:00 |
|
DebaucheryLibrarian
|
6a5063cf32
|
Fixed PornCZ scene photos attribute.
|
2020-11-22 04:13:21 +01:00 |
|
DebaucheryLibrarian
|
081a5a1e8c
|
Updated HTTP call in Gamma scraper.
|
2020-11-22 04:09:44 +01:00 |
|
DebaucheryLibrarian
|
b9b777c621
|
Using new HTTP module with a dynamic rate limiter.
|
2020-11-22 04:07:09 +01:00 |
|
DebaucheryLibrarian
|
5d0fe44130
|
1.141.2
|
2020-11-19 02:01:24 +01:00 |
|
DebaucheryLibrarian
|
77f9193669
|
Updated Dorcel scraper, added movie support.
|
2020-11-19 02:01:13 +01:00 |
|
DebaucheryLibrarian
|
ecc90be12c
|
1.141.1
|
2020-11-15 23:50:11 +01:00 |
|
DebaucheryLibrarian
|
d14ef90136
|
Scraping actor scenes from Hussie Pass. Adding entity to actor base releases.
|
2020-11-15 23:50:04 +01:00 |
|
DebaucheryLibrarian
|
b952b758d7
|
1.141.0
|
2020-11-15 04:33:40 +01:00 |
|
DebaucheryLibrarian
|
df9a6eac05
|
Updated Hussie Pass scraper for new site design. Added cock size to profiles.
|
2020-11-15 04:33:24 +01:00 |
|
DebaucheryLibrarian
|
b3a5d7f379
|
Fixed JayRock status response,
|
2020-11-13 01:23:06 +01:00 |
|
DebaucheryLibrarian
|
cc7c9f3b31
|
1.140.2
|
2020-11-13 01:16:27 +01:00 |
|
DebaucheryLibrarian
|
8a22ff07a6
|
Merged legacy JayRock scraper into new scraper for CosPimps.
|
2020-11-13 01:16:17 +01:00 |
|
DebaucheryLibrarian
|
2063d66550
|
Ignoring placeholder avatar in Jay Rock scraper.
|
2020-11-10 22:44:15 +01:00 |
|
DebaucheryLibrarian
|
e698146d94
|
1.140.1
|
2020-11-05 02:22:23 +01:00 |
|
DebaucheryLibrarian
|
4408507371
|
Added creampie tag photo.
|
2020-11-05 02:22:15 +01:00 |
|
DebaucheryLibrarian
|
574f53c66d
|
1.140.0
|
2020-11-04 04:03:02 +01:00 |
|
DebaucheryLibrarian
|
a3c18ca577
|
Rewrote Jay Rock scraper for new website.
|
2020-11-04 04:02:51 +01:00 |
|
DebaucheryLibrarian
|
ec7acd46a0
|
1.139.7
|
2020-11-03 03:36:43 +01:00 |
|
DebaucheryLibrarian
|
6976eb337d
|
Added various tag photos.
|
2020-11-03 03:36:34 +01:00 |
|
DebaucheryLibrarian
|
994413c509
|
1.139.6
|
2020-11-02 04:55:16 +01:00 |
|
DebaucheryLibrarian
|
0078dba085
|
Added various tag photos.
|
2020-11-02 04:49:16 +01:00 |
|
DebaucheryLibrarian
|
9a636b81a6
|
1.139.5
|
2020-11-01 05:25:38 +01:00 |
|
DebaucheryLibrarian
|
734de26559
|
Added various tag photos.
|
2020-11-01 05:25:29 +01:00 |
|
DebaucheryLibrarian
|
aa5e9a9c8b
|
1.139.4
|
2020-11-01 03:25:37 +01:00 |
|
DebaucheryLibrarian
|
8586817963
|
Fixed Insex html table selector.
|
2020-11-01 03:25:30 +01:00 |
|
DebaucheryLibrarian
|
ccca6a7714
|
1.139.3
|
2020-11-01 02:58:29 +01:00 |
|
DebaucheryLibrarian
|
c1fffe5cdb
|
Added alternative layout to Insex for updated Topgrl and Sexually Broken sites.
|
2020-11-01 02:58:21 +01:00 |
|
DebaucheryLibrarian
|
7c11b2204e
|
1.139.2
|
2020-10-31 04:53:50 +01:00 |
|
DebaucheryLibrarian
|
72859ede85
|
Added various tag photos.
|
2020-10-31 04:53:40 +01:00 |
|
DebaucheryLibrarian
|
30c002d0f2
|
1.139.1
|
2020-10-30 17:51:56 +01:00 |
|
DebaucheryLibrarian
|
3855d96135
|
Removed 'null' from scene tile URL if no slug is available.
|
2020-10-30 17:51:47 +01:00 |
|
DebaucheryLibrarian
|
7974be05e9
|
1.139.0
|
2020-10-30 17:37:19 +01:00 |
|
DebaucheryLibrarian
|
39f8c037a5
|
Replaced bhttp with patched fork. Improved Jesse Loads Monster Facials scraper reliability (WIP). Added various tag photos.
|
2020-10-30 17:37:10 +01:00 |
|
DebaucheryLibrarian
|
4af7597441
|
1.138.9
|
2020-10-29 16:06:27 +01:00 |
|
DebaucheryLibrarian
|
c37d4ad01f
|
Filtering invalid actors from releases before storing.
|
2020-10-29 16:06:20 +01:00 |
|
DebaucheryLibrarian
|
2801732f57
|
1.138.8
|
2020-10-29 15:21:08 +01:00 |
|
DebaucheryLibrarian
|
b188bc5744
|
Filtering out empty or unidentified scenes from update scraper, with warning. Improved Jesse Loads Monster Facials reliability.
|
2020-10-29 15:20:59 +01:00 |
|
DebaucheryLibrarian
|
f4b1fb4831
|
1.138.7
|
2020-10-28 15:28:43 +01:00 |
|
DebaucheryLibrarian
|
8c553d5b3d
|
Added traxxx dummy network to default excludes.
|
2020-10-28 15:28:39 +01:00 |
|
DebaucheryLibrarian
|
e40d7ba181
|
1.138.6
|
2020-10-28 03:51:15 +01:00 |
|
DebaucheryLibrarian
|
4469376dd2
|
Using temporary table instead of WHERE IN to stack depth error when finding duplicate actors.
|
2020-10-28 03:50:52 +01:00 |
|
DebaucheryLibrarian
|
64a52fbb1e
|
1.138.5
|
2020-10-28 01:36:21 +01:00 |
|
DebaucheryLibrarian
|
bf9b334b73
|
Adding scraper config by scraper slug to current 'includes' parameter.
|
2020-10-28 01:36:13 +01:00 |
|
DebaucheryLibrarian
|
1869877178
|
Added release covers table to flush routine.
|
2020-10-27 02:40:30 +01:00 |
|
DebaucheryLibrarian
|
209fe67bb0
|
1.138.4
|
2020-10-27 02:34:15 +01:00 |
|
DebaucheryLibrarian
|
7257776ba8
|
Mapping avatar to media ID in orphan delete.
|
2020-10-27 02:34:06 +01:00 |
|
DebaucheryLibrarian
|
af7fa56e02
|
1.138.3
|
2020-10-27 02:10:03 +01:00 |
|
DebaucheryLibrarian
|
1d3ec96e8d
|
Detecting profile avatars in orphaned media flush.
|
2020-10-27 02:09:52 +01:00 |
|
DebaucheryLibrarian
|
99a7bfeb4c
|
Added traxxx dummy network.
|
2020-10-26 01:42:38 +01:00 |
|
DebaucheryLibrarian
|
15810333b9
|
1.138.2
|
2020-10-25 21:43:45 +01:00 |
|
DebaucheryLibrarian
|
0027be65eb
|
Fixed CzechAV to accomodate teasers instead of photos. Fixed error trying to flush non-existent media file.
|
2020-10-25 21:43:36 +01:00 |
|
DebaucheryLibrarian
|
0e804db130
|
1.138.1
|
2020-10-25 01:29:41 +02:00 |
|
DebaucheryLibrarian
|
57a44d6643
|
Expanded README.
|
2020-10-25 01:29:25 +02:00 |
|
DebaucheryLibrarian
|
7e3e0d8f30
|
Merge branch 'experimental' into master
|
2020-10-25 01:22:50 +02:00 |
|
DebaucheryLibrarian
|
07b94f1513
|
Updated README.
|
2020-10-25 01:22:40 +02:00 |
|
DebaucheryLibrarian
|
9619f7e7ed
|
1.138.0
|
2020-10-25 01:17:51 +02:00 |
|
DebaucheryLibrarian
|
0bd7fca876
|
Added orphaned media flush and batch release flush.
|
2020-10-25 00:52:40 +02:00 |
|
DebaucheryLibrarian
|
ef852f0191
|
1.137.6
|
2020-10-20 21:04:36 +02:00 |
|
DebaucheryLibrarian
|
6791053c83
|
Fixed entity alias available through wrong type endpoint.
|
2020-10-20 21:04:29 +02:00 |
|
DebaucheryLibrarian
|
47238b2969
|
1.137.5
|
2020-10-20 15:37:50 +02:00 |
|
DebaucheryLibrarian
|
9f3c686913
|
Added thumbnail and favicon to entity REST API.
|
2020-10-20 15:37:42 +02:00 |
|
DebaucheryLibrarian
|
cefd91a7b9
|
1.137.4
|
2020-10-20 15:29:51 +02:00 |
|
DebaucheryLibrarian
|
ecdd6d8fb0
|
Added logo path to entity API.
|
2020-10-20 15:28:58 +02:00 |
|
DebaucheryLibrarian
|
60eb599416
|
Added alias to entity search query.
|
2020-10-20 00:25:32 +02:00 |
|
DebaucheryLibrarian
|
8e7b944b52
|
1.137.3
|
2020-10-20 00:21:25 +02:00 |
|
DebaucheryLibrarian
|
6b17f9d1f2
|
Allowing entity to be fetched by alias.
|
2020-10-20 00:21:15 +02:00 |
|
DebaucheryLibrarian
|
cb459d4cc7
|
1.137.2
|
2020-10-20 00:08:24 +02:00 |
|
DebaucheryLibrarian
|
d795266114
|
Removed no-date-limit as argument due yargs conflict.
|
2020-10-20 00:08:14 +02:00 |
|
DebaucheryLibrarian
|
3e303e4b10
|
1.137.1
|
2020-10-20 00:05:34 +02:00 |
|