DebaucheryLibrarian
|
7ff222ce25
|
Passing recursive parameters to all scraper methods. Using throttle parameters in MindGeek scraper, fixed missing slug breaking scene and actor URLs.
|
2021-02-10 03:23:48 +01:00 |
|
DebaucheryLibrarian
|
998774fe5c
|
Added tag photos.
|
2021-02-06 04:15:28 +01:00 |
|
DebaucheryLibrarian
|
15cc970ee2
|
Added tags to release channels. Labeling DDF Network VR trailers as VR.
|
2021-02-05 01:54:06 +01:00 |
|
DebaucheryLibrarian
|
f217b161b4
|
Scraping scene photos from Bang API.
|
2021-02-04 22:55:19 +01:00 |
|
DebaucheryLibrarian
|
ff123b99b7
|
Added WankzVR update, scene and profile scraper.
|
2021-02-04 01:13:02 +01:00 |
|
DebaucheryLibrarian
|
0b99e72924
|
Added Kink VR to Kink network using BaDoink scraper.
|
2021-02-03 21:29:56 +01:00 |
|
DebaucheryLibrarian
|
79b51eca67
|
Added BaDoink profile scraper. Improved convert wrapper.
|
2021-02-03 21:03:35 +01:00 |
|
DebaucheryLibrarian
|
cd417f40a8
|
Fixed VR tags in seed, fixed Honour May LP studio name and slug mixup.
|
2021-02-03 20:11:28 +01:00 |
|
DebaucheryLibrarian
|
8dabef57b6
|
Added missing LegalPorno studios with prefix codes.
|
2021-02-03 20:00:42 +01:00 |
|
DebaucheryLibrarian
|
8ea3fccb61
|
Added VR tag photos.
|
2021-02-03 03:22:43 +01:00 |
|
DebaucheryLibrarian
|
0c2e45141d
|
Added BaDoink latest and scene scraper.
|
2021-02-03 02:59:39 +01:00 |
|
DebaucheryLibrarian
|
6d93083581
|
Removed superfluous MindGeek scrapers.
|
2021-02-03 00:46:59 +01:00 |
|
DebaucheryLibrarian
|
4db9a34a34
|
Removed superfluous Gamma scrapers.
|
2021-02-02 22:36:47 +01:00 |
|
DebaucheryLibrarian
|
aade7490f8
|
Querying infinite parent depth for deep release entities.
|
2021-02-01 01:45:30 +01:00 |
|
DebaucheryLibrarian
|
97c088cfb4
|
Added Anal Only and upcoming scraping to Mike Adriano. Fixed profile expand arrow color.
|
2021-01-30 17:43:33 +01:00 |
|
DebaucheryLibrarian
|
bfb5006e95
|
Added actor scene URL parameter to Gamma scraper to phase out release URL function.
|
2021-01-30 01:12:42 +01:00 |
|
DebaucheryLibrarian
|
9535ab7953
|
Regarding layout parameters from parent and grandparent entities. Removed Evil Angel and Fantasy Massage scraper wrappers.
|
2021-01-30 00:01:40 +01:00 |
|
DebaucheryLibrarian
|
6938e88fbf
|
Fixed some Gamma scene scrapers.
|
2021-01-29 04:26:45 +01:00 |
|
DebaucheryLibrarian
|
4d89256a4c
|
Merging improvements.
|
2021-01-27 00:21:58 +01:00 |
|
DebaucheryLibrarian
|
486dbc5613
|
Improved Woodman scraper, added profiles.
|
2021-01-25 00:10:57 +01:00 |
|
DebaucheryLibrarian
|
e9cbf5dab2
|
Added Woodman Casting X and WUNF update and scene scraper. Fixed actor and fallback media arrays being merged in deep scraper.
|
2021-01-24 23:31:28 +01:00 |
|
DebaucheryLibrarian
|
b16cc26024
|
Added Zero Tolerance channel to network.
|
2021-01-22 00:26:06 +01:00 |
|
DebaucheryLibrarian
|
a95e409366
|
Fixed Kink deep scrape photos. Fixed favicon ratio in compact scene tile. Hiding scroll buttons on small screens.
|
2021-01-19 15:58:27 +01:00 |
|
DebaucheryLibrarian
|
dd5284c55a
|
Fixed scroll to top.
|
2021-01-17 21:24:20 +01:00 |
|
DebaucheryLibrarian
|
251bb9476d
|
Added Gaywire, modified Bang Bros scraper to accomodate.
|
2021-01-17 01:43:55 +01:00 |
|
DebaucheryLibrarian
|
b8df8e6507
|
Added Top Web Models update and scene scraper.
|
2021-01-15 04:04:32 +01:00 |
|
DebaucheryLibrarian
|
12c3f0d7b9
|
Added Top Web Models framework.
|
2021-01-14 01:37:50 +01:00 |
|
DebaucheryLibrarian
|
39d149c728
|
Added default deep scrape fetch method. Added Karups scene and profile scraper. Added schoolgirl tag photo.
|
2021-01-13 21:29:05 +01:00 |
|
DebaucheryLibrarian
|
ae0efccb04
|
Skipping Babel, updated node version. Improved deep scrape array merge.
|
2021-01-13 16:08:19 +01:00 |
|
DebaucheryLibrarian
|
52356f0f31
|
Added Pinky XXX, changed ethnicity tags.
|
2021-01-13 00:52:05 +01:00 |
|
DebaucheryLibrarian
|
db4e74fb99
|
Fixed Nubiles base poster query, handling trailing commas in qu source set. Added profile scene scraper to Dogfart. Added tag photo.
|
2021-01-11 16:20:01 +01:00 |
|
DebaucheryLibrarian
|
9ca2ec6dd0
|
Fixed parent entity relations in seed file. Fixed MindGeek scraper session URL determination.
|
2021-01-05 16:27:20 +01:00 |
|
DebaucheryLibrarian
|
150988ecb9
|
Fixed filter tooltips closing on click. Added tag photo.
|
2021-01-05 03:29:02 +01:00 |
|
DebaucheryLibrarian
|
7bbb2f3557
|
Added tag filter dialog.
|
2021-01-03 22:53:51 +01:00 |
|
DebaucheryLibrarian
|
f27af19670
|
Added tag photo.
|
2021-01-03 16:36:47 +01:00 |
|
DebaucheryLibrarian
|
236d4fcde7
|
Fixed scene media lazy image. Fixed Perv City actor scope.
|
2021-01-01 04:28:10 +01:00 |
|
DebaucheryLibrarian
|
83f51219e4
|
Updated warning message. Added grandparent networks to network seed file, merged 21Naturals and 21Sextreme into 21Sextury.
|
2020-12-18 23:28:02 +01:00 |
|
DebaucheryLibrarian
|
112970050c
|
Updated tag photos.
|
2020-12-18 04:08:28 +01:00 |
|
DebaucheryLibrarian
|
cd8e810c35
|
Fixed various Kelly Madison scraper issues.
|
2020-12-17 02:05:01 +01:00 |
|
DebaucheryLibrarian
|
9413bd5357
|
Updated tag photos.
|
2020-12-16 03:53:44 +01:00 |
|
DebaucheryLibrarian
|
6ed02933a6
|
Added tag photos.
|
2020-12-15 04:45:04 +01:00 |
|
DebaucheryLibrarian
|
07f0249717
|
Upgraded pg, knex and postgraphile. Updated nvmrc version to latest node LTS. Fixed Gamma scraper not passing request headers to new http module.
|
2020-12-14 03:16:47 +01:00 |
|
DebaucheryLibrarian
|
f0bec85ef8
|
Added Fuck'n'Drive and Jizz On Teens latest layouts to First Anal Quest scraper.
|
2020-12-05 02:24:31 +01:00 |
|
DebaucheryLibrarian
|
be1821b9eb
|
Changed --inspect to --report to avoid conflict with Node's own debug tools.
|
2020-12-02 21:26:55 +01:00 |
|
DebaucheryLibrarian
|
2656e3adb0
|
Added First Anal Quest and Double View Casting latest and scene scraper.
|
2020-12-02 03:17:32 +01:00 |
|
DebaucheryLibrarian
|
9a61d2305c
|
Added fixed actor age. Added male profiles to Littlr Caprice Dreams scraper. Added various tag photos.
|
2020-11-29 03:59:47 +01:00 |
|
DebaucheryLibrarian
|
54df9d0c78
|
Fixed empty page breaking Vixen scraper.
|
2020-11-26 03:13:43 +01:00 |
|
DebaucheryLibrarian
|
980efbc93d
|
Added series as channels with logos and photo album scraping to Little Caprice. Added various tag photos.
|
2020-11-24 04:29:44 +01:00 |
|
DebaucheryLibrarian
|
711a9441a6
|
Added Little Caprice Dreams scraped (WIP).
|
2020-11-23 04:32:56 +01:00 |
|
DebaucheryLibrarian
|
b9b777c621
|
Using new HTTP module with a dynamic rate limiter.
|
2020-11-22 04:07:09 +01:00 |
|
DebaucheryLibrarian
|
77f9193669
|
Updated Dorcel scraper, added movie support.
|
2020-11-19 02:01:13 +01:00 |
|
DebaucheryLibrarian
|
d14ef90136
|
Scraping actor scenes from Hussie Pass. Adding entity to actor base releases.
|
2020-11-15 23:50:04 +01:00 |
|
DebaucheryLibrarian
|
df9a6eac05
|
Updated Hussie Pass scraper for new site design. Added cock size to profiles.
|
2020-11-15 04:33:24 +01:00 |
|
DebaucheryLibrarian
|
b3a5d7f379
|
Fixed JayRock status response,
|
2020-11-13 01:23:06 +01:00 |
|
DebaucheryLibrarian
|
8a22ff07a6
|
Merged legacy JayRock scraper into new scraper for CosPimps.
|
2020-11-13 01:16:17 +01:00 |
|
DebaucheryLibrarian
|
4408507371
|
Added creampie tag photo.
|
2020-11-05 02:22:15 +01:00 |
|
DebaucheryLibrarian
|
a3c18ca577
|
Rewrote Jay Rock scraper for new website.
|
2020-11-04 04:02:51 +01:00 |
|
DebaucheryLibrarian
|
6976eb337d
|
Added various tag photos.
|
2020-11-03 03:36:34 +01:00 |
|
DebaucheryLibrarian
|
0078dba085
|
Added various tag photos.
|
2020-11-02 04:49:16 +01:00 |
|
DebaucheryLibrarian
|
734de26559
|
Added various tag photos.
|
2020-11-01 05:25:29 +01:00 |
|
DebaucheryLibrarian
|
c1fffe5cdb
|
Added alternative layout to Insex for updated Topgrl and Sexually Broken sites.
|
2020-11-01 02:58:21 +01:00 |
|
DebaucheryLibrarian
|
72859ede85
|
Added various tag photos.
|
2020-10-31 04:53:40 +01:00 |
|
DebaucheryLibrarian
|
39f8c037a5
|
Replaced bhttp with patched fork. Improved Jesse Loads Monster Facials scraper reliability (WIP). Added various tag photos.
|
2020-10-30 17:37:10 +01:00 |
|
DebaucheryLibrarian
|
b188bc5744
|
Filtering out empty or unidentified scenes from update scraper, with warning. Improved Jesse Loads Monster Facials reliability.
|
2020-10-29 15:20:59 +01:00 |
|
DebaucheryLibrarian
|
1d3ec96e8d
|
Detecting profile avatars in orphaned media flush.
|
2020-10-27 02:09:52 +01:00 |
|
DebaucheryLibrarian
|
99a7bfeb4c
|
Added traxxx dummy network.
|
2020-10-26 01:42:38 +01:00 |
|
DebaucheryLibrarian
|
6b17f9d1f2
|
Allowing entity to be fetched by alias.
|
2020-10-20 00:21:15 +02:00 |
|
DebaucheryLibrarian
|
593ce27312
|
Added rudimentary scene and entity scene remove.
|
2020-10-19 02:02:21 +02:00 |
|
DebaucheryLibrarian
|
013e85cf2a
|
Added various tag photos.
|
2020-10-13 04:04:09 +02:00 |
|
DebaucheryLibrarian
|
8aefb8eddb
|
Added and updated tag photos.
|
2020-10-07 03:40:19 +02:00 |
|
DebaucheryLibrarian
|
3f843cc0fc
|
Added version to stats page.
|
2020-09-25 21:21:26 +02:00 |
|
DebaucheryLibrarian
|
566c20ea7e
|
Added various tag photos. Renamed some toy tags.
|
2020-09-21 05:11:24 +02:00 |
|
DebaucheryLibrarian
|
3c9468b0f1
|
Fixed wrong MindGeek session acquire URL.
|
2020-09-18 03:27:00 +02:00 |
|
DebaucheryLibrarian
|
796a624d2b
|
Changed Updated various tag posters.
|
2020-09-17 04:01:40 +02:00 |
|
DebaucheryLibrarian
|
1a8de4fcf6
|
Added mimetype verification option to media source to ensure server returned a plausible file. Added additional fallbacks to Jules Jordan poster scraper for Amateur Allure.
|
2020-09-17 02:30:58 +02:00 |
|
DebaucheryLibrarian
|
6fb15fb591
|
Added Dorcel Club with scene and actor scraping. Added count method to qu.
|
2020-09-16 04:55:30 +02:00 |
|
DebaucheryLibrarian
|
7fd7005776
|
Added profile scraper to Pascals Subsluts.
|
2020-09-16 01:42:15 +02:00 |
|
DebaucheryLibrarian
|
bc34c6edb4
|
Added Bang Bros Vault channel.
|
2020-09-14 16:01:27 +02:00 |
|
DebaucheryLibrarian
|
ba7419d3b0
|
Added basic Pascals Subsluts scraper.
|
2020-09-14 02:40:27 +02:00 |
|
DebaucheryLibrarian
|
beeaebbfb7
|
Added CzechAV.
|
2020-09-14 00:53:41 +02:00 |
|
DebaucheryLibrarian
|
471f8f2bec
|
Improve date range precision.
|
2020-09-11 02:29:14 +02:00 |
|
DebaucheryLibrarian
|
88eeab410b
|
Added filter parameter to Gamma scraper to distinguish Evil Angel exclusives from channel scenes.
|
2020-09-10 03:43:16 +02:00 |
|
DebaucheryLibrarian
|
0d4893b13c
|
Added Evil Angel channels with logos.
|
2020-09-10 03:17:19 +02:00 |
|
DebaucheryLibrarian
|
a285313bae
|
Changed Evil Angel type to network and added Anal Acrobats.
|
2020-09-09 22:23:37 +02:00 |
|
DebaucheryLibrarian
|
860d88fe56
|
Fixed tag tile links.
|
2020-09-09 21:36:52 +02:00 |
|
DebaucheryLibrarian
|
8aaa88770f
|
Accounting for Windows paths in logger.
|
2020-09-08 15:44:55 +02:00 |
|
DebaucheryLibrarian
|
03ba35d65a
|
Fixed include object. Fixed qu's undefined URL handling.
|
2020-09-08 03:26:34 +02:00 |
|
DebaucheryLibrarian
|
7c6243cf33
|
Combined scene and movie components.
|
2020-09-08 02:20:15 +02:00 |
|
DebaucheryLibrarian
|
c96e10b33d
|
Improved SFW and tag media seed file to allow updates.
|
2020-09-05 02:57:24 +02:00 |
|
DebaucheryLibrarian
|
e90bb63a8f
|
Added American Pornstar. Improved Jules Jordan scraper to accomodate for American Pornstar. Changed entity logo mogrify settings to ensure both minimum height and width.
|
2020-09-05 01:56:54 +02:00 |
|
DebaucheryLibrarian
|
3c84a814a8
|
Added Zero Tolerance with Addicted 2 Girls and GenderX.
|
2020-09-04 03:07:28 +02:00 |
|
DebaucheryLibrarian
|
c187a27123
|
Added Hookup Hotshot.
|
2020-09-03 22:22:12 +02:00 |
|
DebaucheryLibrarian
|
f6353ca14c
|
Storing actor profile URL when provided from scene page.
|
2020-08-31 02:43:41 +02:00 |
|
DebaucheryLibrarian
|
53b0101a12
|
Added new Naughty America sites.
|
2020-08-26 23:59:29 +02:00 |
|
DebaucheryLibrarian
|
8611d738b0
|
Using UTC to query date ranges. Removed stray console log from MindGeek scraper.
|
2020-08-26 02:01:38 +02:00 |
|
DebaucheryLibrarian
|
7fed5b7138
|
Moved Brazzers to MindGeek scraper to support new site.
|
2020-08-24 05:13:34 +02:00 |
|
DebaucheryLibrarian
|
c3d771c8fc
|
Hush scraper uses children from entity argument for filter regexp, instead of making its own database request.
|
2020-08-23 03:31:37 +02:00 |
|
DebaucheryLibrarian
|
3a5ea3dd9a
|
Returning duplicate releases from pagination.
|
2020-08-22 04:22:56 +02:00 |
|
DebaucheryLibrarian
|
4ec89e2cc8
|
Added upcoming, profile and detailed scene actor scraping to InTheCrack. Fixed clip upsert.
|
2020-08-20 23:35:18 +02:00 |
|
DebaucheryLibrarian
|
501e764c21
|
Renamed chapters to clips. Fixed Vixen trailers.
|
2020-08-20 19:52:02 +02:00 |