DebaucheryLibrarian
|
0633197793
|
Removed direct bhttp usage from scrapers in favor of local http module. Deleted legacy scrapers, as old code is available via git repo history.
|
2020-11-23 00:05:02 +01:00 |
|
DebaucheryLibrarian
|
3d427f7e1d
|
Allowing HTTP rate limits to be set by configuration or argument.
|
2020-11-22 23:50:24 +01:00 |
|
DebaucheryLibrarian
|
6a5063cf32
|
Fixed PornCZ scene photos attribute.
|
2020-11-22 04:13:21 +01:00 |
|
DebaucheryLibrarian
|
081a5a1e8c
|
Updated HTTP call in Gamma scraper.
|
2020-11-22 04:09:44 +01:00 |
|
DebaucheryLibrarian
|
b9b777c621
|
Using new HTTP module with a dynamic rate limiter.
|
2020-11-22 04:07:09 +01:00 |
|
DebaucheryLibrarian
|
77f9193669
|
Updated Dorcel scraper, added movie support.
|
2020-11-19 02:01:13 +01:00 |
|
DebaucheryLibrarian
|
d14ef90136
|
Scraping actor scenes from Hussie Pass. Adding entity to actor base releases.
|
2020-11-15 23:50:04 +01:00 |
|
DebaucheryLibrarian
|
df9a6eac05
|
Updated Hussie Pass scraper for new site design. Added cock size to profiles.
|
2020-11-15 04:33:24 +01:00 |
|
DebaucheryLibrarian
|
b3a5d7f379
|
Fixed JayRock status response,
|
2020-11-13 01:23:06 +01:00 |
|
DebaucheryLibrarian
|
8a22ff07a6
|
Merged legacy JayRock scraper into new scraper for CosPimps.
|
2020-11-13 01:16:17 +01:00 |
|
DebaucheryLibrarian
|
2063d66550
|
Ignoring placeholder avatar in Jay Rock scraper.
|
2020-11-10 22:44:15 +01:00 |
|
DebaucheryLibrarian
|
a3c18ca577
|
Rewrote Jay Rock scraper for new website.
|
2020-11-04 04:02:51 +01:00 |
|
DebaucheryLibrarian
|
8586817963
|
Fixed Insex html table selector.
|
2020-11-01 03:25:30 +01:00 |
|
DebaucheryLibrarian
|
c1fffe5cdb
|
Added alternative layout to Insex for updated Topgrl and Sexually Broken sites.
|
2020-11-01 02:58:21 +01:00 |
|
DebaucheryLibrarian
|
3855d96135
|
Removed 'null' from scene tile URL if no slug is available.
|
2020-10-30 17:51:47 +01:00 |
|
DebaucheryLibrarian
|
39f8c037a5
|
Replaced bhttp with patched fork. Improved Jesse Loads Monster Facials scraper reliability (WIP). Added various tag photos.
|
2020-10-30 17:37:10 +01:00 |
|
DebaucheryLibrarian
|
c37d4ad01f
|
Filtering invalid actors from releases before storing.
|
2020-10-29 16:06:20 +01:00 |
|
DebaucheryLibrarian
|
b188bc5744
|
Filtering out empty or unidentified scenes from update scraper, with warning. Improved Jesse Loads Monster Facials reliability.
|
2020-10-29 15:20:59 +01:00 |
|
DebaucheryLibrarian
|
bf9b334b73
|
Adding scraper config by scraper slug to current 'includes' parameter.
|
2020-10-28 01:36:13 +01:00 |
|
DebaucheryLibrarian
|
1d3ec96e8d
|
Detecting profile avatars in orphaned media flush.
|
2020-10-27 02:09:52 +01:00 |
|
DebaucheryLibrarian
|
99a7bfeb4c
|
Added traxxx dummy network.
|
2020-10-26 01:42:38 +01:00 |
|
DebaucheryLibrarian
|
0027be65eb
|
Fixed CzechAV to accomodate teasers instead of photos. Fixed error trying to flush non-existent media file.
|
2020-10-25 21:43:36 +01:00 |
|
DebaucheryLibrarian
|
0bd7fca876
|
Added orphaned media flush and batch release flush.
|
2020-10-25 00:52:40 +02:00 |
|
DebaucheryLibrarian
|
c94e1aaea9
|
Handling missing trailers in Kink scraper.
|
2020-09-18 23:25:15 +02:00 |
|
DebaucheryLibrarian
|
3789ef51f2
|
(Temporarily) removed studio filter from entity query for performance reasons.
|
2020-09-18 22:43:45 +02:00 |
|
DebaucheryLibrarian
|
3c9468b0f1
|
Fixed wrong MindGeek session acquire URL.
|
2020-09-18 03:27:00 +02:00 |
|
DebaucheryLibrarian
|
a4929819df
|
Using channel URL instead of composed URL for session retrieval, should fix Brazzers.
|
2020-09-18 02:54:05 +02:00 |
|
DebaucheryLibrarian
|
a9fa71e455
|
Fixed predata parameter in Assylum scraper.
|
2020-09-17 14:49:45 +02:00 |
|
DebaucheryLibrarian
|
1a8de4fcf6
|
Added mimetype verification option to media source to ensure server returned a plausible file. Added additional fallbacks to Jules Jordan poster scraper for Amateur Allure.
|
2020-09-17 02:30:58 +02:00 |
|
DebaucheryLibrarian
|
0190ee9531
|
Fixed Porn Doe's poster query. Checking style attribute existence in qu before attempting to use it.
|
2020-09-17 00:35:41 +02:00 |
|
DebaucheryLibrarian
|
6fb15fb591
|
Added Dorcel Club with scene and actor scraping. Added count method to qu.
|
2020-09-16 04:55:30 +02:00 |
|
DebaucheryLibrarian
|
a8c525f4fc
|
Hard-coded Pascal White as the male actor for Pascal's Sub Sluts. Added female gender to all Sub Sluts.
|
2020-09-16 02:38:59 +02:00 |
|
DebaucheryLibrarian
|
7c4dd03a8c
|
Ignoring 'Lockdown Submissions' as actor for Pascals Subsluts.
|
2020-09-16 01:45:58 +02:00 |
|
DebaucheryLibrarian
|
7fd7005776
|
Added profile scraper to Pascals Subsluts.
|
2020-09-16 01:42:15 +02:00 |
|
DebaucheryLibrarian
|
bc34c6edb4
|
Added Bang Bros Vault channel.
|
2020-09-14 16:01:27 +02:00 |
|
DebaucheryLibrarian
|
ba7419d3b0
|
Added basic Pascals Subsluts scraper.
|
2020-09-14 02:40:27 +02:00 |
|
DebaucheryLibrarian
|
beeaebbfb7
|
Added CzechAV.
|
2020-09-14 00:53:41 +02:00 |
|
DebaucheryLibrarian
|
eb6337f6fb
|
Fixed upcoming Jules Jordan scene without teaser breaking scraper.
|
2020-09-11 02:36:36 +02:00 |
|
DebaucheryLibrarian
|
0e8024adf1
|
Changed next page determination to ensure --after is followed even if there are no unique releases.
|
2020-09-10 23:49:24 +02:00 |
|
DebaucheryLibrarian
|
bec097f14d
|
Returning status codes from Gamma fetch.
|
2020-09-10 17:54:23 +02:00 |
|
DebaucheryLibrarian
|
7f8704ee2c
|
Using http instead of bhttp for Gamma.
|
2020-09-10 17:41:29 +02:00 |
|
DebaucheryLibrarian
|
5ee5b270ef
|
Added avatars to Gamma latest API.
|
2020-09-10 03:56:09 +02:00 |
|
DebaucheryLibrarian
|
88eeab410b
|
Added filter parameter to Gamma scraper to distinguish Evil Angel exclusives from channel scenes.
|
2020-09-10 03:43:16 +02:00 |
|
DebaucheryLibrarian
|
03ba35d65a
|
Fixed include object. Fixed qu's undefined URL handling.
|
2020-09-08 03:26:34 +02:00 |
|
DebaucheryLibrarian
|
e90bb63a8f
|
Added American Pornstar. Improved Jules Jordan scraper to accomodate for American Pornstar. Changed entity logo mogrify settings to ensure both minimum height and width.
|
2020-09-05 01:56:54 +02:00 |
|
DebaucheryLibrarian
|
3c84a814a8
|
Added Zero Tolerance with Addicted 2 Girls and GenderX.
|
2020-09-04 03:07:28 +02:00 |
|
DebaucheryLibrarian
|
c187a27123
|
Added Hookup Hotshot.
|
2020-09-03 22:22:12 +02:00 |
|
DebaucheryLibrarian
|
f6353ca14c
|
Storing actor profile URL when provided from scene page.
|
2020-08-31 02:43:41 +02:00 |
|
DebaucheryLibrarian
|
1bfdf4b232
|
Storing actor profiles from scene pages.
|
2020-08-30 04:18:47 +02:00 |
|
DebaucheryLibrarian
|
53b0101a12
|
Added new Naughty America sites.
|
2020-08-26 23:59:29 +02:00 |
|