DebaucheryLibrarian
|
c94e1aaea9
|
Handling missing trailers in Kink scraper.
|
2020-09-18 23:25:15 +02:00 |
|
DebaucheryLibrarian
|
3789ef51f2
|
(Temporarily) removed studio filter from entity query for performance reasons.
|
2020-09-18 22:43:45 +02:00 |
|
DebaucheryLibrarian
|
3c9468b0f1
|
Fixed wrong MindGeek session acquire URL.
|
2020-09-18 03:27:00 +02:00 |
|
DebaucheryLibrarian
|
a4929819df
|
Using channel URL instead of composed URL for session retrieval, should fix Brazzers.
|
2020-09-18 02:54:05 +02:00 |
|
DebaucheryLibrarian
|
a9fa71e455
|
Fixed predata parameter in Assylum scraper.
|
2020-09-17 14:49:45 +02:00 |
|
DebaucheryLibrarian
|
1a8de4fcf6
|
Added mimetype verification option to media source to ensure server returned a plausible file. Added additional fallbacks to Jules Jordan poster scraper for Amateur Allure.
|
2020-09-17 02:30:58 +02:00 |
|
DebaucheryLibrarian
|
0190ee9531
|
Fixed Porn Doe's poster query. Checking style attribute existence in qu before attempting to use it.
|
2020-09-17 00:35:41 +02:00 |
|
DebaucheryLibrarian
|
6fb15fb591
|
Added Dorcel Club with scene and actor scraping. Added count method to qu.
|
2020-09-16 04:55:30 +02:00 |
|
DebaucheryLibrarian
|
a8c525f4fc
|
Hard-coded Pascal White as the male actor for Pascal's Sub Sluts. Added female gender to all Sub Sluts.
|
2020-09-16 02:38:59 +02:00 |
|
DebaucheryLibrarian
|
7c4dd03a8c
|
Ignoring 'Lockdown Submissions' as actor for Pascals Subsluts.
|
2020-09-16 01:45:58 +02:00 |
|
DebaucheryLibrarian
|
7fd7005776
|
Added profile scraper to Pascals Subsluts.
|
2020-09-16 01:42:15 +02:00 |
|
DebaucheryLibrarian
|
bc34c6edb4
|
Added Bang Bros Vault channel.
|
2020-09-14 16:01:27 +02:00 |
|
DebaucheryLibrarian
|
ba7419d3b0
|
Added basic Pascals Subsluts scraper.
|
2020-09-14 02:40:27 +02:00 |
|
DebaucheryLibrarian
|
beeaebbfb7
|
Added CzechAV.
|
2020-09-14 00:53:41 +02:00 |
|
DebaucheryLibrarian
|
b57b0a38f5
|
Fixed infinite pagination when scraping upcoming scenes.
|
2020-09-13 01:41:52 +02:00 |
|
DebaucheryLibrarian
|
eb6337f6fb
|
Fixed upcoming Jules Jordan scene without teaser breaking scraper.
|
2020-09-11 02:36:36 +02:00 |
|
DebaucheryLibrarian
|
0e8024adf1
|
Changed next page determination to ensure --after is followed even if there are no unique releases.
|
2020-09-10 23:49:24 +02:00 |
|
DebaucheryLibrarian
|
bec097f14d
|
Returning status codes from Gamma fetch.
|
2020-09-10 17:54:23 +02:00 |
|
DebaucheryLibrarian
|
7f8704ee2c
|
Using http instead of bhttp for Gamma.
|
2020-09-10 17:41:29 +02:00 |
|
DebaucheryLibrarian
|
5ee5b270ef
|
Added avatars to Gamma latest API.
|
2020-09-10 03:56:09 +02:00 |
|
DebaucheryLibrarian
|
88eeab410b
|
Added filter parameter to Gamma scraper to distinguish Evil Angel exclusives from channel scenes.
|
2020-09-10 03:43:16 +02:00 |
|
DebaucheryLibrarian
|
0d4893b13c
|
Added Evil Angel channels with logos.
|
2020-09-10 03:17:19 +02:00 |
|
DebaucheryLibrarian
|
ac66606135
|
Including networks in filter count. Preserving query between date ranges. Allowing --latest to be used without --last.
|
2020-09-09 03:45:00 +02:00 |
|
DebaucheryLibrarian
|
8aaa88770f
|
Accounting for Windows paths in logger.
|
2020-09-08 15:44:55 +02:00 |
|
DebaucheryLibrarian
|
03ba35d65a
|
Fixed include object. Fixed qu's undefined URL handling.
|
2020-09-08 03:26:34 +02:00 |
|
DebaucheryLibrarian
|
e90bb63a8f
|
Added American Pornstar. Improved Jules Jordan scraper to accomodate for American Pornstar. Changed entity logo mogrify settings to ensure both minimum height and width.
|
2020-09-05 01:56:54 +02:00 |
|
DebaucheryLibrarian
|
3c84a814a8
|
Added Zero Tolerance with Addicted 2 Girls and GenderX.
|
2020-09-04 03:07:28 +02:00 |
|
DebaucheryLibrarian
|
c187a27123
|
Added Hookup Hotshot.
|
2020-09-03 22:22:12 +02:00 |
|
DebaucheryLibrarian
|
f6353ca14c
|
Storing actor profile URL when provided from scene page.
|
2020-08-31 02:43:41 +02:00 |
|
DebaucheryLibrarian
|
1bfdf4b232
|
Storing actor profiles from scene pages.
|
2020-08-30 04:18:47 +02:00 |
|
DebaucheryLibrarian
|
53b0101a12
|
Added new Naughty America sites.
|
2020-08-26 23:59:29 +02:00 |
|
DebaucheryLibrarian
|
8611d738b0
|
Using UTC to query date ranges. Removed stray console log from MindGeek scraper.
|
2020-08-26 02:01:38 +02:00 |
|
DebaucheryLibrarian
|
52f66e7982
|
Fixed undefined location in FreeOnes scraper.
|
2020-08-24 18:24:07 +02:00 |
|
DebaucheryLibrarian
|
7fed5b7138
|
Moved Brazzers to MindGeek scraper to support new site.
|
2020-08-24 05:13:34 +02:00 |
|
DebaucheryLibrarian
|
d8b8dfa299
|
Not creating batch ID when no movies are to be stored.
|
2020-08-23 03:41:29 +02:00 |
|
DebaucheryLibrarian
|
c3d771c8fc
|
Hush scraper uses children from entity argument for filter regexp, instead of making its own database request.
|
2020-08-23 03:31:37 +02:00 |
|
DebaucheryLibrarian
|
278b74e78c
|
Providing duplicate releases in predata. Using duplicates for filtering scenes without channel in Hush scraper.
|
2020-08-23 02:43:10 +02:00 |
|
DebaucheryLibrarian
|
3a5ea3dd9a
|
Returning duplicate releases from pagination.
|
2020-08-22 04:22:56 +02:00 |
|
DebaucheryLibrarian
|
5f5c48ea05
|
Fixed pagination behavior for upcoming scenes.
|
2020-08-22 01:57:23 +02:00 |
|
DebaucheryLibrarian
|
7c052fedfc
|
Fixed map error.
|
2020-08-22 00:28:22 +02:00 |
|
DebaucheryLibrarian
|
1c17cd1be5
|
Improved update scrape pagination and limits.
|
2020-08-21 03:55:51 +02:00 |
|
DebaucheryLibrarian
|
4ec89e2cc8
|
Added upcoming, profile and detailed scene actor scraping to InTheCrack. Fixed clip upsert.
|
2020-08-20 23:35:18 +02:00 |
|
DebaucheryLibrarian
|
501e764c21
|
Renamed chapters to clips. Fixed Vixen trailers.
|
2020-08-20 19:52:02 +02:00 |
|
DebaucheryLibrarian
|
2835c66694
|
Added chapters and shoot location. Added In The Crack.
|
2020-08-20 04:57:38 +02:00 |
|
DebaucheryLibrarian
|
fd4477bc50
|
Improved 'new' sorting.
|
2020-08-19 21:48:55 +02:00 |
|
DebaucheryLibrarian
|
e896d52968
|
Added separate task queue for video streams to prevent ffmpeg overstressing the CPU. Fixed entity parent in scene REST API.
|
2020-08-17 15:53:20 +02:00 |
|
DebaucheryLibrarian
|
b3435c97c3
|
Added footer and basic stats page.
|
2020-08-15 19:04:33 +02:00 |
|
DebaucheryLibrarian
|
d7974f057f
|
Fixed scene tile detail word wrap. Fixed Score posters.
|
2020-08-15 02:05:35 +02:00 |
|
DebaucheryLibrarian
|
50c5f921f5
|
Using new bulk insert utility for releases, media and actors.
|
2020-08-14 23:21:53 +02:00 |
|
DebaucheryLibrarian
|
e996a45bf5
|
Added new bulk upsert utility.
|
2020-08-14 23:05:25 +02:00 |
|
DebaucheryLibrarian
|
b3f784686f
|
Improved entity provision behavior.
|
2020-08-14 00:32:59 +02:00 |
|
DebaucheryLibrarian
|
77566eae0d
|
Fixed and documented entity configuration and query.
|
2020-08-13 23:59:54 +02:00 |
|
DebaucheryLibrarian
|
59e2124407
|
Removed type property from scenes API.
|
2020-08-13 16:10:58 +02:00 |
|
DebaucheryLibrarian
|
f8c9b69f4b
|
Allowing --actors-update to be used without --actors.
|
2020-08-12 21:04:38 +02:00 |
|
DebaucheryLibrarian
|
d14034d38b
|
Defauling --actors-update to 1900-01-01
|
2020-08-12 21:00:50 +02:00 |
|
DebaucheryLibrarian
|
7413d7db25
|
Improved and documented actor profile scraping.
|
2020-08-12 20:51:08 +02:00 |
|
DebaucheryLibrarian
|
5cabeed19d
|
Modularized release component between movie and scene. Added Kink Classics channel.
|
2020-08-12 03:30:20 +02:00 |
|
DebaucheryLibrarian
|
40aed1086f
|
Showing actors, tags and date on movie tiles.
|
2020-08-10 21:39:55 +02:00 |
|
DebaucheryLibrarian
|
a7d5bef93f
|
Filtering undefined scenes property from movies. Added movie page scraper to Elegant Angel.
|
2020-08-08 18:10:59 +02:00 |
|
DebaucheryLibrarian
|
b4f0501765
|
Scraping from Cherry Pimps when available. Showing cover in movie tile.
|
2020-08-02 03:44:14 +02:00 |
|
DebaucheryLibrarian
|
767437d9aa
|
Added movie tile. Fixed actor header. Larger breakpoint for nav menu.
|
2020-08-01 15:11:07 +02:00 |
|
DebaucheryLibrarian
|
6c5a62353c
|
Moved movies to separate table.
|
2020-07-25 03:44:19 +02:00 |
|
DebaucheryLibrarian
|
bfd54e94e7
|
Improved Team Skeet profile scraper.
|
2020-07-23 21:00:16 +02:00 |
|
DebaucheryLibrarian
|
747c2e1637
|
Checking nationality against alpha2 and alpha2. Improved Team Skeet profile scraper.
|
2020-07-23 04:39:12 +02:00 |
|
DebaucheryLibrarian
|
23e4f87af0
|
Added profile scraping and Hoby Buchanon to Team Skeet.
|
2020-07-23 04:29:46 +02:00 |
|
DebaucheryLibrarian
|
9ef5ea8fb6
|
Added the awkward pagination to PornCZ scraper.
|
2020-07-23 00:55:55 +02:00 |
|
DebaucheryLibrarian
|
46c6c4dd21
|
Added PornCZ.
|
2020-07-22 04:12:20 +02:00 |
|
DebaucheryLibrarian
|
9d89a38490
|
Added actor page scene thumbnails to Hitzefrei scraper.
|
2020-07-21 04:10:16 +02:00 |
|
DebaucheryLibrarian
|
d56da74168
|
Added Hitzefrei. Fixed date averaging.
|
2020-07-21 04:04:07 +02:00 |
|
DebaucheryLibrarian
|
dff4d15872
|
Updated profile scrapers to use base actor instead of actor name. Fixes for Reality Kings and Cherry Pimps scrapers.
|
2020-07-21 01:44:51 +02:00 |
|
DebaucheryLibrarian
|
939eba8e61
|
Changed qu's HTML element detection. Passing base actor instead of actorName to profile scrapers.
|
2020-07-21 01:16:26 +02:00 |
|
DebaucheryLibrarian
|
5291a87587
|
Added 'clear all' button to tag filter. Tag name never removes tag. Added actor scene scraping to LegalPorno.
|
2020-07-19 19:40:21 +02:00 |
|
DebaucheryLibrarian
|
689c701f34
|
Various tag photos.
|
2020-07-18 05:12:32 +02:00 |
|
DebaucheryLibrarian
|
a3d281192d
|
Reordered scraper arguments. Fixed Jules Jordan scraper for Amateur Allure.
|
2020-07-17 23:27:59 +02:00 |
|
DebaucheryLibrarian
|
f59e809713
|
Added experimental movie page scraping with Elegant Angel.
|
2020-07-17 04:33:05 +02:00 |
|
DebaucheryLibrarian
|
a88c2f0760
|
Added m3u8 stream support to media module. Added Elegant Angel. Added regex parameter to qu's number method. Various tags.
|
2020-07-17 03:39:13 +02:00 |
|
DebaucheryLibrarian
|
66d6322c1d
|
Updated GraphQL queries to Datetime. Updated template to latest guideline.
|
2020-07-16 15:55:03 +02:00 |
|
DebaucheryLibrarian
|
6adfded074
|
Refactored Mike Adriano scraper. Changed logo and favicon. Added style methods to qu.
|
2020-07-16 03:47:07 +02:00 |
|
DebaucheryLibrarian
|
5b886b3917
|
Improved actor extraction for fcuk scraper. Changed 'copyright' to 'credit'. Redused entity page favicon size.
|
2020-07-15 05:12:29 +02:00 |
|
DebaucheryLibrarian
|
c62df2228b
|
Added scraper for FCUK's coed sites.
|
2020-07-15 04:51:39 +02:00 |
|
DebaucheryLibrarian
|
17b3ba1272
|
Added partial 'fcuk' (Exploited College Girls) scraper. Added file parameter for actor names and scene URLs.
|
2020-07-15 03:24:47 +02:00 |
|
DebaucheryLibrarian
|
90fc7a0d9d
|
Fixed Kink profile scraper returning partial matches. Removed parent from BAM Visions and Vogov.
|
2020-07-14 21:21:27 +02:00 |
|
DebaucheryLibrarian
|
74b15aa8e9
|
Added 5K Porn and 5K Teens.
|
2020-07-14 04:36:14 +02:00 |
|
DebaucheryLibrarian
|
b7be97fcf9
|
Added Amateur Euro, For Bondage, Mamacitaz, TransBella and VIP Sex Vault. Refactored Kelly Madison scraper using qu, fixed trailers and improved reliability.
|
2020-07-14 03:46:31 +02:00 |
 ThePendulum
|
1eab3be7f6
|
Added Lets Doe It scraper. Added timestamp matching to qu's duration method.
|
2020-07-13 03:51:17 +02:00 |
|
ThePendulum
|
6fd2bc2687
|
Added Kink profile scraper. Fixed --force causing media collisions.
|
2020-07-13 00:12:01 +02:00 |
|
ThePendulum
|
a7707b7b28
|
Merged DDF Network with Porn World. Fixed and updated DDF/PW scraper.
|
2020-07-12 22:36:53 +02:00 |
|
ThePendulum
|
70c60e93ac
|
Scraping Perv City updates to network entity.
|
2020-07-12 05:25:27 +02:00 |
|
ThePendulum
|
9c8cfe3bdb
|
Re-wrote broken Perv City scraper, added profile scraping.
|
2020-07-12 05:10:23 +02:00 |
|
ThePendulum
|
e8c55512e2
|
Added image processing options to media module. Cropping Killergram avatars. Overwriting images when --force is used.
|
2020-07-10 03:42:08 +02:00 |
|
ThePendulum
|
4c551cc15f
|
Fixed pagination for Killergram, added pagination to actor profiles, added Killergram Platinum. Added experimental m3u8 stream support.
|
2020-07-10 02:01:23 +02:00 |
|
ThePendulum
|
a013d73400
|
Added Killergram.
|
2020-07-09 04:31:27 +02:00 |
|
ThePendulum
|
44a8ced30c
|
Separated actor expand buttons. Refactored Brazzers scraper. Fixed actor releases not included in shallow scrape. Added number query and data-src default to qu img. Updated README. Removed post-install migrate and seed.
|
2020-07-09 02:00:54 +02:00 |
|
ThePendulum
|
17d46e804e
|
Updated tag photos.
|
2020-07-08 04:58:12 +02:00 |
|
ThePendulum
|
9e5d3aa139
|
Added 'visible' property to entities. Added various Teen Core Club logos.
|
2020-07-08 02:53:46 +02:00 |
|
ThePendulum
|
0fd1edd8fd
|
Added Teen Core Club profile scraper. Added all TCC channels. Added various TCC logos.
|
2020-07-07 04:37:12 +02:00 |
|
ThePendulum
|
abe7de5701
|
Added scene scraping to Teen Core Club.
|
2020-07-06 04:13:48 +02:00 |
|
ThePendulum
|
f4ef2d4cc2
|
Auto-shrinking pagination. Various Teen Core Club curations.
|
2020-07-05 04:10:35 +02:00 |
|
ThePendulum
|
c47fae3a1b
|
Setting composed title as page title. Using Teen Core Club title if it isn't shoot ID.
|
2020-07-03 04:42:20 +02:00 |
|
ThePendulum
|
48a127409e
|
Added date precision. Added Teen Core Club update scraper.
|
2020-07-03 04:12:56 +02:00 |