Commit Graph

738 Commits

Author SHA1 Message Date
DebaucheryLibrarian 01a8a24db6 Updated default request limit config. Added type expect to Kink images to fix broken photos due malformed content type header. 2024-10-24 03:18:27 +02:00
DebaucheryLibrarian 87adc0472e Removed stray console log from AnalVids scraper. 2024-10-24 02:03:53 +02:00
DebaucheryLibrarian 4f247d23c4 Updated unprint, integrated throttle settings. 2024-10-24 02:03:30 +02:00
DebaucheryLibrarian a525d9b200 Changed sitename to availableOnSite in Gamma API call, added Evil Angel trans sites. Updated actor revisions migration. 2024-10-21 05:41:04 +02:00
DebaucheryLibrarian 5374d6fd39 Refactored AnalVids so studios are channels, excluded most channels from daily update. 2024-10-20 01:59:18 +02:00
DebaucheryLibrarian b8e9431225 Fixed Snow Valley breaking on Transex Japan if no album is found for scene. 2024-10-18 22:57:12 +02:00
DebaucheryLibrarian 1163b010fb Added actor page deep scrape for the few Sperm Mania scenes not on the homepage. 2024-10-17 23:50:55 +02:00
DebaucheryLibrarian 1950dd2e62 Added Snow Valley (Sperm Mania) scraper. 2024-10-16 02:39:11 +02:00
DebaucheryLibrarian d3f15a6a2b Tweaked Spizoo scraper for Goth Girlfriends. 2024-09-13 01:22:46 +02:00
DebaucheryLibrarian 7cb41c7c5d Added deciated ExploitedX scraper. 2024-09-08 05:41:05 +02:00
DebaucheryLibrarian a9a6e89d1f Further data fixes for ECG in ElevatedX scraper and seed file. 2024-09-08 03:26:16 +02:00
DebaucheryLibrarian 6e1c4a9de8 Added content version table. Marked ElevatedX scraper as deprecated, fixed ExploitedCollegeGirls queries. 2024-09-08 03:09:44 +02:00
DebaucheryLibrarian 51bd1bff14 Added Sex Like Real. Added separate missing date limit for upcoming updates. 2024-09-04 02:40:52 +02:00
DebaucheryLibrarian ac51382d8b Added upcoming to Porn World scraper. 2024-09-01 21:44:48 +02:00
DebaucheryLibrarian 668221dafd Added Porn World to replace DDF scraper. 2024-09-01 00:00:40 +02:00
DebaucheryLibrarian ccc6d1c10c Refactored Hookup Hotshot scraper. 2024-08-29 22:18:56 +02:00
DebaucheryLibrarian 6590e457b5 Added actor names to Jules Jordan title entry ID. 2024-08-27 02:43:46 +02:00
DebaucheryLibrarian 73676b8628 Appending date to Jules Jordan title-derived entry ID. 2024-08-27 02:16:25 +02:00
DebaucheryLibrarian 1a74bdb68a Fixed Jules Jordan poster returning page URL. 2024-08-25 21:39:05 +02:00
DebaucheryLibrarian e61411ca44 Added Angelo Godshack Original. 2024-08-22 03:07:38 +02:00
DebaucheryLibrarian 80e5d7828a Retired unused Bang Bros scraper (now part of Aylo). 2024-08-22 02:07:39 +02:00
DebaucheryLibrarian 893a3be393 Updated Gaywire configuration, moved from Bang Bros to Aylo. 2024-08-22 02:00:54 +02:00
DebaucheryLibrarian 8aeee8eea6 Added Cliff Media (Vanessa Cliff). 2024-08-21 01:03:53 +02:00
DebaucheryLibrarian d3a978c501 Using unprint as default, marked to-be-updated scrapers as deprecated. Merging movie tags and movie scene tags for manticore movies table. Removed poster set to null in deep merge; annotate if it has purpose. Refactored Brad Montana scraper. 2024-08-20 02:33:42 +02:00
DebaucheryLibrarian 596597e0e3 Added MissaX. 2024-08-17 02:33:59 +02:00
DebaucheryLibrarian bca677b0a8 Added virtual entity spawning for multi-page updates (i.e. Elegant Angel). Fixed ffmpeg error freezing process. Refactored Adult Empire/Elegant Angel scraper. 2024-08-16 23:26:52 +02:00
DebaucheryLibrarian 0516b0cee6 Fixed Amnesiac over-selecting actors. 2024-07-11 00:02:37 +02:00
DebaucheryLibrarian acd29a1451 Removed stray console log from Gamma. 2024-07-09 02:22:05 +02:00
DebaucheryLibrarian b8e7029cef Using base poster as fallback for deep poster in merge. Improved Naughty America scraper for live scenes. 2024-07-09 02:19:23 +02:00
DebaucheryLibrarian ad9113f624 Added Upclose to Gamma. 2024-07-09 01:44:17 +02:00
DebaucheryLibrarian 889a13f206 Fixed pagination in Amnesiac/Hentaied scraper. 2024-07-09 00:30:53 +02:00
DebaucheryLibrarian c62a529e76 Added Amnesiac (Hentaied) scraper. 2024-07-08 04:59:28 +02:00
DebaucheryLibrarian 1e03aa37b7 Expanded Naughty America scraper to support Tonight's Girlfriend (and possibly other native sites). 2024-07-08 01:58:11 +02:00
DebaucheryLibrarian 56163f2b3d Refactored and fixed Naughty America scraper. 2024-07-06 06:08:35 +02:00
DebaucheryLibrarian f11a009395 Adapted Aylo scraper for Bang Bros. 2024-06-30 03:27:57 +02:00
DebaucheryLibrarian 405db5e002 Solidifed New Sensations entry ID. Updated Four Finger Club to Girl Girl XXX. 2024-06-13 02:16:03 +02:00
DebaucheryLibrarian 8c37071145 Expanded puppeteer options. Fixed Mike Adriano scraper. Fixed convert utility. 2024-06-12 03:21:45 +02:00
DebaucheryLibrarian 644226531e Using URL or title slug for Whale Member entry IDs for backwards compatability. 2024-06-05 03:05:30 +02:00
DebaucheryLibrarian ab46e8558d Fixed Kink scraper. 2024-06-04 05:12:41 +02:00
DebaucheryLibrarian c2afa571bf Fixed Whale Member (Porn Pros, Holed) scraper. 2024-06-04 03:30:26 +02:00
DebaucheryLibrarian 8749b464fd Added alias and privileges to metadata migration. 2024-03-15 01:24:02 +01:00
DebaucheryLibrarian f83ea2436d Added stashes to Manticore search update. 2024-03-15 00:57:28 +01:00
DebaucheryLibrarian a3c064be55 Added Inn of Sinn, added Lil Sis to Nubiles. 2023-12-06 00:15:55 +01:00
DebaucheryLibrarian 9ea317939b Fixed session reuse in Aylo scraper. 2023-12-01 02:09:24 +01:00
DebaucheryLibrarian 98bf7ea9dd Updated all dependencies. Updated MindGeek to Aylo. 2023-11-30 03:12:47 +01:00
DebaucheryLibrarian 238dce78b5 Refactored alerts to use application code, added regex. Updated Jules Jordan for the Ass Factory relaunch. 2023-11-24 01:29:22 +01:00
DebaucheryLibrarian 1cf06a8b49 Fixed Vixen upcoming. 2023-11-09 01:10:05 +01:00
DebaucheryLibrarian eba96df631 Added The Flourish, adapted Arch Angel scraper. 2023-11-07 04:29:35 +01:00
DebaucheryLibrarian e20641e101 Fixed Teen Mega World scraper. 2023-11-07 03:06:39 +01:00
DebaucheryLibrarian eeb947d311 Catching media store fail unlink error to prevent batch failure. 2023-08-28 02:53:35 +02:00
DebaucheryLibrarian c94dcdd9e6 Updated Radical to support Top Web Models. 2023-08-16 06:31:49 +02:00
DebaucheryLibrarian b29a34c76a Updated AnalVids. 2023-08-16 03:08:47 +02:00
DebaucheryLibrarian 1ed47c3173 Updated Radical scraper. Added town property to location resolve tool. 2023-08-14 01:54:17 +02:00
DebaucheryLibrarian c860bfebc1 Separated error log. Added search/summary update tool. 2023-08-13 21:57:32 +02:00
DebaucheryLibrarian 02850eb6e3 Updated Team Skeet and MYLF. 2023-08-11 03:56:08 +02:00
DebaucheryLibrarian 2df20aea38 Moved Aziani to Gamma. 2023-08-05 00:09:13 +02:00
DebaucheryLibrarian 5f26f8de27 Excluding studios from entity aggregration. Added profile scraping to Teste de Fudelidade. 2023-08-04 22:30:18 +02:00
DebaucheryLibrarian 328550b9a3 Added Teste de Fudelidade. 2023-08-04 22:02:28 +02:00
DebaucheryLibrarian 54dbea659a Added missing image fallbacks to legacy Aziani scraper. 2023-08-04 21:43:57 +02:00
DebaucheryLibrarian 4a10887e48 Fixed Aziani breaking on missing source. 2023-08-04 00:12:24 +02:00
DebaucheryLibrarian abbfedf3f7 Added trailer support to legacy Aziani scraper. 2023-08-03 23:35:10 +02:00
DebaucheryLibrarian b287f5c2db Fixed photo query in Aziana scraper. 2023-08-03 23:24:23 +02:00
DebaucheryLibrarian c5d81e94e5 Updated OSM API path, added redis caching. 2023-08-02 23:12:41 +02:00
DebaucheryLibrarian e9a1df9123 Improved Model Media scene code matching. 2023-08-02 16:38:50 +02:00
DebaucheryLibrarian c064efc812 Fixed title curation disparity Tokyo Hot. 2023-08-02 02:22:26 +02:00
DebaucheryLibrarian 8c1f1b69ff Splitting Han titles and actors in Model Media scraper. 2023-08-02 02:14:41 +02:00
DebaucheryLibrarian ae64c5225f Added conditions to Tokyo Hot scraper to prevent total failure. 2023-07-31 23:41:32 +02:00
DebaucheryLibrarian ab5b165c68 Preserving Jules Jordan base photos in deep scrape. 2023-07-29 23:59:17 +02:00
DebaucheryLibrarian 40276a11f9 Fixed Tokyo Hot deep scrape failing on missing trailer. 2023-07-25 20:45:46 +02:00
DebaucheryLibrarian 693983dc29 Added screen caps separate from photos. Added Tokyo Hot. Added hair type, shoe size and blood type actor fields. 2023-07-25 03:03:41 +02:00
DebaucheryLibrarian 997914ec27 Improved Hush T1 profile scraper. 2023-07-23 01:05:25 +02:00
DebaucheryLibrarian ca695db3ba Storing actor socials, improved Hush profile scraper. 2023-07-23 01:02:18 +02:00
DebaucheryLibrarian 80750b44dc Added Milfy to profile list, fixed Vixen not returning gracefully when profile is not found. 2023-07-22 00:49:56 +02:00
DebaucheryLibrarian 25f3dcf9a5 Fixed avatar data type in Vixen scraper. 2023-07-22 00:01:12 +02:00
DebaucheryLibrarian 0b101dde3c Updated Vixen model scraper. 2023-07-21 23:55:30 +02:00
DebaucheryLibrarian 86e4fb7603 Fixed Team Skeet profiles. 2023-07-21 21:58:50 +02:00
DebaucheryLibrarian 77727dff77 Added MariskaX. 2023-07-09 21:39:40 +02:00
DebaucheryLibrarian 1cba51fbfd Moved Blowpass to Gamma API. 2023-07-09 05:08:35 +02:00
DebaucheryLibrarian 88a56794aa Separated Filthy Kings into its channels, upgraded Gamma scraper to accomodate. 2023-07-09 04:35:30 +02:00
DebaucheryLibrarian 6f4608ba23 Using better video API for Vixen deep scrape. 2023-07-07 02:20:07 +02:00
DebaucheryLibrarian 83e22813f3 Using more aggressive optional chaining in Vixen scraper to prevent errors. 2023-07-07 00:23:02 +02:00
DebaucheryLibrarian f8e7ace89f Removed superfluous console logs. 2023-07-06 05:40:23 +02:00
DebaucheryLibrarian 8bb46c5a6d Moved missing slug return in Vixen scraper. 2023-07-06 05:30:51 +02:00
DebaucheryLibrarian 51e04e7331 Updated Jules Jordan profile scraper. 2023-07-06 05:09:05 +02:00
DebaucheryLibrarian 18744372b3 Updated Vixen scraper with more informative API query. 2023-07-06 04:24:47 +02:00
DebaucheryLibrarian f6c1910be3 Added media attempt configuration, default from 3 to 2, 1 for JJ scraper. 2023-07-06 00:30:04 +02:00
DebaucheryLibrarian 0905847ffa Updated Jules Jordan scraper. 2023-07-06 00:14:38 +02:00
DebaucheryLibrarian 916deff487 Fixed Arch Angel placeholder thumbnail. 2023-07-03 00:50:47 +02:00
DebaucheryLibrarian 13d02a44e5 Fixed failed hash duplicate source breaking media association. 2023-07-02 23:59:49 +02:00
DebaucheryLibrarian 61c84e18e4 Added separate force media argument. 2023-07-02 21:06:38 +02:00
DebaucheryLibrarian 4a3674feac Added dedicated Arch Angel scraper. 2023-07-02 05:07:38 +02:00
DebaucheryLibrarian a339c096ef Fixed Kink trailer query. 2023-07-02 01:04:39 +02:00
DebaucheryLibrarian a8fa1f36f8 Added Van Styles to Jules Jordan tag directors. 2023-07-01 22:45:28 +02:00
DebaucheryLibrarian aa9e3b3d1f Deriving Jules Jordan director from tags. 2023-07-01 21:53:01 +02:00
DebaucheryLibrarian 205102ff90 Added Meiden van Holland and Vurig Vlaanderen. 2023-07-01 21:46:44 +02:00
DebaucheryLibrarian 25a90dd52c Moved Dogfart to DFXtra. 2023-06-22 01:31:36 +02:00
DebaucheryLibrarian 7723b2b698 Only curating release ID when present. 2023-06-16 02:29:01 +02:00
DebaucheryLibrarian 128f9950ec Prefer HTML over data titles for capitalization in Bang scraper. 2023-06-15 19:53:42 +02:00
DebaucheryLibrarian bae51dd59c Fixed poster query for old New Sensations scenes. 2023-06-10 00:46:38 +02:00
DebaucheryLibrarian c4e4f649f5 Fixed New Sensations classic scraper breaking on missing actors. 2023-06-09 00:33:40 +02:00