Commit Graph

1160 Commits

Author SHA1 Message Date
DebaucheryLibrarian 01a8a24db6 Updated default request limit config. Added type expect to Kink images to fix broken photos due malformed content type header. 2024-10-24 03:18:27 +02:00
DebaucheryLibrarian 87adc0472e Removed stray console log from AnalVids scraper. 2024-10-24 02:03:53 +02:00
DebaucheryLibrarian 4f247d23c4 Updated unprint, integrated throttle settings. 2024-10-24 02:03:30 +02:00
DebaucheryLibrarian 8778ea1275 Removed old profile interpolation code. 2024-10-22 03:13:41 +02:00
DebaucheryLibrarian c307140db3 Updated actors common path. 2024-10-22 03:13:03 +02:00
DebaucheryLibrarian 783712ab2f Updated traxxx common path to cjs. 2024-10-22 02:56:56 +02:00
DebaucheryLibrarian eea8d6cc68 Renamed traxxx utils to common. Added natural lips column. 2024-10-22 02:51:00 +02:00
DebaucheryLibrarian a525d9b200 Changed sitename to availableOnSite in Gamma API call, added Evil Angel trans sites. Updated actor revisions migration. 2024-10-21 05:41:04 +02:00
DebaucheryLibrarian 5374d6fd39 Refactored AnalVids so studios are channels, excluded most channels from daily update. 2024-10-20 01:59:18 +02:00
DebaucheryLibrarian b8e9431225 Fixed Snow Valley breaking on Transex Japan if no album is found for scene. 2024-10-18 22:57:12 +02:00
DebaucheryLibrarian 5ed408226d Fixed eye color bruin mapping to bruin instead of brown. 2024-10-18 04:05:51 +02:00
DebaucheryLibrarian 1163b010fb Added actor page deep scrape for the few Sperm Mania scenes not on the homepage. 2024-10-17 23:50:55 +02:00
DebaucheryLibrarian 1950dd2e62 Added Snow Valley (Sperm Mania) scraper. 2024-10-16 02:39:11 +02:00
DebaucheryLibrarian d3f15a6a2b Tweaked Spizoo scraper for Goth Girlfriends. 2024-09-13 01:22:46 +02:00
DebaucheryLibrarian 7cb41c7c5d Added deciated ExploitedX scraper. 2024-09-08 05:41:05 +02:00
DebaucheryLibrarian a9a6e89d1f Further data fixes for ECG in ElevatedX scraper and seed file. 2024-09-08 03:26:16 +02:00
DebaucheryLibrarian 6e1c4a9de8 Added content version table. Marked ElevatedX scraper as deprecated, fixed ExploitedCollegeGirls queries. 2024-09-08 03:09:44 +02:00
DebaucheryLibrarian 51bd1bff14 Added Sex Like Real. Added separate missing date limit for upcoming updates. 2024-09-04 02:40:52 +02:00
DebaucheryLibrarian 8feeb0f858 Added studio info to manticore scenes. 2024-09-03 06:10:08 +02:00
DebaucheryLibrarian ac51382d8b Added upcoming to Porn World scraper. 2024-09-01 21:44:48 +02:00
DebaucheryLibrarian 668221dafd Added Porn World to replace DDF scraper. 2024-09-01 00:00:40 +02:00
DebaucheryLibrarian ccc6d1c10c Refactored Hookup Hotshot scraper. 2024-08-29 22:18:56 +02:00
DebaucheryLibrarian b1353f3bc3 Added movie and serie titles to manticore scenes. 2024-08-29 04:46:21 +02:00
DebaucheryLibrarian 22400ed954 Removed JJ and Whale Member fix tools. 2024-08-28 16:38:46 +02:00
DebaucheryLibrarian 6590e457b5 Added actor names to Jules Jordan title entry ID. 2024-08-27 02:43:46 +02:00
DebaucheryLibrarian 3aa542ab98 Added JJ fix tool (hopefully no longer needed, but just in case). 2024-08-27 02:27:47 +02:00
DebaucheryLibrarian 73676b8628 Appending date to Jules Jordan title-derived entry ID. 2024-08-27 02:16:25 +02:00
DebaucheryLibrarian 1a74bdb68a Fixed Jules Jordan poster returning page URL. 2024-08-25 21:39:05 +02:00
DebaucheryLibrarian e61411ca44 Added Angelo Godshack Original. 2024-08-22 03:07:38 +02:00
DebaucheryLibrarian 80e5d7828a Retired unused Bang Bros scraper (now part of Aylo). 2024-08-22 02:07:39 +02:00
DebaucheryLibrarian 893a3be393 Updated Gaywire configuration, moved from Bang Bros to Aylo. 2024-08-22 02:00:54 +02:00
DebaucheryLibrarian 8aeee8eea6 Added Cliff Media (Vanessa Cliff). 2024-08-21 01:03:53 +02:00
DebaucheryLibrarian d3a978c501 Using unprint as default, marked to-be-updated scrapers as deprecated. Merging movie tags and movie scene tags for manticore movies table. Removed poster set to null in deep merge; annotate if it has purpose. Refactored Brad Montana scraper. 2024-08-20 02:33:42 +02:00
DebaucheryLibrarian 596597e0e3 Added MissaX. 2024-08-17 02:33:59 +02:00
DebaucheryLibrarian bca677b0a8 Added virtual entity spawning for multi-page updates (i.e. Elegant Angel). Fixed ffmpeg error freezing process. Refactored Adult Empire/Elegant Angel scraper. 2024-08-16 23:26:52 +02:00
DebaucheryLibrarian 0516b0cee6 Fixed Amnesiac over-selecting actors. 2024-07-11 00:02:37 +02:00
DebaucheryLibrarian acd29a1451 Removed stray console log from Gamma. 2024-07-09 02:22:05 +02:00
DebaucheryLibrarian b8e7029cef Using base poster as fallback for deep poster in merge. Improved Naughty America scraper for live scenes. 2024-07-09 02:19:23 +02:00
DebaucheryLibrarian ad9113f624 Added Upclose to Gamma. 2024-07-09 01:44:17 +02:00
DebaucheryLibrarian 889a13f206 Fixed pagination in Amnesiac/Hentaied scraper. 2024-07-09 00:30:53 +02:00
DebaucheryLibrarian c62a529e76 Added Amnesiac (Hentaied) scraper. 2024-07-08 04:59:28 +02:00
DebaucheryLibrarian 1e03aa37b7 Expanded Naughty America scraper to support Tonight's Girlfriend (and possibly other native sites). 2024-07-08 01:58:11 +02:00
DebaucheryLibrarian 857771e5c6 Inheriting argv request timeout in unprint configuration. 2024-07-06 06:19:38 +02:00
DebaucheryLibrarian 56163f2b3d Refactored and fixed Naughty America scraper. 2024-07-06 06:08:35 +02:00
DebaucheryLibrarian 36a51f0491 Sharing title filter function between manticore update module and sync tool, fixing sync tool title filter word boundaries. 2024-07-05 02:55:02 +02:00
DebaucheryLibrarian f11a009395 Adapted Aylo scraper for Bang Bros. 2024-06-30 03:27:57 +02:00
DebaucheryLibrarian 405db5e002 Solidifed New Sensations entry ID. Updated Four Finger Club to Girl Girl XXX. 2024-06-13 02:16:03 +02:00
DebaucheryLibrarian 8c37071145 Expanded puppeteer options. Fixed Mike Adriano scraper. Fixed convert utility. 2024-06-12 03:21:45 +02:00
DebaucheryLibrarian a0ed434360 Added date range to flush commands. 2024-06-06 00:20:54 +02:00
DebaucheryLibrarian 894eaeb43f Added batch showcase in manticore scene update. 2024-06-05 23:04:07 +02:00
DebaucheryLibrarian 2a4b0e9636 Disable notifications if showcase flag is disabled. 2024-06-05 03:11:49 +02:00
DebaucheryLibrarian 644226531e Using URL or title slug for Whale Member entry IDs for backwards compatability. 2024-06-05 03:05:30 +02:00
DebaucheryLibrarian ab46e8558d Fixed Kink scraper. 2024-06-04 05:12:41 +02:00
DebaucheryLibrarian b6a402d964 Added grandparent network IDs to manticore scene database. 2024-06-04 03:49:35 +02:00
DebaucheryLibrarian 74fbe29db5 Added URL util to repo. 2024-06-04 03:34:09 +02:00
DebaucheryLibrarian c2afa571bf Fixed Whale Member (Porn Pros, Holed) scraper. 2024-06-04 03:30:26 +02:00
DebaucheryLibrarian 43752cef92 Storing serie IDs to manticore scenes table. 2024-06-02 00:28:42 +02:00
DebaucheryLibrarian 91bd0c42be Added showcase boolean to manticore scene CLI tool. 2024-05-31 04:36:47 +02:00
DebaucheryLibrarian 7db724eda4 Set minimum prefix length 3 on manticore actors table. 2024-05-30 23:54:49 +02:00
DebaucheryLibrarian f956f0e112 Converting expression before storing. Pre-fixed some Bang! channel names with 'Bang!'. 2024-05-29 23:57:38 +02:00
DebaucheryLibrarian 0f05abcd27 Implemented alert field AND/OR logic. 2024-05-20 06:29:44 +02:00
DebaucheryLibrarian 5ac64d410e Fixed alert stash deduper. 2024-05-04 05:18:00 +02:00
DebaucheryLibrarian 26f3bf8d6a Fixed title tag filtering in manticore scene sync. 2024-05-01 03:45:51 +02:00
DebaucheryLibrarian 6339a253c0 Syncing alert stash with manticore. 2024-04-29 03:53:17 +02:00
DebaucheryLibrarian db1b72f95f Fixed back-end alert verification. 2024-03-28 01:19:13 +01:00
DebaucheryLibrarian e019648a87 Syncing stash actions to manticore. 2024-03-27 02:39:16 +01:00
DebaucheryLibrarian efd5b959db Removed tag priority filter from manticore scene update query. 2024-03-25 21:51:52 +01:00
DebaucheryLibrarian 00f59b3743 Added movies to manticore migrations and update. 2024-03-25 02:08:54 +01:00
DebaucheryLibrarian f1f618d3a7 Added entity_ids column to manticore scenes table. 2024-03-24 22:16:58 +01:00
DebaucheryLibrarian 33311b4954 Changed weight to mass in manticore actors table to prevent score weight conflict. 2024-03-24 04:23:55 +01:00
DebaucheryLibrarian 05d78d948b Added showcase to manticore migration. Added Cheating Sis to Nubiles. 2024-03-17 03:57:55 +01:00
DebaucheryLibrarian 8749b464fd Added alias and privileges to metadata migration. 2024-03-15 01:24:02 +01:00
DebaucheryLibrarian f83ea2436d Added stashes to Manticore search update. 2024-03-15 00:57:28 +01:00
DebaucheryLibrarian fc0661804f Added filtered titles and secondary tags to manticore database. 2024-02-09 22:30:38 +01:00
DebaucheryLibrarian d9d585d51a Added Manticore migration and meta text field. 2024-01-25 01:58:55 +01:00
DebaucheryLibrarian 86ffcc3316 Updating Manticore scenes database on scene store. 2024-01-25 01:15:42 +01:00
DebaucheryLibrarian a6fb572a21 Added Freaky Fembots to Team Skeet. 2024-01-03 23:03:30 +01:00
DebaucheryLibrarian b872d7a0ec Moved maintenance page to public directory to be served by webserver. 2023-12-07 01:27:44 +01:00
DebaucheryLibrarian 2a3f21976a Added maintenance mode. 2023-12-06 01:51:34 +01:00
DebaucheryLibrarian a3c064be55 Added Inn of Sinn, added Lil Sis to Nubiles. 2023-12-06 00:15:55 +01:00
DebaucheryLibrarian 1e707ccefa Added database pool settings. 2023-12-01 02:19:53 +01:00
DebaucheryLibrarian 9ea317939b Fixed session reuse in Aylo scraper. 2023-12-01 02:09:24 +01:00
DebaucheryLibrarian 98bf7ea9dd Updated all dependencies. Updated MindGeek to Aylo. 2023-11-30 03:12:47 +01:00
DebaucheryLibrarian 0369446681 Added AND/OR toggle to alerts. 2023-11-24 02:10:03 +01:00
DebaucheryLibrarian 238dce78b5 Refactored alerts to use application code, added regex. Updated Jules Jordan for the Ass Factory relaunch. 2023-11-24 01:29:22 +01:00
DebaucheryLibrarian 1cf06a8b49 Fixed Vixen upcoming. 2023-11-09 01:10:05 +01:00
DebaucheryLibrarian edc724b475 Storing photo counts. 2023-11-07 04:46:45 +01:00
DebaucheryLibrarian eba96df631 Added The Flourish, adapted Arch Angel scraper. 2023-11-07 04:29:35 +01:00
DebaucheryLibrarian e20641e101 Fixed Teen Mega World scraper. 2023-11-07 03:06:39 +01:00
DebaucheryLibrarian eeb947d311 Catching media store fail unlink error to prevent batch failure. 2023-08-28 02:53:35 +02:00
DebaucheryLibrarian c94dcdd9e6 Updated Radical to support Top Web Models. 2023-08-16 06:31:49 +02:00
DebaucheryLibrarian b29a34c76a Updated AnalVids. 2023-08-16 03:08:47 +02:00
DebaucheryLibrarian 1ed47c3173 Updated Radical scraper. Added town property to location resolve tool. 2023-08-14 01:54:17 +02:00
DebaucheryLibrarian c860bfebc1 Separated error log. Added search/summary update tool. 2023-08-13 21:57:32 +02:00
DebaucheryLibrarian 02850eb6e3 Updated Team Skeet and MYLF. 2023-08-11 03:56:08 +02:00
DebaucheryLibrarian 2df20aea38 Moved Aziani to Gamma. 2023-08-05 00:09:13 +02:00
DebaucheryLibrarian 5f26f8de27 Excluding studios from entity aggregration. Added profile scraping to Teste de Fudelidade. 2023-08-04 22:30:18 +02:00
DebaucheryLibrarian 328550b9a3 Added Teste de Fudelidade. 2023-08-04 22:02:28 +02:00
DebaucheryLibrarian 54dbea659a Added missing image fallbacks to legacy Aziani scraper. 2023-08-04 21:43:57 +02:00
DebaucheryLibrarian 4a10887e48 Fixed Aziani breaking on missing source. 2023-08-04 00:12:24 +02:00
DebaucheryLibrarian abbfedf3f7 Added trailer support to legacy Aziani scraper. 2023-08-03 23:35:10 +02:00
DebaucheryLibrarian b287f5c2db Fixed photo query in Aziana scraper. 2023-08-03 23:24:23 +02:00
DebaucheryLibrarian 5f2c9eb5df Fixed place cache check. 2023-08-03 00:31:07 +02:00
DebaucheryLibrarian c5d81e94e5 Updated OSM API path, added redis caching. 2023-08-02 23:12:41 +02:00
DebaucheryLibrarian e9a1df9123 Improved Model Media scene code matching. 2023-08-02 16:38:50 +02:00
DebaucheryLibrarian c064efc812 Fixed title curation disparity Tokyo Hot. 2023-08-02 02:22:26 +02:00
DebaucheryLibrarian 8c1f1b69ff Splitting Han titles and actors in Model Media scraper. 2023-08-02 02:14:41 +02:00
DebaucheryLibrarian ae64c5225f Added conditions to Tokyo Hot scraper to prevent total failure. 2023-07-31 23:41:32 +02:00
DebaucheryLibrarian ab5b165c68 Preserving Jules Jordan base photos in deep scrape. 2023-07-29 23:59:17 +02:00
DebaucheryLibrarian 40276a11f9 Fixed Tokyo Hot deep scrape failing on missing trailer. 2023-07-25 20:45:46 +02:00
DebaucheryLibrarian b7a31b7933 Added showcase flag to batch table. 2023-07-25 03:22:24 +02:00
DebaucheryLibrarian 693983dc29 Added screen caps separate from photos. Added Tokyo Hot. Added hair type, shoe size and blood type actor fields. 2023-07-25 03:03:41 +02:00
DebaucheryLibrarian 9f727a0fa0 Added analytics configuration. 2023-07-24 00:59:47 +02:00
DebaucheryLibrarian 997914ec27 Improved Hush T1 profile scraper. 2023-07-23 01:05:25 +02:00
DebaucheryLibrarian ca695db3ba Storing actor socials, improved Hush profile scraper. 2023-07-23 01:02:18 +02:00
DebaucheryLibrarian 80750b44dc Added Milfy to profile list, fixed Vixen not returning gracefully when profile is not found. 2023-07-22 00:49:56 +02:00
DebaucheryLibrarian 25f3dcf9a5 Fixed avatar data type in Vixen scraper. 2023-07-22 00:01:12 +02:00
DebaucheryLibrarian 0b101dde3c Updated Vixen model scraper. 2023-07-21 23:55:30 +02:00
DebaucheryLibrarian 86e4fb7603 Fixed Team Skeet profiles. 2023-07-21 21:58:50 +02:00
DebaucheryLibrarian dab38c8013 Added grey hair color, removed console log. 2023-07-21 01:07:06 +02:00
DebaucheryLibrarian c29ecac41c Fixed summary view refresh. 2023-07-17 02:56:37 +02:00
DebaucheryLibrarian 2b3b2d7fd2 Using summaries table for improved performance. 2023-07-17 01:59:26 +02:00
DebaucheryLibrarian 77727dff77 Added MariskaX. 2023-07-09 21:39:40 +02:00
DebaucheryLibrarian f009c90e5d Updated Blowpass seed entries. 2023-07-09 05:23:17 +02:00
DebaucheryLibrarian 1cba51fbfd Moved Blowpass to Gamma API. 2023-07-09 05:08:35 +02:00
DebaucheryLibrarian 88a56794aa Separated Filthy Kings into its channels, upgraded Gamma scraper to accomodate. 2023-07-09 04:35:30 +02:00
DebaucheryLibrarian 6f4608ba23 Using better video API for Vixen deep scrape. 2023-07-07 02:20:07 +02:00
DebaucheryLibrarian 83e22813f3 Using more aggressive optional chaining in Vixen scraper to prevent errors. 2023-07-07 00:23:02 +02:00
DebaucheryLibrarian f8e7ace89f Removed superfluous console logs. 2023-07-06 05:40:23 +02:00
DebaucheryLibrarian 8bb46c5a6d Moved missing slug return in Vixen scraper. 2023-07-06 05:30:51 +02:00
DebaucheryLibrarian 51e04e7331 Updated Jules Jordan profile scraper. 2023-07-06 05:09:05 +02:00
DebaucheryLibrarian 18744372b3 Updated Vixen scraper with more informative API query. 2023-07-06 04:24:47 +02:00
DebaucheryLibrarian f6c1910be3 Added media attempt configuration, default from 3 to 2, 1 for JJ scraper. 2023-07-06 00:30:04 +02:00
DebaucheryLibrarian 0905847ffa Updated Jules Jordan scraper. 2023-07-06 00:14:38 +02:00
DebaucheryLibrarian 916deff487 Fixed Arch Angel placeholder thumbnail. 2023-07-03 00:50:47 +02:00
DebaucheryLibrarian 13d02a44e5 Fixed failed hash duplicate source breaking media association. 2023-07-02 23:59:49 +02:00
DebaucheryLibrarian 61c84e18e4 Added separate force media argument. 2023-07-02 21:06:38 +02:00
DebaucheryLibrarian 4a3674feac Added dedicated Arch Angel scraper. 2023-07-02 05:07:38 +02:00
DebaucheryLibrarian a339c096ef Fixed Kink trailer query. 2023-07-02 01:04:39 +02:00
DebaucheryLibrarian a8fa1f36f8 Added Van Styles to Jules Jordan tag directors. 2023-07-01 22:45:28 +02:00
DebaucheryLibrarian a2331bc913 Added prefer option for entity resolution. Merged migrations. 2023-07-01 22:24:21 +02:00
DebaucheryLibrarian aa9e3b3d1f Deriving Jules Jordan director from tags. 2023-07-01 21:53:01 +02:00
DebaucheryLibrarian 205102ff90 Added Meiden van Holland and Vurig Vlaanderen. 2023-07-01 21:46:44 +02:00
DebaucheryLibrarian 25a90dd52c Moved Dogfart to DFXtra. 2023-06-22 01:31:36 +02:00
DebaucheryLibrarian 18f75595da Added GraphiQL disable. 2023-06-19 03:28:55 +02:00
DebaucheryLibrarian 1766556c49 Added query timeout setting. 2023-06-19 01:45:45 +02:00
DebaucheryLibrarian dbaddfb291 Merged database migrations. 2023-06-19 00:39:00 +02:00
DebaucheryLibrarian 87a29baf8b Added stream ignore option. 2023-06-18 02:12:13 +02:00
DebaucheryLibrarian 7723b2b698 Only curating release ID when present. 2023-06-16 02:29:01 +02:00
DebaucheryLibrarian 128f9950ec Prefer HTML over data titles for capitalization in Bang scraper. 2023-06-15 19:53:42 +02:00