Commit Graph

1140 Commits

Author SHA1 Message Date
DebaucheryLibrarian 23f76fd1be Added sparse date mode. Fixed profile fetch error catching. Updated Kelly Madison scraper, using site IDs and fixed profile scraper. 2024-12-30 01:57:26 +01:00
DebaucheryLibrarian 0e69898c32 Prioritizing known video qualities as fallbacks, fixed Gamma quality format. 2024-12-28 17:50:28 +01:00
DebaucheryLibrarian a12b88d6cf Passing limit arguments to unprint as defaults (will not override hostname limits). 2024-11-24 06:48:51 +01:00
DebaucheryLibrarian fbfd52e831 Refactored Aziani scraper. Improved actor profile update logic. 2024-11-24 06:10:21 +01:00
DebaucheryLibrarian 639ad6c79e Fixed Bang Bros URL path. 2024-11-19 04:46:43 +01:00
DebaucheryLibrarian 844c1d87a6 Fixed Aylo scraper using spartan ID in URLs; should only be used for unique identifier. 2024-11-19 04:05:17 +01:00
DebaucheryLibrarian 0cf43f6eab Upgraded Spizoo scraper to unprint, added to default proxy list. 2024-11-19 01:35:28 +01:00
DebaucheryLibrarian e7c9b78827 Fixed qu methods used with unprint in PornDoe scraper. 2024-11-19 00:09:02 +01:00
DebaucheryLibrarian b679ae95f2 Moved LetsDoeIt to Aylo, updated PornDoe scraper. 2024-11-18 23:58:55 +01:00
DebaucheryLibrarian b7535a3151 Fixed Team Skeet API URL, added Brat Tamer. 2024-11-07 21:02:20 +01:00
DebaucheryLibrarian 15896d4c5b Added dupe index to manticore movies table. 2024-11-05 04:07:09 +01:00
DebaucheryLibrarian c5545aae11 Added dupe index to manticore scenes and movies tables. 2024-11-05 04:00:25 +01:00
DebaucheryLibrarian a487f21059 Improved socials table. 2024-11-04 02:37:45 +01:00
DebaucheryLibrarian 90027d12fb Fixed Adult Empire/Elegant Angel age verification. 2024-11-03 02:52:30 +01:00
DebaucheryLibrarian 9eca44795f Added PornBox scraper for AnalVids. 2024-11-03 01:52:49 +01:00
DebaucheryLibrarian 341c6aed1e Added referer to AnalVids requests. 2024-11-01 00:38:49 +01:00
DebaucheryLibrarian 96a075cb2d Added Dogfart to actor scraper list. 2024-10-31 05:59:33 +01:00
DebaucheryLibrarian 0fe6a1119a Accomodating unprint proxy options. 2024-10-31 05:47:54 +01:00
DebaucheryLibrarian 928650b602 Using options instead of config dependency for common location resolver. 2024-10-31 03:19:18 +01:00
DebaucheryLibrarian 1aa876acd9 Using common for place resolve. 2024-10-31 03:01:13 +01:00
DebaucheryLibrarian df820e6e71 Fixed new profiles not being assigned avatars appropriately. 2024-10-30 00:42:27 +01:00
DebaucheryLibrarian ea02ec3943 Separated media request limits. 2024-10-29 22:42:30 +01:00
DebaucheryLibrarian d80ec2e6a6 Fixed actor ID property for newly created profiles, should fix actor association failing. 2024-10-27 17:12:21 +01:00
DebaucheryLibrarian edf1b64624 Added more detailed total runtime. 2024-10-26 22:24:54 +02:00
DebaucheryLibrarian 2df3213936 Added error stack to actor association fail. 2024-10-26 22:13:44 +02:00
DebaucheryLibrarian b5b09a7dce Added total run time indicator. 2024-10-26 02:12:46 +02:00
DebaucheryLibrarian 29ab61e713 Removed stray console logs. 2024-10-26 01:12:38 +02:00
DebaucheryLibrarian e24012f446 Storing avatars in actors avatars table to allow multiple (historical) photos per profile. 2024-10-26 01:04:28 +02:00
DebaucheryLibrarian d7ff6cee08 Fixed Radical module, actively retrieving endpoint. 2024-10-25 01:39:58 +02:00
DebaucheryLibrarian 81d2217fdc Passing refresh view parameter into profile interpolator. Updated Got Filled and Inserted API keys. 2024-10-25 00:56:35 +02:00
DebaucheryLibrarian 01a8a24db6 Updated default request limit config. Added type expect to Kink images to fix broken photos due malformed content type header. 2024-10-24 03:18:27 +02:00
DebaucheryLibrarian 87adc0472e Removed stray console log from AnalVids scraper. 2024-10-24 02:03:53 +02:00
DebaucheryLibrarian 4f247d23c4 Updated unprint, integrated throttle settings. 2024-10-24 02:03:30 +02:00
DebaucheryLibrarian 8778ea1275 Removed old profile interpolation code. 2024-10-22 03:13:41 +02:00
DebaucheryLibrarian c307140db3 Updated actors common path. 2024-10-22 03:13:03 +02:00
DebaucheryLibrarian 783712ab2f Updated traxxx common path to cjs. 2024-10-22 02:56:56 +02:00
DebaucheryLibrarian eea8d6cc68 Renamed traxxx utils to common. Added natural lips column. 2024-10-22 02:51:00 +02:00
DebaucheryLibrarian a525d9b200 Changed sitename to availableOnSite in Gamma API call, added Evil Angel trans sites. Updated actor revisions migration. 2024-10-21 05:41:04 +02:00
DebaucheryLibrarian 5374d6fd39 Refactored AnalVids so studios are channels, excluded most channels from daily update. 2024-10-20 01:59:18 +02:00
DebaucheryLibrarian b8e9431225 Fixed Snow Valley breaking on Transex Japan if no album is found for scene. 2024-10-18 22:57:12 +02:00
DebaucheryLibrarian 5ed408226d Fixed eye color bruin mapping to bruin instead of brown. 2024-10-18 04:05:51 +02:00
DebaucheryLibrarian 1163b010fb Added actor page deep scrape for the few Sperm Mania scenes not on the homepage. 2024-10-17 23:50:55 +02:00
DebaucheryLibrarian 1950dd2e62 Added Snow Valley (Sperm Mania) scraper. 2024-10-16 02:39:11 +02:00
DebaucheryLibrarian d3f15a6a2b Tweaked Spizoo scraper for Goth Girlfriends. 2024-09-13 01:22:46 +02:00
DebaucheryLibrarian 7cb41c7c5d Added deciated ExploitedX scraper. 2024-09-08 05:41:05 +02:00
DebaucheryLibrarian a9a6e89d1f Further data fixes for ECG in ElevatedX scraper and seed file. 2024-09-08 03:26:16 +02:00
DebaucheryLibrarian 6e1c4a9de8 Added content version table. Marked ElevatedX scraper as deprecated, fixed ExploitedCollegeGirls queries. 2024-09-08 03:09:44 +02:00
DebaucheryLibrarian 51bd1bff14 Added Sex Like Real. Added separate missing date limit for upcoming updates. 2024-09-04 02:40:52 +02:00
DebaucheryLibrarian 8feeb0f858 Added studio info to manticore scenes. 2024-09-03 06:10:08 +02:00
DebaucheryLibrarian ac51382d8b Added upcoming to Porn World scraper. 2024-09-01 21:44:48 +02:00
DebaucheryLibrarian 668221dafd Added Porn World to replace DDF scraper. 2024-09-01 00:00:40 +02:00
DebaucheryLibrarian ccc6d1c10c Refactored Hookup Hotshot scraper. 2024-08-29 22:18:56 +02:00
DebaucheryLibrarian b1353f3bc3 Added movie and serie titles to manticore scenes. 2024-08-29 04:46:21 +02:00
DebaucheryLibrarian 22400ed954 Removed JJ and Whale Member fix tools. 2024-08-28 16:38:46 +02:00
DebaucheryLibrarian 6590e457b5 Added actor names to Jules Jordan title entry ID. 2024-08-27 02:43:46 +02:00
DebaucheryLibrarian 3aa542ab98 Added JJ fix tool (hopefully no longer needed, but just in case). 2024-08-27 02:27:47 +02:00
DebaucheryLibrarian 73676b8628 Appending date to Jules Jordan title-derived entry ID. 2024-08-27 02:16:25 +02:00
DebaucheryLibrarian 1a74bdb68a Fixed Jules Jordan poster returning page URL. 2024-08-25 21:39:05 +02:00
DebaucheryLibrarian e61411ca44 Added Angelo Godshack Original. 2024-08-22 03:07:38 +02:00
DebaucheryLibrarian 80e5d7828a Retired unused Bang Bros scraper (now part of Aylo). 2024-08-22 02:07:39 +02:00
DebaucheryLibrarian 893a3be393 Updated Gaywire configuration, moved from Bang Bros to Aylo. 2024-08-22 02:00:54 +02:00
DebaucheryLibrarian 8aeee8eea6 Added Cliff Media (Vanessa Cliff). 2024-08-21 01:03:53 +02:00
DebaucheryLibrarian d3a978c501 Using unprint as default, marked to-be-updated scrapers as deprecated. Merging movie tags and movie scene tags for manticore movies table. Removed poster set to null in deep merge; annotate if it has purpose. Refactored Brad Montana scraper. 2024-08-20 02:33:42 +02:00
DebaucheryLibrarian 596597e0e3 Added MissaX. 2024-08-17 02:33:59 +02:00
DebaucheryLibrarian bca677b0a8 Added virtual entity spawning for multi-page updates (i.e. Elegant Angel). Fixed ffmpeg error freezing process. Refactored Adult Empire/Elegant Angel scraper. 2024-08-16 23:26:52 +02:00
DebaucheryLibrarian 0516b0cee6 Fixed Amnesiac over-selecting actors. 2024-07-11 00:02:37 +02:00
DebaucheryLibrarian acd29a1451 Removed stray console log from Gamma. 2024-07-09 02:22:05 +02:00
DebaucheryLibrarian b8e7029cef Using base poster as fallback for deep poster in merge. Improved Naughty America scraper for live scenes. 2024-07-09 02:19:23 +02:00
DebaucheryLibrarian ad9113f624 Added Upclose to Gamma. 2024-07-09 01:44:17 +02:00
DebaucheryLibrarian 889a13f206 Fixed pagination in Amnesiac/Hentaied scraper. 2024-07-09 00:30:53 +02:00
DebaucheryLibrarian c62a529e76 Added Amnesiac (Hentaied) scraper. 2024-07-08 04:59:28 +02:00
DebaucheryLibrarian 1e03aa37b7 Expanded Naughty America scraper to support Tonight's Girlfriend (and possibly other native sites). 2024-07-08 01:58:11 +02:00
DebaucheryLibrarian 857771e5c6 Inheriting argv request timeout in unprint configuration. 2024-07-06 06:19:38 +02:00
DebaucheryLibrarian 56163f2b3d Refactored and fixed Naughty America scraper. 2024-07-06 06:08:35 +02:00
DebaucheryLibrarian 36a51f0491 Sharing title filter function between manticore update module and sync tool, fixing sync tool title filter word boundaries. 2024-07-05 02:55:02 +02:00
DebaucheryLibrarian f11a009395 Adapted Aylo scraper for Bang Bros. 2024-06-30 03:27:57 +02:00
DebaucheryLibrarian 405db5e002 Solidifed New Sensations entry ID. Updated Four Finger Club to Girl Girl XXX. 2024-06-13 02:16:03 +02:00
DebaucheryLibrarian 8c37071145 Expanded puppeteer options. Fixed Mike Adriano scraper. Fixed convert utility. 2024-06-12 03:21:45 +02:00
DebaucheryLibrarian a0ed434360 Added date range to flush commands. 2024-06-06 00:20:54 +02:00
DebaucheryLibrarian 894eaeb43f Added batch showcase in manticore scene update. 2024-06-05 23:04:07 +02:00
DebaucheryLibrarian 2a4b0e9636 Disable notifications if showcase flag is disabled. 2024-06-05 03:11:49 +02:00
DebaucheryLibrarian 644226531e Using URL or title slug for Whale Member entry IDs for backwards compatability. 2024-06-05 03:05:30 +02:00
DebaucheryLibrarian ab46e8558d Fixed Kink scraper. 2024-06-04 05:12:41 +02:00
DebaucheryLibrarian b6a402d964 Added grandparent network IDs to manticore scene database. 2024-06-04 03:49:35 +02:00
DebaucheryLibrarian 74fbe29db5 Added URL util to repo. 2024-06-04 03:34:09 +02:00
DebaucheryLibrarian c2afa571bf Fixed Whale Member (Porn Pros, Holed) scraper. 2024-06-04 03:30:26 +02:00
DebaucheryLibrarian 43752cef92 Storing serie IDs to manticore scenes table. 2024-06-02 00:28:42 +02:00
DebaucheryLibrarian 91bd0c42be Added showcase boolean to manticore scene CLI tool. 2024-05-31 04:36:47 +02:00
DebaucheryLibrarian 7db724eda4 Set minimum prefix length 3 on manticore actors table. 2024-05-30 23:54:49 +02:00
DebaucheryLibrarian f956f0e112 Converting expression before storing. Pre-fixed some Bang! channel names with 'Bang!'. 2024-05-29 23:57:38 +02:00
DebaucheryLibrarian 0f05abcd27 Implemented alert field AND/OR logic. 2024-05-20 06:29:44 +02:00
DebaucheryLibrarian 5ac64d410e Fixed alert stash deduper. 2024-05-04 05:18:00 +02:00
DebaucheryLibrarian 26f3bf8d6a Fixed title tag filtering in manticore scene sync. 2024-05-01 03:45:51 +02:00
DebaucheryLibrarian 6339a253c0 Syncing alert stash with manticore. 2024-04-29 03:53:17 +02:00
DebaucheryLibrarian db1b72f95f Fixed back-end alert verification. 2024-03-28 01:19:13 +01:00
DebaucheryLibrarian e019648a87 Syncing stash actions to manticore. 2024-03-27 02:39:16 +01:00
DebaucheryLibrarian efd5b959db Removed tag priority filter from manticore scene update query. 2024-03-25 21:51:52 +01:00
DebaucheryLibrarian 00f59b3743 Added movies to manticore migrations and update. 2024-03-25 02:08:54 +01:00
DebaucheryLibrarian f1f618d3a7 Added entity_ids column to manticore scenes table. 2024-03-24 22:16:58 +01:00
DebaucheryLibrarian 33311b4954 Changed weight to mass in manticore actors table to prevent score weight conflict. 2024-03-24 04:23:55 +01:00