boiii
/
traxxx
forked from DebaucheryLibrarian/traxxx
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
2,778 Commits 8 Branches 0 Tags 4.7 GiB
Commit Graph

1128 Commits

Author SHA1 Message Date
DebaucheryLibrarian d3a978c501 Using unprint as default, marked to-be-updated scrapers as deprecated. Merging movie tags and movie scene tags for manticore movies table. Removed poster set to null in deep merge; annotate if it has purpose. Refactored Brad Montana scraper. 2024-08-20 02:33:42 +02:00
DebaucheryLibrarian 596597e0e3 Added MissaX. 2024-08-17 02:33:59 +02:00
DebaucheryLibrarian bca677b0a8 Added virtual entity spawning for multi-page updates (i.e. Elegant Angel). Fixed ffmpeg error freezing process. Refactored Adult Empire/Elegant Angel scraper. 2024-08-16 23:26:52 +02:00
DebaucheryLibrarian 0516b0cee6 Fixed Amnesiac over-selecting actors. 2024-07-11 00:02:37 +02:00
DebaucheryLibrarian acd29a1451 Removed stray console log from Gamma. 2024-07-09 02:22:05 +02:00
DebaucheryLibrarian b8e7029cef Using base poster as fallback for deep poster in merge. Improved Naughty America scraper for live scenes. 2024-07-09 02:19:23 +02:00
DebaucheryLibrarian ad9113f624 Added Upclose to Gamma. 2024-07-09 01:44:17 +02:00
DebaucheryLibrarian 889a13f206 Fixed pagination in Amnesiac/Hentaied scraper. 2024-07-09 00:30:53 +02:00
DebaucheryLibrarian c62a529e76 Added Amnesiac (Hentaied) scraper. 2024-07-08 04:59:28 +02:00
DebaucheryLibrarian 1e03aa37b7 Expanded Naughty America scraper to support Tonight's Girlfriend (and possibly other native sites). 2024-07-08 01:58:11 +02:00
DebaucheryLibrarian 857771e5c6 Inheriting argv request timeout in unprint configuration. 2024-07-06 06:19:38 +02:00
DebaucheryLibrarian 56163f2b3d Refactored and fixed Naughty America scraper. 2024-07-06 06:08:35 +02:00
DebaucheryLibrarian 36a51f0491 Sharing title filter function between manticore update module and sync tool, fixing sync tool title filter word boundaries. 2024-07-05 02:55:02 +02:00
DebaucheryLibrarian f11a009395 Adapted Aylo scraper for Bang Bros. 2024-06-30 03:27:57 +02:00
DebaucheryLibrarian 405db5e002 Solidifed New Sensations entry ID. Updated Four Finger Club to Girl Girl XXX. 2024-06-13 02:16:03 +02:00
DebaucheryLibrarian 8c37071145 Expanded puppeteer options. Fixed Mike Adriano scraper. Fixed convert utility. 2024-06-12 03:21:45 +02:00
DebaucheryLibrarian a0ed434360 Added date range to flush commands. 2024-06-06 00:20:54 +02:00
DebaucheryLibrarian 894eaeb43f Added batch showcase in manticore scene update. 2024-06-05 23:04:07 +02:00
DebaucheryLibrarian 2a4b0e9636 Disable notifications if showcase flag is disabled. 2024-06-05 03:11:49 +02:00
DebaucheryLibrarian 644226531e Using URL or title slug for Whale Member entry IDs for backwards compatability. 2024-06-05 03:05:30 +02:00
DebaucheryLibrarian ab46e8558d Fixed Kink scraper. 2024-06-04 05:12:41 +02:00
DebaucheryLibrarian b6a402d964 Added grandparent network IDs to manticore scene database. 2024-06-04 03:49:35 +02:00
DebaucheryLibrarian 74fbe29db5 Added URL util to repo. 2024-06-04 03:34:09 +02:00
DebaucheryLibrarian c2afa571bf Fixed Whale Member (Porn Pros, Holed) scraper. 2024-06-04 03:30:26 +02:00
DebaucheryLibrarian 43752cef92 Storing serie IDs to manticore scenes table. 2024-06-02 00:28:42 +02:00
DebaucheryLibrarian 91bd0c42be Added showcase boolean to manticore scene CLI tool. 2024-05-31 04:36:47 +02:00
DebaucheryLibrarian 7db724eda4 Set minimum prefix length 3 on manticore actors table. 2024-05-30 23:54:49 +02:00
DebaucheryLibrarian f956f0e112 Converting expression before storing. Pre-fixed some Bang! channel names with 'Bang!'. 2024-05-29 23:57:38 +02:00
DebaucheryLibrarian 0f05abcd27 Implemented alert field AND/OR logic. 2024-05-20 06:29:44 +02:00
DebaucheryLibrarian 5ac64d410e Fixed alert stash deduper. 2024-05-04 05:18:00 +02:00
DebaucheryLibrarian 26f3bf8d6a Fixed title tag filtering in manticore scene sync. 2024-05-01 03:45:51 +02:00
DebaucheryLibrarian 6339a253c0 Syncing alert stash with manticore. 2024-04-29 03:53:17 +02:00
DebaucheryLibrarian db1b72f95f Fixed back-end alert verification. 2024-03-28 01:19:13 +01:00
DebaucheryLibrarian e019648a87 Syncing stash actions to manticore. 2024-03-27 02:39:16 +01:00
DebaucheryLibrarian efd5b959db Removed tag priority filter from manticore scene update query. 2024-03-25 21:51:52 +01:00
DebaucheryLibrarian 00f59b3743 Added movies to manticore migrations and update. 2024-03-25 02:08:54 +01:00
DebaucheryLibrarian f1f618d3a7 Added entity_ids column to manticore scenes table. 2024-03-24 22:16:58 +01:00
DebaucheryLibrarian 33311b4954 Changed weight to mass in manticore actors table to prevent score weight conflict. 2024-03-24 04:23:55 +01:00
DebaucheryLibrarian 05d78d948b Added showcase to manticore migration. Added Cheating Sis to Nubiles. 2024-03-17 03:57:55 +01:00
DebaucheryLibrarian 8749b464fd Added alias and privileges to metadata migration. 2024-03-15 01:24:02 +01:00
DebaucheryLibrarian f83ea2436d Added stashes to Manticore search update. 2024-03-15 00:57:28 +01:00
DebaucheryLibrarian fc0661804f Added filtered titles and secondary tags to manticore database. 2024-02-09 22:30:38 +01:00
DebaucheryLibrarian d9d585d51a Added Manticore migration and meta text field. 2024-01-25 01:58:55 +01:00
DebaucheryLibrarian 86ffcc3316 Updating Manticore scenes database on scene store. 2024-01-25 01:15:42 +01:00
DebaucheryLibrarian a6fb572a21 Added Freaky Fembots to Team Skeet. 2024-01-03 23:03:30 +01:00
DebaucheryLibrarian b872d7a0ec Moved maintenance page to public directory to be served by webserver. 2023-12-07 01:27:44 +01:00
DebaucheryLibrarian 2a3f21976a Added maintenance mode. 2023-12-06 01:51:34 +01:00
DebaucheryLibrarian a3c064be55 Added Inn of Sinn, added Lil Sis to Nubiles. 2023-12-06 00:15:55 +01:00
DebaucheryLibrarian 1e707ccefa Added database pool settings. 2023-12-01 02:19:53 +01:00
DebaucheryLibrarian 9ea317939b Fixed session reuse in Aylo scraper. 2023-12-01 02:09:24 +01:00
DebaucheryLibrarian 98bf7ea9dd Updated all dependencies. Updated MindGeek to Aylo. 2023-11-30 03:12:47 +01:00
DebaucheryLibrarian 0369446681 Added AND/OR toggle to alerts. 2023-11-24 02:10:03 +01:00
DebaucheryLibrarian 238dce78b5 Refactored alerts to use application code, added regex. Updated Jules Jordan for the Ass Factory relaunch. 2023-11-24 01:29:22 +01:00
DebaucheryLibrarian 1cf06a8b49 Fixed Vixen upcoming. 2023-11-09 01:10:05 +01:00
DebaucheryLibrarian edc724b475 Storing photo counts. 2023-11-07 04:46:45 +01:00
DebaucheryLibrarian eba96df631 Added The Flourish, adapted Arch Angel scraper. 2023-11-07 04:29:35 +01:00
DebaucheryLibrarian e20641e101 Fixed Teen Mega World scraper. 2023-11-07 03:06:39 +01:00
DebaucheryLibrarian eeb947d311 Catching media store fail unlink error to prevent batch failure. 2023-08-28 02:53:35 +02:00
DebaucheryLibrarian c94dcdd9e6 Updated Radical to support Top Web Models. 2023-08-16 06:31:49 +02:00
DebaucheryLibrarian b29a34c76a Updated AnalVids. 2023-08-16 03:08:47 +02:00
DebaucheryLibrarian 1ed47c3173 Updated Radical scraper. Added town property to location resolve tool. 2023-08-14 01:54:17 +02:00
DebaucheryLibrarian c860bfebc1 Separated error log. Added search/summary update tool. 2023-08-13 21:57:32 +02:00
DebaucheryLibrarian 02850eb6e3 Updated Team Skeet and MYLF. 2023-08-11 03:56:08 +02:00
DebaucheryLibrarian 2df20aea38 Moved Aziani to Gamma. 2023-08-05 00:09:13 +02:00
DebaucheryLibrarian 5f26f8de27 Excluding studios from entity aggregration. Added profile scraping to Teste de Fudelidade. 2023-08-04 22:30:18 +02:00
DebaucheryLibrarian 328550b9a3 Added Teste de Fudelidade. 2023-08-04 22:02:28 +02:00
DebaucheryLibrarian 54dbea659a Added missing image fallbacks to legacy Aziani scraper. 2023-08-04 21:43:57 +02:00
DebaucheryLibrarian 4a10887e48 Fixed Aziani breaking on missing source. 2023-08-04 00:12:24 +02:00
DebaucheryLibrarian abbfedf3f7 Added trailer support to legacy Aziani scraper. 2023-08-03 23:35:10 +02:00
DebaucheryLibrarian b287f5c2db Fixed photo query in Aziana scraper. 2023-08-03 23:24:23 +02:00
DebaucheryLibrarian 5f2c9eb5df Fixed place cache check. 2023-08-03 00:31:07 +02:00
DebaucheryLibrarian c5d81e94e5 Updated OSM API path, added redis caching. 2023-08-02 23:12:41 +02:00
DebaucheryLibrarian e9a1df9123 Improved Model Media scene code matching. 2023-08-02 16:38:50 +02:00
DebaucheryLibrarian c064efc812 Fixed title curation disparity Tokyo Hot. 2023-08-02 02:22:26 +02:00
DebaucheryLibrarian 8c1f1b69ff Splitting Han titles and actors in Model Media scraper. 2023-08-02 02:14:41 +02:00
DebaucheryLibrarian ae64c5225f Added conditions to Tokyo Hot scraper to prevent total failure. 2023-07-31 23:41:32 +02:00
DebaucheryLibrarian ab5b165c68 Preserving Jules Jordan base photos in deep scrape. 2023-07-29 23:59:17 +02:00
DebaucheryLibrarian 40276a11f9 Fixed Tokyo Hot deep scrape failing on missing trailer. 2023-07-25 20:45:46 +02:00
DebaucheryLibrarian b7a31b7933 Added showcase flag to batch table. 2023-07-25 03:22:24 +02:00
DebaucheryLibrarian 693983dc29 Added screen caps separate from photos. Added Tokyo Hot. Added hair type, shoe size and blood type actor fields. 2023-07-25 03:03:41 +02:00
DebaucheryLibrarian 9f727a0fa0 Added analytics configuration. 2023-07-24 00:59:47 +02:00
DebaucheryLibrarian 997914ec27 Improved Hush T1 profile scraper. 2023-07-23 01:05:25 +02:00
DebaucheryLibrarian ca695db3ba Storing actor socials, improved Hush profile scraper. 2023-07-23 01:02:18 +02:00
DebaucheryLibrarian 80750b44dc Added Milfy to profile list, fixed Vixen not returning gracefully when profile is not found. 2023-07-22 00:49:56 +02:00
DebaucheryLibrarian 25f3dcf9a5 Fixed avatar data type in Vixen scraper. 2023-07-22 00:01:12 +02:00
DebaucheryLibrarian 0b101dde3c Updated Vixen model scraper. 2023-07-21 23:55:30 +02:00
DebaucheryLibrarian 86e4fb7603 Fixed Team Skeet profiles. 2023-07-21 21:58:50 +02:00
DebaucheryLibrarian dab38c8013 Added grey hair color, removed console log. 2023-07-21 01:07:06 +02:00
DebaucheryLibrarian c29ecac41c Fixed summary view refresh. 2023-07-17 02:56:37 +02:00
DebaucheryLibrarian 2b3b2d7fd2 Using summaries table for improved performance. 2023-07-17 01:59:26 +02:00
DebaucheryLibrarian 77727dff77 Added MariskaX. 2023-07-09 21:39:40 +02:00
DebaucheryLibrarian f009c90e5d Updated Blowpass seed entries. 2023-07-09 05:23:17 +02:00
DebaucheryLibrarian 1cba51fbfd Moved Blowpass to Gamma API. 2023-07-09 05:08:35 +02:00
DebaucheryLibrarian 88a56794aa Separated Filthy Kings into its channels, upgraded Gamma scraper to accomodate. 2023-07-09 04:35:30 +02:00
DebaucheryLibrarian 6f4608ba23 Using better video API for Vixen deep scrape. 2023-07-07 02:20:07 +02:00
DebaucheryLibrarian 83e22813f3 Using more aggressive optional chaining in Vixen scraper to prevent errors. 2023-07-07 00:23:02 +02:00
DebaucheryLibrarian f8e7ace89f Removed superfluous console logs. 2023-07-06 05:40:23 +02:00
DebaucheryLibrarian 8bb46c5a6d Moved missing slug return in Vixen scraper. 2023-07-06 05:30:51 +02:00
DebaucheryLibrarian 51e04e7331 Updated Jules Jordan profile scraper. 2023-07-06 05:09:05 +02:00
DebaucheryLibrarian 18744372b3 Updated Vixen scraper with more informative API query. 2023-07-06 04:24:47 +02:00
DebaucheryLibrarian f6c1910be3 Added media attempt configuration, default from 3 to 2, 1 for JJ scraper. 2023-07-06 00:30:04 +02:00
DebaucheryLibrarian 0905847ffa Updated Jules Jordan scraper. 2023-07-06 00:14:38 +02:00
DebaucheryLibrarian 916deff487 Fixed Arch Angel placeholder thumbnail. 2023-07-03 00:50:47 +02:00
DebaucheryLibrarian 13d02a44e5 Fixed failed hash duplicate source breaking media association. 2023-07-02 23:59:49 +02:00
DebaucheryLibrarian 61c84e18e4 Added separate force media argument. 2023-07-02 21:06:38 +02:00
DebaucheryLibrarian 4a3674feac Added dedicated Arch Angel scraper. 2023-07-02 05:07:38 +02:00
DebaucheryLibrarian a339c096ef Fixed Kink trailer query. 2023-07-02 01:04:39 +02:00
DebaucheryLibrarian a8fa1f36f8 Added Van Styles to Jules Jordan tag directors. 2023-07-01 22:45:28 +02:00
DebaucheryLibrarian a2331bc913 Added prefer option for entity resolution. Merged migrations. 2023-07-01 22:24:21 +02:00
DebaucheryLibrarian aa9e3b3d1f Deriving Jules Jordan director from tags. 2023-07-01 21:53:01 +02:00
DebaucheryLibrarian 205102ff90 Added Meiden van Holland and Vurig Vlaanderen. 2023-07-01 21:46:44 +02:00
DebaucheryLibrarian 25a90dd52c Moved Dogfart to DFXtra. 2023-06-22 01:31:36 +02:00
DebaucheryLibrarian 18f75595da Added GraphiQL disable. 2023-06-19 03:28:55 +02:00
DebaucheryLibrarian 1766556c49 Added query timeout setting. 2023-06-19 01:45:45 +02:00
DebaucheryLibrarian dbaddfb291 Merged database migrations. 2023-06-19 00:39:00 +02:00
DebaucheryLibrarian 87a29baf8b Added stream ignore option. 2023-06-18 02:12:13 +02:00
DebaucheryLibrarian 7723b2b698 Only curating release ID when present. 2023-06-16 02:29:01 +02:00
DebaucheryLibrarian 128f9950ec Prefer HTML over data titles for capitalization in Bang scraper. 2023-06-15 19:53:42 +02:00
DebaucheryLibrarian 5d3358ed91 Decoding HTML entities in title, description and location. 2023-06-15 16:56:27 +02:00
DebaucheryLibrarian bcc183d5b9 Using native stream promises for media stream retrieval. 2023-06-11 01:17:37 +02:00
DebaucheryLibrarian 80334843c9 Improved puppeteer bypass, enabled for Team Skeet. 2023-06-10 02:05:59 +02:00
DebaucheryLibrarian bae51dd59c Fixed poster query for old New Sensations scenes. 2023-06-10 00:46:38 +02:00
DebaucheryLibrarian c4e4f649f5 Fixed New Sensations classic scraper breaking on missing actors. 2023-06-09 00:33:40 +02:00
DebaucheryLibrarian d847c58d24 Changed stash routing. 2023-06-08 04:19:37 +02:00
DebaucheryLibrarian 914838e367 Curating usernames in sign-up and stash load tool. 2023-06-08 03:57:50 +02:00
DebaucheryLibrarian 1fc441670b Reduced stash load verbosity. 2023-06-08 03:48:29 +02:00
DebaucheryLibrarian a16ca716da Warn instead of error when stash import user does not exist. 2023-06-08 03:42:26 +02:00
DebaucheryLibrarian 9c63b31dfa Fixed alert tool to transfer combinations. 2023-06-08 03:22:46 +02:00
DebaucheryLibrarian 9bdd3ff2f3 Added alert transfer tools to repo. 2023-06-08 02:37:39 +02:00
DebaucheryLibrarian 3dbb74a1dc Added alert transfer tools. Removed stash and alert add-tiles in favor of more prominent heading buttons. 2023-06-08 02:36:47 +02:00
DebaucheryLibrarian e7b72f5e99 Added filename to stash save. 2023-06-08 01:39:44 +02:00
DebaucheryLibrarian 5576fed590 Fixed existing stash selection in transfer tool. 2023-06-08 01:37:27 +02:00
DebaucheryLibrarian 56534800d8 Added stash transfer tool. 2023-06-08 01:16:44 +02:00
DebaucheryLibrarian e36ba59d27 Auto-recognizing m3u8 sources as stream. Fixed Bang Bros poster and trailer. 2023-06-05 04:49:44 +02:00
DebaucheryLibrarian d3da2359de Refactored Bang! scraper, added My Stepdaughters Friend. 2023-06-05 03:32:24 +02:00
DebaucheryLibrarian adda78f0c6 Refactored New Sensations scraper. 2023-06-05 02:13:36 +02:00
DebaucheryLibrarian 164757ee26 Matching URLs to entity using hostname rather than slug to minimize collisions. Fixed missing Cum Louder POV logo. 2023-06-04 21:50:59 +02:00
DebaucheryLibrarian caf37ba9fb Transferring release media types separately to prevent race conditions. 2023-06-04 04:17:01 +02:00
DebaucheryLibrarian 18e91d54f1 Transfer tool finds existing media by source. 2023-06-04 01:24:18 +02:00
DebaucheryLibrarian 84c59bd05a Removed redundant description replace in transfer tool. 2023-06-04 01:20:38 +02:00
DebaucheryLibrarian e0f7db8187 Improved skipped scene reporting in transfer tool. 2023-06-04 01:13:23 +02:00
DebaucheryLibrarian 13e38c487f Ignoring skipped scenes in final tally. 2023-06-04 01:05:59 +02:00
DebaucheryLibrarian 33cab26d3b Fixed transfer status, moved media logging to debug level. 2023-06-04 01:04:21 +02:00
DebaucheryLibrarian c9201430ea Logging index in transfer. 2023-06-04 00:58:35 +02:00
DebaucheryLibrarian a4c82a377b Returning existing release ID in case new scene for existing movie was encountered. 2023-06-04 00:49:21 +02:00
DebaucheryLibrarian 66f4244779 Logging skipped releases. 2023-06-04 00:42:29 +02:00
DebaucheryLibrarian 54798f87da Improved duplicate media handling in transfer tool. 2023-06-04 00:23:45 +02:00
DebaucheryLibrarian f356135722 Using line-separated JSON to save memory in transfer tool. 2023-06-03 22:41:15 +02:00
DebaucheryLibrarian 5103a07e5f Accumulating boolean instead of full scene. 2023-06-03 21:51:09 +02:00
DebaucheryLibrarian 4b9a0e6bab Extended and improved transfer tool. Moved scenes up on movie page. 2023-06-03 02:51:42 +02:00