Commit Graph

1344 Commits

Author SHA1 Message Date
DebaucheryLibrarian
56169f00d6 Added feeds db table. Using undici agent for proxy. 2026-04-04 00:19:08 +02:00
DebaucheryLibrarian
3d1b6a7cd6 Using channel origin instead of url for Teen Core Club scene links. 2026-04-03 22:45:39 +02:00
DebaucheryLibrarian
bb168969ae Fixed undici in http module breaking on headers duplicated due casing. 2026-04-03 01:16:52 +02:00
DebaucheryLibrarian
802fd44260 Enabled gay results in Teen Core Club query. 2026-04-03 00:40:45 +02:00
DebaucheryLibrarian
a492401db0 Storing scene language and production date precision. Refactored Teen Core Club. 2026-04-03 00:26:13 +02:00
DebaucheryLibrarian
a96ec64d61 Refactored media fetch with undici for http/2 support. 2026-04-02 04:45:31 +02:00
DebaucheryLibrarian
ebb8832096 Added DarkkoTV scraper. Removed some obsolete web components. 2026-03-31 06:29:30 +02:00
DebaucheryLibrarian
01c4b61f03 No longer Bang @id field for entryId, this is now the full URL for some reason. 2026-03-27 03:32:26 +01:00
DebaucheryLibrarian
f5da798cd2 Fixed expect type associated to wrong object in Bang scraper. 2026-03-27 03:22:51 +01:00
DebaucheryLibrarian
69d410666d Fixed expect instead of expectType property in Bang scraper. 2026-03-27 03:12:07 +01:00
DebaucheryLibrarian
ae3a181503 Added octet expectation to Bang photos. 2026-03-27 03:11:00 +01:00
DebaucheryLibrarian
ba2a5c2225 Fixed unmatched censored tags. 2026-03-22 04:46:40 +01:00
DebaucheryLibrarian
1c6a28247a Removed remote browser config into bypass browser section. 2026-03-20 23:10:01 +01:00
DebaucheryLibrarian
f46b56f606 Updated unprint, integrated remote browser. Updated Kink affiliate URLs. 2026-03-20 23:01:57 +01:00
DebaucheryLibrarian
a7df43eb55 Added Pascal's Subsluts affiliate. 2026-03-20 01:59:22 +01:00
DebaucheryLibrarian
1c8df6415d Added Jawked to Karups, set up affiliate links. 2026-03-17 23:54:32 +01:00
DebaucheryLibrarian
0beb54312a Updating Manticore scenes after tag reassociation. 2026-03-16 04:58:46 +01:00
DebaucheryLibrarian
6cad394e88 Removed stray console log. 2026-03-16 02:50:31 +01:00
DebaucheryLibrarian
186f9660c3 Increased dangerous query bindings threshold. 2026-03-15 22:30:55 +01:00
DebaucheryLibrarian
1b6aaafe10 Using batch insert module for media, calculating chunk size based on item size. 2026-03-15 21:33:14 +01:00
DebaucheryLibrarian
74d03b7483 Using browser for Nubiles, added She's Breeding Material. 2026-03-15 20:07:51 +01:00
DebaucheryLibrarian
0d30115ad5 Refreshing entity slug cache in seeds. Added Hardwerk to Radical. 2026-03-15 17:42:07 +01:00
DebaucheryLibrarian
108bf3b168 Integrated manticore stash sync tool. 2026-03-13 05:14:42 +01:00
DebaucheryLibrarian
155e235246 Fixed Aylo specifying wrong host for media. 2026-03-10 05:54:00 +01:00
DebaucheryLibrarian
c7111329dc Improved knex error reporting. 2026-03-10 04:41:30 +01:00
DebaucheryLibrarian
ea298d7edb Fixed Aylo scraper ignoring session configuration. 2026-03-09 05:36:17 +01:00
DebaucheryLibrarian
24cba1e1fa Deleting flushed scenes from manticore. 2026-03-08 04:03:55 +01:00
DebaucheryLibrarian
f1caa77e4b Added scene tags table to manticore scenes tool. 2026-03-05 02:00:43 +01:00
DebaucheryLibrarian
016c24af28 Added channel filter option to Gamma scraper, re-added Disruptive Films channel. 2026-03-03 22:40:49 +01:00
DebaucheryLibrarian
68ddc8cb78 Added Wicked affiliate. Improved Gamma banner tool filename composition. 2026-03-03 01:20:58 +01:00
DebaucheryLibrarian
7276d90629 Disabled tags by default in Gamma banner tool filenames. Added Gangbang Creampie, Gloryhole Secrets and Taboo Heat affiliates. 2026-03-02 23:55:09 +01:00
DebaucheryLibrarian
16648d50f6 Re-enabled filename actors and tags in Gamma banner tool, improved disable argument. 2026-03-02 06:24:54 +01:00
DebaucheryLibrarian
42effd53fc Added Diabolic affiliate. Disabled filename actors and tags in Gamma banner tool, unreliable. 2026-03-02 06:21:27 +01:00
DebaucheryLibrarian
0500f7eda8 Added Burning Angel affiliate. Fixed Gamma banner tool breaking on invalid URL. 2026-03-02 05:52:46 +01:00
DebaucheryLibrarian
f3e2143b45 Fixed wrong date parse function call in Gamma scraper. Added Biphoria affiliate link. 2026-03-02 04:01:39 +01:00
DebaucheryLibrarian
d8b41ec9b5 Use request interface for Vixen deep fetch, seemingly less chance of a 403. 2026-03-02 03:46:46 +01:00
DebaucheryLibrarian
c2fc09fdaa Removed redundant program filter from Gamma banner tool. 2026-03-02 03:27:24 +01:00
DebaucheryLibrarian
e029ca7fd0 Added Gamma banner downloader. 2026-03-02 03:08:26 +01:00
DebaucheryLibrarian
dcaee01ce8 Using channel origin instead of URL for Gamma referer URL composition. 2026-03-02 03:07:10 +01:00
DebaucheryLibrarian
98b735dbae Added Vivid and Zero Tolerance affiliate links. Restored BAM Visions profile scraper, site is back online. 2026-03-02 01:41:36 +01:00
DebaucheryLibrarian
23257745a7 Fixed profile updated_at timestamp not updating. 2026-03-02 01:14:23 +01:00
DebaucheryLibrarian
eb20af14a6 Improved Gamma scene URL composition. 2026-03-02 01:06:29 +01:00
DebaucheryLibrarian
2b20d98ee0 Removed stray console log. 2026-03-01 23:53:22 +01:00
DebaucheryLibrarian
af57f412c9 Refactored Gamma scraper, only using API. 2026-03-01 23:52:41 +01:00
DebaucheryLibrarian
5b6fefd43b Rounding actor profile values stored as integers to prevent database errors. 2026-03-01 20:45:30 +01:00
DebaucheryLibrarian
209a81ef71 Removed Vivid wrapper, updated channel URLs. 2026-03-01 19:58:35 +01:00
DebaucheryLibrarian
b89f25405a Using batch insert for various actor scraping inserts. 2026-03-01 04:49:01 +01:00
DebaucheryLibrarian
198f08cb3a Removed stray console log. 2026-03-01 04:28:09 +01:00
DebaucheryLibrarian
f82167656b Changed actor foot column to decimal. 2026-03-01 04:27:29 +01:00
DebaucheryLibrarian
612a489cdf Fixed actor scraper list reference. 2026-02-27 00:55:14 +01:00