DebaucheryLibrarian
|
eba96df631
|
Added The Flourish, adapted Arch Angel scraper.
|
2023-11-07 04:29:35 +01:00 |
DebaucheryLibrarian
|
e20641e101
|
Fixed Teen Mega World scraper.
|
2023-11-07 03:06:39 +01:00 |
DebaucheryLibrarian
|
e7a4ccecf3
|
Renamed Natasha Teen Productions to Natasha Teen Films.
|
2023-09-24 04:29:43 +02:00 |
DebaucheryLibrarian
|
c94dcdd9e6
|
Updated Radical to support Top Web Models.
|
2023-08-16 06:31:49 +02:00 |
DebaucheryLibrarian
|
c860bfebc1
|
Separated error log. Added search/summary update tool.
|
2023-08-13 21:57:32 +02:00 |
DebaucheryLibrarian
|
bf36825fce
|
Added Say Uncle channels.
|
2023-08-12 23:19:30 +02:00 |
DebaucheryLibrarian
|
02850eb6e3
|
Updated Team Skeet and MYLF.
|
2023-08-11 03:56:08 +02:00 |
DebaucheryLibrarian
|
2df20aea38
|
Moved Aziani to Gamma.
|
2023-08-05 00:09:13 +02:00 |
DebaucheryLibrarian
|
54dbea659a
|
Added missing image fallbacks to legacy Aziani scraper.
|
2023-08-04 21:43:57 +02:00 |
DebaucheryLibrarian
|
ae64c5225f
|
Added conditions to Tokyo Hot scraper to prevent total failure.
|
2023-07-31 23:41:32 +02:00 |
DebaucheryLibrarian
|
ab5b165c68
|
Preserving Jules Jordan base photos in deep scrape.
|
2023-07-29 23:59:17 +02:00 |
DebaucheryLibrarian
|
c3d4bf0e62
|
Capitalized JAV tag.
|
2023-07-26 00:28:03 +02:00 |
DebaucheryLibrarian
|
693983dc29
|
Added screen caps separate from photos. Added Tokyo Hot. Added hair type, shoe size and blood type actor fields.
|
2023-07-25 03:03:41 +02:00 |
DebaucheryLibrarian
|
2b3b2d7fd2
|
Using summaries table for improved performance.
|
2023-07-17 01:59:26 +02:00 |
DebaucheryLibrarian
|
77727dff77
|
Added MariskaX.
|
2023-07-09 21:39:40 +02:00 |
DebaucheryLibrarian
|
f009c90e5d
|
Updated Blowpass seed entries.
|
2023-07-09 05:23:17 +02:00 |
DebaucheryLibrarian
|
1cba51fbfd
|
Moved Blowpass to Gamma API.
|
2023-07-09 05:08:35 +02:00 |
DebaucheryLibrarian
|
88a56794aa
|
Separated Filthy Kings into its channels, upgraded Gamma scraper to accomodate.
|
2023-07-09 04:35:30 +02:00 |
DebaucheryLibrarian
|
6cb48647a8
|
Updated deepthroat tag photo.
|
2023-07-07 03:43:16 +02:00 |
DebaucheryLibrarian
|
18744372b3
|
Updated Vixen scraper with more informative API query.
|
2023-07-06 04:24:47 +02:00 |
DebaucheryLibrarian
|
0905847ffa
|
Updated Jules Jordan scraper.
|
2023-07-06 00:14:38 +02:00 |
DebaucheryLibrarian
|
916deff487
|
Fixed Arch Angel placeholder thumbnail.
|
2023-07-03 00:50:47 +02:00 |
DebaucheryLibrarian
|
bb204f3d85
|
Disabled Arch Angel campaigns until NATS license is reactivated.
|
2023-07-02 05:17:27 +02:00 |
DebaucheryLibrarian
|
4a3674feac
|
Added dedicated Arch Angel scraper.
|
2023-07-02 05:07:38 +02:00 |
DebaucheryLibrarian
|
205102ff90
|
Added Meiden van Holland and Vurig Vlaanderen.
|
2023-07-01 21:46:44 +02:00 |
DebaucheryLibrarian
|
fbcf17d1c4
|
Refactored stats page.
|
2023-06-24 17:16:06 +02:00 |
DebaucheryLibrarian
|
25a90dd52c
|
Moved Dogfart to DFXtra.
|
2023-06-22 01:31:36 +02:00 |
DebaucheryLibrarian
|
b5309005e9
|
Using affiliate parameters for Bang, fixed affiliate URL composition on entity page.
|
2023-06-19 05:19:49 +02:00 |
DebaucheryLibrarian
|
54c501e277
|
Added Bang affiliate link.
|
2023-06-19 05:11:27 +02:00 |
DebaucheryLibrarian
|
013675d102
|
Improved showcase query.
|
2023-06-17 23:31:09 +02:00 |
DebaucheryLibrarian
|
236d4a9427
|
Fixed showcased not inserted in networks seed file.
|
2023-06-16 03:18:40 +02:00 |
DebaucheryLibrarian
|
22512833da
|
Dsiabled showcase for entirey Nebraska Coeds network.
|
2023-06-16 03:17:03 +02:00 |
DebaucheryLibrarian
|
dc231527f3
|
Disabled showcase for Nebraska Coeds.
|
2023-06-16 03:14:38 +02:00 |
DebaucheryLibrarian
|
682f299c8f
|
Added Milfy to Vixen.
|
2023-06-16 02:12:31 +02:00 |
DebaucheryLibrarian
|
c4e4f649f5
|
Fixed New Sensations classic scraper breaking on missing actors.
|
2023-06-09 00:33:40 +02:00 |
DebaucheryLibrarian
|
d3da2359de
|
Refactored Bang! scraper, added My Stepdaughters Friend.
|
2023-06-05 03:32:24 +02:00 |
DebaucheryLibrarian
|
adda78f0c6
|
Refactored New Sensations scraper.
|
2023-06-05 02:13:36 +02:00 |
DebaucheryLibrarian
|
1b4d973e7b
|
Added transfer tool, WIP. Added Savage Gangbang to Kink.
|
2023-05-31 00:29:54 +02:00 |
DebaucheryLibrarian
|
54b1c03a8d
|
Added Fabulous Cash sites.
|
2023-04-06 01:28:59 +02:00 |
DebaucheryLibrarian
|
1a24d39761
|
Updated MG session acquisition.
|
2023-03-27 00:01:38 +02:00 |
DebaucheryLibrarian
|
306744f415
|
Restored upcoming in Bang! scraper, added Bang! Adventures site.
|
2023-01-03 23:32:52 +01:00 |
DebaucheryLibrarian
|
eb759a0dec
|
Fixed Kink Men Test Shoots slug.
|
2023-01-01 02:03:18 +01:00 |
DebaucheryLibrarian
|
0d846c8871
|
Updated Kink channel inventory, separated Kink Men.
|
2022-12-31 17:50:39 +01:00 |
DebaucheryLibrarian
|
6edd62c337
|
Refactored Bang! scraper to match new website, first use of unprint.
|
2022-11-27 04:22:58 +01:00 |
DebaucheryLibrarian
|
2943aea4d8
|
Added showcased migration. Added Love Her Films scraper.
|
2022-10-25 23:13:24 +02:00 |
DebaucheryLibrarian
|
a6905e4664
|
Added showcased column, hiding most LegalPorno/AnalVids studios. Refined Adult Time network structure.
|
2022-10-05 22:01:27 +02:00 |
DebaucheryLibrarian
|
463e0e1fe7
|
Added and restructured various Adult Time series and studios.
|
2022-10-02 22:49:38 +02:00 |
DebaucheryLibrarian
|
0fc37e46d2
|
Fixed media module trying to fetch invalid source URLs. Added Accidental Gangbang to Adult Time.
|
2022-09-27 20:09:46 +02:00 |
DebaucheryLibrarian
|
3db8b80164
|
Added CF resolver to http module. Using priority lookup in tags seed.
|
2022-08-15 23:51:51 +02:00 |
DebaucheryLibrarian
|
cd187fac16
|
Added campaign retrieval function, added banner to homepage.
|
2022-07-18 02:42:30 +02:00 |
DebaucheryLibrarian
|
01b37f087f
|
Added native site support to Perv City scraper for DP Diva.
|
2022-07-10 01:57:24 +02:00 |
DebaucheryLibrarian
|
43d239a6ae
|
Added Ricky's Room.
|
2022-05-29 21:10:44 +02:00 |
DebaucheryLibrarian
|
527112d5da
|
Refactored Vixen scraper, moved XEmpire to generic Gamma scraper after site update, added BiPhoria.
|
2022-05-15 23:28:56 +02:00 |
DebaucheryLibrarian
|
b9556c9c86
|
Set Kink rate limits, added method parameter for arbitrary requests.
|
2022-04-10 21:51:22 +02:00 |
DebaucheryLibrarian
|
cc63cc652a
|
Using network page for Dogfart sites without complete index.
|
2022-04-07 23:22:40 +02:00 |
DebaucheryLibrarian
|
1d84830423
|
Supporting JSON in scenes file. Added Dogfart link finding utility.
|
2022-04-07 16:06:38 +02:00 |
DebaucheryLibrarian
|
0d95746689
|
Added update url parameter to Dogfart scraper.
|
2022-04-04 18:21:51 +02:00 |
DebaucheryLibrarian
|
5cbf122d6f
|
Scraping Dogfart scenes from native sites.
|
2022-04-03 23:00:05 +02:00 |
DebaucheryLibrarian
|
5e499c3685
|
Added chunking to media duplicate queries to prevent overloading parameters. Added DP Diva to Perv City (coming soon).
|
2022-04-02 00:32:23 +02:00 |
DebaucheryLibrarian
|
39813d4461
|
Updated Insex scraper.
|
2022-03-31 22:46:54 +02:00 |
DebaucheryLibrarian
|
94e07ff23d
|
Added Bang! Podcast channel.
|
2022-03-30 16:11:07 +02:00 |
DebaucheryLibrarian
|
c455f02c66
|
Updated Men URLs.
|
2022-03-30 15:45:41 +02:00 |
DebaucheryLibrarian
|
2021093645
|
Marked Dane Jones and Lesbea as native sites.
|
2022-03-29 23:24:55 +02:00 |
DebaucheryLibrarian
|
1ef946fa77
|
Marked Mile High sites as native.
|
2022-03-28 23:44:42 +02:00 |
DebaucheryLibrarian
|
e93e8ace5c
|
Added deep scene force parameter to MindGeek scraper.
|
2022-03-27 00:27:26 +01:00 |
DebaucheryLibrarian
|
5ff076cac3
|
Added DP Star Sex Challenges to Digital Playground.
|
2022-03-09 23:26:48 +01:00 |
DebaucheryLibrarian
|
f0d0ee3acc
|
Removed redundant scenes path from Digital Playground main channel.
|
2022-02-27 21:15:05 +01:00 |
DebaucheryLibrarian
|
a239a5c593
|
Fixed entity scenes function for studios. Added triple anal tag alias.
|
2022-02-25 00:00:18 +01:00 |
DebaucheryLibrarian
|
d55e3c37cd
|
Updated media seeds from LegalPorno to AnalVids.
|
2022-02-24 23:33:19 +01:00 |
DebaucheryLibrarian
|
3e290b74dc
|
Updated affiliates from LegalPorno to AnalVids.
|
2022-02-24 23:30:47 +01:00 |
DebaucheryLibrarian
|
17dfeac1af
|
Renamed LegalPorno to AnalVids, added missing studios.
|
2022-02-24 23:28:24 +01:00 |
DebaucheryLibrarian
|
333f252099
|
Added BJ Raw to Radical.
|
2022-02-24 22:42:59 +01:00 |
DebaucheryLibrarian
|
582269cfaa
|
Added Radical metadata layout scraper and the Got Filled and Inserted channels.
|
2022-02-24 22:33:00 +01:00 |
DebaucheryLibrarian
|
fecef6c1cf
|
Added missing MOFOS serie channels.
|
2022-02-20 23:40:20 +01:00 |
DebaucheryLibrarian
|
690d2bb3ed
|
Added MOFOS to default rate limit config, added light logos.
|
2022-02-20 16:52:29 +01:00 |
DebaucheryLibrarian
|
8386230f33
|
Added missing Team Skeet sites.
|
2022-02-14 01:27:56 +01:00 |
DebaucheryLibrarian
|
496c29e569
|
Configured Reality Kings to fetch session from RK scene overview.
|
2022-02-11 22:14:44 +01:00 |
DebaucheryLibrarian
|
f7bbab08bd
|
Added Porn Pros main channel and working URLs for Flexible Positions, Public Violations and Squirt Disgrace. Added bisexual tag photos.
|
2022-02-08 23:59:44 +01:00 |
DebaucheryLibrarian
|
9b7879bff7
|
Removed channel ID from Gamma update query to prevent duplicate scenes. Added sexuality tags with covers to overview.
|
2022-02-08 00:19:34 +01:00 |
DebaucheryLibrarian
|
fffe9080f3
|
Added stand-alone Spizoo sites.
|
2022-02-07 21:58:27 +01:00 |
DebaucheryLibrarian
|
f1a7f2f905
|
Added Gamma movie API scraper.
|
2022-02-02 23:51:15 +01:00 |
DebaucheryLibrarian
|
10b8abf706
|
Updated Zero Tolerance channel to Zero Tolerance Films.
|
2022-02-02 22:25:04 +01:00 |
DebaucheryLibrarian
|
502c588958
|
Updated Bang Bros product ID for Haze Her, removed wrong ones.
|
2022-01-30 00:18:15 +01:00 |
DebaucheryLibrarian
|
784d326584
|
Updated Bang Bros product ID for College Rules.
|
2022-01-30 00:08:39 +01:00 |
DebaucheryLibrarian
|
af320684b4
|
Added Bang Bros sites.
|
2022-01-29 03:34:26 +01:00 |
DebaucheryLibrarian
|
d776cc2f71
|
Added Abuse Me to Bang Bros network.
|
2022-01-29 02:39:14 +01:00 |
DebaucheryLibrarian
|
5c5a11fdca
|
Added Bang Bros members page scraper (not for full scenes).
|
2022-01-29 01:21:41 +01:00 |
boiii
|
d77c145de3
|
Update 'seeds/02_sites.js'
|
2022-01-25 20:56:11 +00:00 |
DebaucheryLibrarian
|
b9146aee5f
|
Removed exclusive filter from Evil Angel parameters.
|
2022-01-07 01:02:34 +01:00 |
DebaucheryLibrarian
|
5d80b6dc21
|
Added and improved Reality Kings logos. Added tag photos.
|
2022-01-06 01:41:26 +01:00 |
DebaucheryLibrarian
|
5b5688438c
|
Fixed Gamma movie scene query. Added tag photos.
|
2021-12-11 22:46:55 +01:00 |
DebaucheryLibrarian
|
9d7183ac69
|
Added PurgatoryX scraper.
|
2021-11-27 23:55:16 +01:00 |
DebaucheryLibrarian
|
f0b7678444
|
Fixed upsert failing on empty insert array due breaking Knex API change.
|
2021-11-21 00:19:10 +01:00 |
DebaucheryLibrarian
|
26539b74a5
|
Updated dependencies. Added periodic memory logger.
|
2021-11-20 23:59:48 +01:00 |
DebaucheryLibrarian
|
0864154a0e
|
Added unextracted property to keep paginating when extracting scenes.
|
2021-10-28 01:59:53 +02:00 |
DebaucheryLibrarian
|
a22c4d5679
|
Added beforeNetwork hook, used by MindGeek. Added Filthy Kings to Gamma.
|
2021-10-27 17:19:23 +02:00 |
DebaucheryLibrarian
|
6c5d4389fe
|
Not parsing HTML with jsdom when using http module directly to save memory. Added loading ellipsis to release grid pages.
|
2021-10-25 02:06:24 +02:00 |
DebaucheryLibrarian
|
167df35d37
|
Fixed tags module not dealing with empty releases or tags, added origin tag column to chapter tag table.
|
2021-10-17 00:28:13 +02:00 |
DebaucheryLibrarian
|
f1ff662be2
|
Fixed tags seed file.
|
2021-10-11 04:31:40 +02:00 |
DebaucheryLibrarian
|
b6ad2903f3
|
Storing original tags.
|
2021-10-10 00:04:21 +02:00 |