DebaucheryLibrarian/traxxx
2
1
Fork 1
Code Issues 39 Pull Requests 1 Releases Wiki Activity
Files
e3ef0a0d699aee395dd5e1ce07faa90c26ccd37c
traxxx/src/scrapers
History
DebaucheryLibrarian e3ef0a0d69 Added Top Web Models profile scraper.
2021-01-16 04:10:43 +01:00
..
21naturals.js
Switched to tabs. Adding missing actor entries when scraping actors, with batch ID.
2020-05-14 04:26:05 +02:00
21sextreme.js
Switched to tabs. Adding missing actor entries when scraping actors, with batch ID.
2020-05-14 04:26:05 +02:00
21sextury.js
Switched to tabs. Adding missing actor entries when scraping actors, with batch ID.
2020-05-14 04:26:05 +02:00
adulttime.js
Switched to tabs. Adding missing actor entries when scraping actors, with batch ID.
2020-05-14 04:26:05 +02:00
amateurallure.js
Changed next page determination to ensure --after is followed even if there are no unique releases.
2020-09-10 23:49:24 +02:00
americanpornstar.js
Changed next page determination to ensure --after is followed even if there are no unique releases.
2020-09-10 23:49:24 +02:00
assylum.js
Fixed predata parameter in Assylum scraper.
2020-09-17 14:49:45 +02:00
aziani.js
Fixed qu init selector. Fixed Aziani scene page scope.
2021-01-02 03:20:39 +01:00
babes.js
Updated profile scrapers to use base actor instead of actor name. Fixes for Reality Kings and Cherry Pimps scrapers.
2020-07-21 01:44:51 +02:00
bamvisions.js
Updated profile scrapers to use base actor instead of actor name. Fixes for Reality Kings and Cherry Pimps scrapers.
2020-07-21 01:44:51 +02:00
bang.js
Added support for upcoming scenes to Bang scraper.
2020-11-26 22:07:54 +01:00
bangbros.js
Removed direct bhttp usage from scrapers in favor of local http module. Deleted legacy scrapers, as old code is available via git repo history.
2020-11-23 00:05:02 +01:00
blowpass.js
Removed direct bhttp usage from scrapers in favor of local http module. Deleted legacy scrapers, as old code is available via git repo history.
2020-11-23 00:05:02 +01:00
boobpedia.js
Removed direct bhttp usage from scrapers in favor of local http module. Deleted legacy scrapers, as old code is available via git repo history.
2020-11-23 00:05:02 +01:00
brazzers-legacy.js
Moved Brazzers to MindGeek scraper to support new site.
2020-08-24 05:13:34 +02:00
burningangel.js
Switched to tabs. Adding missing actor entries when scraping actors, with batch ID.
2020-05-14 04:26:05 +02:00
cherrypimps.js
Scraping from Cherry Pimps when available. Showing cover in movie tile.
2020-08-02 03:44:14 +02:00
czechav.js
Fixed CzechAV to accomodate teasers instead of photos. Fixed error trying to flush non-existent media file.
2020-10-25 21:43:36 +01:00
ddfnetwork.js
Removed direct bhttp usage from scrapers in favor of local http module. Deleted legacy scrapers, as old code is available via git repo history.
2020-11-23 00:05:02 +01:00
digitalplayground.js
Updated profile scrapers to use base actor instead of actor name. Fixes for Reality Kings and Cherry Pimps scrapers.
2020-07-21 01:44:51 +02:00
dogfart.js
Fixed Nubiles base poster query, handling trailing commas in qu source set. Added profile scene scraper to Dogfart. Added tag photo.
2021-01-11 16:20:01 +01:00
dorcel.js
Using new HTTP module with a dynamic rate limiter.
2020-11-22 04:07:09 +01:00
elegantangel.js
Added CzechAV.
2020-09-14 00:53:41 +02:00
evilangel.js
Switched to tabs. Adding missing actor entries when scraping actors, with batch ID.
2020-05-14 04:26:05 +02:00
fakehub.js
Updated profile scrapers to use base actor instead of actor name. Fixes for Reality Kings and Cherry Pimps scrapers.
2020-07-21 01:44:51 +02:00
famedigital.js
Updated profile scrapers to use base actor instead of actor name. Fixes for Reality Kings and Cherry Pimps scrapers.
2020-07-21 01:44:51 +02:00
fantasymassage.js
Switched to tabs. Adding missing actor entries when scraping actors, with batch ID.
2020-05-14 04:26:05 +02:00
fcuk.js
Changed qu's HTML element detection. Passing base actor instead of actorName to profile scrapers.
2020-07-21 01:16:26 +02:00
firstanalquest.js
Removed console log.
2020-12-05 02:44:39 +01:00
freeones.js
Removed direct bhttp usage from scrapers in favor of local http module. Deleted legacy scrapers, as old code is available via git repo history.
2020-11-23 00:05:02 +01:00
fullpornnetwork.js
Updated profile scrapers to use base actor instead of actor name. Fixes for Reality Kings and Cherry Pimps scrapers.
2020-07-21 01:44:51 +02:00
gamma.js
Upgraded pg, knex and postgraphile. Updated nvmrc version to latest node LTS. Fixed Gamma scraper not passing request headers to new http module.
2020-12-14 03:16:47 +01:00
girlsway.js
Switched to tabs. Adding missing actor entries when scraping actors, with batch ID.
2020-05-14 04:26:05 +02:00
hitzefrei.js
Using new HTTP module with a dynamic rate limiter.
2020-11-22 04:07:09 +01:00
hookuphotshot.js
Replaced queueMethod in media sources for new interval/concurrency options.
2020-11-23 00:38:22 +01:00
hush.js
Fixed trailer path regex for some Hush sites.
2020-12-19 02:35:41 +01:00
iconmale.js
Updated profile scrapers to use base actor instead of actor name. Fixes for Reality Kings and Cherry Pimps scrapers.
2020-07-21 01:44:51 +02:00
insex.js
Using new HTTP module with a dynamic rate limiter.
2020-11-22 04:07:09 +01:00
inthecrack.js
Added upcoming, profile and detailed scene actor scraping to InTheCrack. Fixed clip upsert.
2020-08-20 23:35:18 +02:00
jayrock.js
Using new HTTP module with a dynamic rate limiter.
2020-11-22 04:07:09 +01:00
jesseloadsmonsterfacials.js
Removed 'null' from scene tile URL if no slug is available.
2020-10-30 17:51:47 +01:00
julesjordan.js
Removed direct bhttp usage from scrapers in favor of local http module. Deleted legacy scrapers, as old code is available via git repo history.
2020-11-23 00:05:02 +01:00
karups.js
Added default deep scrape fetch method. Added Karups scene and profile scraper. Added schoolgirl tag photo.
2021-01-13 21:29:05 +01:00
kellymadison.js
Fixed Kelly Madison title regex.
2020-12-29 18:53:55 +01:00
killergram.js
Updated profile scrapers to use base actor instead of actor name. Fixes for Reality Kings and Cherry Pimps scrapers.
2020-07-21 01:44:51 +02:00
kink.js
Added tag filter dialog.
2021-01-03 22:53:51 +01:00
legalporno.js
(Temporarily) removed studio filter from entity query for performance reasons.
2020-09-18 22:43:45 +02:00
littlecapricedreams.js
Added fixed actor age. Added male profiles to Littlr Caprice Dreams scraper. Added various tag photos.
2020-11-29 03:59:47 +01:00
men.js
Updated profile scrapers to use base actor instead of actor name. Fixes for Reality Kings and Cherry Pimps scrapers.
2020-07-21 01:44:51 +02:00
metrohd.js
Updated profile scrapers to use base actor instead of actor name. Fixes for Reality Kings and Cherry Pimps scrapers.
2020-07-21 01:44:51 +02:00
mikeadriano.js
Restored Mike Adriano scraper.
2020-12-29 02:05:22 +01:00
milehighmedia.js
Updated profile scrapers to use base actor instead of actor name. Fixes for Reality Kings and Cherry Pimps scrapers.
2020-07-21 01:44:51 +02:00
mindgeek.js
Removed redundant sitename from MindGeek session error.
2021-01-05 16:35:49 +01:00
mofos.js
Updated profile scrapers to use base actor instead of actor name. Fixes for Reality Kings and Cherry Pimps scrapers.
2020-07-21 01:44:51 +02:00
naughtyamerica.js
Using new HTTP module with a dynamic rate limiter.
2020-11-22 04:07:09 +01:00
newsensations.js
Switched to tabs. Adding missing actor entries when scraping actors, with batch ID.
2020-05-14 04:26:05 +02:00
nubiles.js
Using date and title for Nubiles entry ID.
2021-01-11 23:31:33 +01:00
pascalssubsluts.js
Fixed Pascals Sub Sluts interpreting metric as imperial height, filtering unlikely in interpolation. Splitting double actor entries in Top Web Models.
2021-01-15 16:14:48 +01:00
perfectgonzo.js
Removed direct bhttp usage from scrapers in favor of local http module. Deleted legacy scrapers, as old code is available via git repo history.
2020-11-23 00:05:02 +01:00
pervcity.js
Fixed scene media lazy image. Fixed Perv City actor scope.
2021-01-01 04:28:10 +01:00
pinkyxxx.js
Using poster photo for Pinky XXX.
2021-01-13 01:10:29 +01:00
porncz.js
Fixed PornCZ scene photos attribute.
2020-11-22 04:13:21 +01:00
porndoe.js
Fixed Porn Doe's poster query. Checking style attribute existence in qu before attempting to use it.
2020-09-17 00:35:41 +02:00
pornhub.js
Removed direct bhttp usage from scrapers in favor of local http module. Deleted legacy scrapers, as old code is available via git repo history.
2020-11-23 00:05:02 +01:00
private.js
Removed direct bhttp usage from scrapers in favor of local http module. Deleted legacy scrapers, as old code is available via git repo history.
2020-11-23 00:05:02 +01:00
puretaboo.js
Switched to tabs. Adding missing actor entries when scraping actors, with batch ID.
2020-05-14 04:26:05 +02:00
realitykings.js
Removed direct bhttp usage from scrapers in favor of local http module. Deleted legacy scrapers, as old code is available via git repo history.
2020-11-23 00:05:02 +01:00
score.js
Removed direct bhttp usage from scrapers in favor of local http module. Deleted legacy scrapers, as old code is available via git repo history.
2020-11-23 00:05:02 +01:00
scrapers.js
Added Top Web Models profile scraper.
2021-01-16 04:10:43 +01:00
teamskeet.js
Improved Team Skeet profile scraper.
2020-07-23 21:00:16 +02:00
teencoreclub.js
Using new HTTP module with a dynamic rate limiter.
2020-11-22 04:07:09 +01:00
template.js
Updated profile scrapers to use base actor instead of actor name. Fixes for Reality Kings and Cherry Pimps scrapers.
2020-07-21 01:44:51 +02:00
topwebmodels.js
Added Top Web Models profile scraper.
2021-01-16 04:10:43 +01:00
transangels.js
Updated profile scrapers to use base actor instead of actor name. Fixes for Reality Kings and Cherry Pimps scrapers.
2020-07-21 01:44:51 +02:00
traxxx.js
Replaced bhttp with patched fork. Improved Jesse Loads Monster Facials scraper reliability (WIP). Added various tag photos.
2020-10-30 17:37:10 +01:00
twistys.js
Updated profile scrapers to use base actor instead of actor name. Fixes for Reality Kings and Cherry Pimps scrapers.
2020-07-21 01:44:51 +02:00
vivid.js
Removed direct bhttp usage from scrapers in favor of local http module. Deleted legacy scrapers, as old code is available via git repo history.
2020-11-23 00:05:02 +01:00
vixen.js
Ignoring non-scene page (possible CF or similar protection) in Vixen scraper.
2020-11-26 03:27:21 +01:00
vogov.js
Removed direct bhttp usage from scrapers in favor of local http module. Deleted legacy scrapers, as old code is available via git repo history.
2020-11-23 00:05:02 +01:00
whalemember.js
Replaced queueMethod in media sources for new interval/concurrency options.
2020-11-23 00:38:22 +01:00
wicked.js
Switched to tabs. Adding missing actor entries when scraping actors, with batch ID.
2020-05-14 04:26:05 +02:00
xempire.js
Removed direct bhttp usage from scrapers in favor of local http module. Deleted legacy scrapers, as old code is available via git repo history.
2020-11-23 00:05:02 +01:00
zerotolerance.js
Added Zero Tolerance with Addicted 2 Girls and GenderX.
2020-09-04 03:07:28 +02:00