DebaucheryLibrarian/traxxx
2
1
Fork 1
Code Issues 39 Pull Requests 1 Releases Wiki Activity
Files
be4d0255051e94b2fedc1a2be80165ab23dca605
traxxx/src/scrapers
History
DebaucheryLibrarian be4d025505 Fixed trailer path regex for some Hush sites.
2020-12-19 02:35:41 +01:00
..
21naturals.js
Switched to tabs. Adding missing actor entries when scraping actors, with batch ID.
2020-05-14 04:26:05 +02:00
21sextreme.js
Switched to tabs. Adding missing actor entries when scraping actors, with batch ID.
2020-05-14 04:26:05 +02:00
21sextury.js
Switched to tabs. Adding missing actor entries when scraping actors, with batch ID.
2020-05-14 04:26:05 +02:00
adulttime.js
Switched to tabs. Adding missing actor entries when scraping actors, with batch ID.
2020-05-14 04:26:05 +02:00
amateurallure.js
Changed next page determination to ensure --after is followed even if there are no unique releases.
2020-09-10 23:49:24 +02:00
americanpornstar.js
Changed next page determination to ensure --after is followed even if there are no unique releases.
2020-09-10 23:49:24 +02:00
assylum.js
Fixed predata parameter in Assylum scraper.
2020-09-17 14:49:45 +02:00
aziani.js
Updated profile scrapers to use base actor instead of actor name. Fixes for Reality Kings and Cherry Pimps scrapers.
2020-07-21 01:44:51 +02:00
babes.js
Updated profile scrapers to use base actor instead of actor name. Fixes for Reality Kings and Cherry Pimps scrapers.
2020-07-21 01:44:51 +02:00
bamvisions.js
Updated profile scrapers to use base actor instead of actor name. Fixes for Reality Kings and Cherry Pimps scrapers.
2020-07-21 01:44:51 +02:00
bang.js
Added support for upcoming scenes to Bang scraper.
2020-11-26 22:07:54 +01:00
bangbros.js
Removed direct bhttp usage from scrapers in favor of local http module. Deleted legacy scrapers, as old code is available via git repo history.
2020-11-23 00:05:02 +01:00
blowpass.js
Removed direct bhttp usage from scrapers in favor of local http module. Deleted legacy scrapers, as old code is available via git repo history.
2020-11-23 00:05:02 +01:00
boobpedia.js
Removed direct bhttp usage from scrapers in favor of local http module. Deleted legacy scrapers, as old code is available via git repo history.
2020-11-23 00:05:02 +01:00
brazzers-legacy.js
Moved Brazzers to MindGeek scraper to support new site.
2020-08-24 05:13:34 +02:00
burningangel.js
Switched to tabs. Adding missing actor entries when scraping actors, with batch ID.
2020-05-14 04:26:05 +02:00
cherrypimps.js
Scraping from Cherry Pimps when available. Showing cover in movie tile.
2020-08-02 03:44:14 +02:00
czechav.js
Fixed CzechAV to accomodate teasers instead of photos. Fixed error trying to flush non-existent media file.
2020-10-25 21:43:36 +01:00
ddfnetwork.js
Removed direct bhttp usage from scrapers in favor of local http module. Deleted legacy scrapers, as old code is available via git repo history.
2020-11-23 00:05:02 +01:00
digitalplayground.js
Updated profile scrapers to use base actor instead of actor name. Fixes for Reality Kings and Cherry Pimps scrapers.
2020-07-21 01:44:51 +02:00
dogfart.js
Removed direct bhttp usage from scrapers in favor of local http module. Deleted legacy scrapers, as old code is available via git repo history.
2020-11-23 00:05:02 +01:00
dorcel.js
Using new HTTP module with a dynamic rate limiter.
2020-11-22 04:07:09 +01:00
elegantangel.js
Added CzechAV.
2020-09-14 00:53:41 +02:00
evilangel.js
Switched to tabs. Adding missing actor entries when scraping actors, with batch ID.
2020-05-14 04:26:05 +02:00
fakehub.js
Updated profile scrapers to use base actor instead of actor name. Fixes for Reality Kings and Cherry Pimps scrapers.
2020-07-21 01:44:51 +02:00
famedigital.js
Updated profile scrapers to use base actor instead of actor name. Fixes for Reality Kings and Cherry Pimps scrapers.
2020-07-21 01:44:51 +02:00
fantasymassage.js
Switched to tabs. Adding missing actor entries when scraping actors, with batch ID.
2020-05-14 04:26:05 +02:00
fcuk.js
Changed qu's HTML element detection. Passing base actor instead of actorName to profile scrapers.
2020-07-21 01:16:26 +02:00
firstanalquest.js
Removed console log.
2020-12-05 02:44:39 +01:00
freeones.js
Removed direct bhttp usage from scrapers in favor of local http module. Deleted legacy scrapers, as old code is available via git repo history.
2020-11-23 00:05:02 +01:00
fullpornnetwork.js
Updated profile scrapers to use base actor instead of actor name. Fixes for Reality Kings and Cherry Pimps scrapers.
2020-07-21 01:44:51 +02:00
gamma.js
Upgraded pg, knex and postgraphile. Updated nvmrc version to latest node LTS. Fixed Gamma scraper not passing request headers to new http module.
2020-12-14 03:16:47 +01:00
girlsway.js
Switched to tabs. Adding missing actor entries when scraping actors, with batch ID.
2020-05-14 04:26:05 +02:00
hitzefrei.js
Using new HTTP module with a dynamic rate limiter.
2020-11-22 04:07:09 +01:00
hookuphotshot.js
Replaced queueMethod in media sources for new interval/concurrency options.
2020-11-23 00:38:22 +01:00
hush.js
Fixed trailer path regex for some Hush sites.
2020-12-19 02:35:41 +01:00
iconmale.js
Updated profile scrapers to use base actor instead of actor name. Fixes for Reality Kings and Cherry Pimps scrapers.
2020-07-21 01:44:51 +02:00
insex.js
Using new HTTP module with a dynamic rate limiter.
2020-11-22 04:07:09 +01:00
inthecrack.js
Added upcoming, profile and detailed scene actor scraping to InTheCrack. Fixed clip upsert.
2020-08-20 23:35:18 +02:00
jayrock.js
Using new HTTP module with a dynamic rate limiter.
2020-11-22 04:07:09 +01:00
jesseloadsmonsterfacials.js
Removed 'null' from scene tile URL if no slug is available.
2020-10-30 17:51:47 +01:00
julesjordan.js
Removed direct bhttp usage from scrapers in favor of local http module. Deleted legacy scrapers, as old code is available via git repo history.
2020-11-23 00:05:02 +01:00
kellymadison.js
Fixed various Kelly Madison scraper issues.
2020-12-17 02:05:01 +01:00
killergram.js
Updated profile scrapers to use base actor instead of actor name. Fixes for Reality Kings and Cherry Pimps scrapers.
2020-07-21 01:44:51 +02:00
kink.js
Handling missing trailers in Kink scraper.
2020-09-18 23:25:15 +02:00
legalporno.js
(Temporarily) removed studio filter from entity query for performance reasons.
2020-09-18 22:43:45 +02:00
littlecapricedreams.js
Added fixed actor age. Added male profiles to Littlr Caprice Dreams scraper. Added various tag photos.
2020-11-29 03:59:47 +01:00
men.js
Updated profile scrapers to use base actor instead of actor name. Fixes for Reality Kings and Cherry Pimps scrapers.
2020-07-21 01:44:51 +02:00
metrohd.js
Updated profile scrapers to use base actor instead of actor name. Fixes for Reality Kings and Cherry Pimps scrapers.
2020-07-21 01:44:51 +02:00
mikeadriano.js
Removed direct bhttp usage from scrapers in favor of local http module. Deleted legacy scrapers, as old code is available via git repo history.
2020-11-23 00:05:02 +01:00
milehighmedia.js
Updated profile scrapers to use base actor instead of actor name. Fixes for Reality Kings and Cherry Pimps scrapers.
2020-07-21 01:44:51 +02:00
mindgeek.js
Removed direct bhttp usage from scrapers in favor of local http module. Deleted legacy scrapers, as old code is available via git repo history.
2020-11-23 00:05:02 +01:00
mofos.js
Updated profile scrapers to use base actor instead of actor name. Fixes for Reality Kings and Cherry Pimps scrapers.
2020-07-21 01:44:51 +02:00
naughtyamerica.js
Using new HTTP module with a dynamic rate limiter.
2020-11-22 04:07:09 +01:00
newsensations.js
Switched to tabs. Adding missing actor entries when scraping actors, with batch ID.
2020-05-14 04:26:05 +02:00
nubiles.js
Updated profile scrapers to use base actor instead of actor name. Fixes for Reality Kings and Cherry Pimps scrapers.
2020-07-21 01:44:51 +02:00
pascalssubsluts.js
Added Dorcel Club with scene and actor scraping. Added count method to qu.
2020-09-16 04:55:30 +02:00
perfectgonzo.js
Removed direct bhttp usage from scrapers in favor of local http module. Deleted legacy scrapers, as old code is available via git repo history.
2020-11-23 00:05:02 +01:00
pervcity.js
Updated profile scrapers to use base actor instead of actor name. Fixes for Reality Kings and Cherry Pimps scrapers.
2020-07-21 01:44:51 +02:00
porncz.js
Fixed PornCZ scene photos attribute.
2020-11-22 04:13:21 +01:00
porndoe.js
Fixed Porn Doe's poster query. Checking style attribute existence in qu before attempting to use it.
2020-09-17 00:35:41 +02:00
pornhub.js
Removed direct bhttp usage from scrapers in favor of local http module. Deleted legacy scrapers, as old code is available via git repo history.
2020-11-23 00:05:02 +01:00
private.js
Removed direct bhttp usage from scrapers in favor of local http module. Deleted legacy scrapers, as old code is available via git repo history.
2020-11-23 00:05:02 +01:00
puretaboo.js
Switched to tabs. Adding missing actor entries when scraping actors, with batch ID.
2020-05-14 04:26:05 +02:00
realitykings.js
Removed direct bhttp usage from scrapers in favor of local http module. Deleted legacy scrapers, as old code is available via git repo history.
2020-11-23 00:05:02 +01:00
score.js
Removed direct bhttp usage from scrapers in favor of local http module. Deleted legacy scrapers, as old code is available via git repo history.
2020-11-23 00:05:02 +01:00
scrapers.js
Fixed missing initial value in scraper reduce, breaking first network (21 Naturals).
2020-12-19 00:19:38 +01:00
teamskeet.js
Improved Team Skeet profile scraper.
2020-07-23 21:00:16 +02:00
teencoreclub.js
Using new HTTP module with a dynamic rate limiter.
2020-11-22 04:07:09 +01:00
template.js
Updated profile scrapers to use base actor instead of actor name. Fixes for Reality Kings and Cherry Pimps scrapers.
2020-07-21 01:44:51 +02:00
transangels.js
Updated profile scrapers to use base actor instead of actor name. Fixes for Reality Kings and Cherry Pimps scrapers.
2020-07-21 01:44:51 +02:00
traxxx.js
Replaced bhttp with patched fork. Improved Jesse Loads Monster Facials scraper reliability (WIP). Added various tag photos.
2020-10-30 17:37:10 +01:00
twistys.js
Updated profile scrapers to use base actor instead of actor name. Fixes for Reality Kings and Cherry Pimps scrapers.
2020-07-21 01:44:51 +02:00
vivid.js
Removed direct bhttp usage from scrapers in favor of local http module. Deleted legacy scrapers, as old code is available via git repo history.
2020-11-23 00:05:02 +01:00
vixen.js
Ignoring non-scene page (possible CF or similar protection) in Vixen scraper.
2020-11-26 03:27:21 +01:00
vogov.js
Removed direct bhttp usage from scrapers in favor of local http module. Deleted legacy scrapers, as old code is available via git repo history.
2020-11-23 00:05:02 +01:00
whalemember.js
Replaced queueMethod in media sources for new interval/concurrency options.
2020-11-23 00:38:22 +01:00
wicked.js
Switched to tabs. Adding missing actor entries when scraping actors, with batch ID.
2020-05-14 04:26:05 +02:00
xempire.js
Removed direct bhttp usage from scrapers in favor of local http module. Deleted legacy scrapers, as old code is available via git repo history.
2020-11-23 00:05:02 +01:00
zerotolerance.js
Added Zero Tolerance with Addicted 2 Girls and GenderX.
2020-09-04 03:07:28 +02:00