DebaucheryLibrarian
|
0633197793
|
Removed direct bhttp usage from scrapers in favor of local http module. Deleted legacy scrapers, as old code is available via git repo history.
|
2020-11-23 00:05:02 +01:00 |
|
DebaucheryLibrarian
|
39f8c037a5
|
Replaced bhttp with patched fork. Improved Jesse Loads Monster Facials scraper reliability (WIP). Added various tag photos.
|
2020-10-30 17:37:10 +01:00 |
|
DebaucheryLibrarian
|
dff4d15872
|
Updated profile scrapers to use base actor instead of actor name. Fixes for Reality Kings and Cherry Pimps scrapers.
|
2020-07-21 01:44:51 +02:00 |
|
|
|
885aa4f627
|
Passing context object with site or network instead of scraper slug and 'site or network' to all profile scrapers.
|
2020-05-18 03:22:03 +02:00 |
|
|
|
11eb66f834
|
Switched to tabs. Adding missing actor entries when scraping actors, with batch ID.
|
2020-05-14 04:26:05 +02:00 |
|
|
|
370605554b
|
Added profile scraper with scenes to BAM Visions. Passing 'includes' object instead of withReleases boolean to Gamma.
|
2020-03-12 02:19:45 +01:00 |
|
|
|
ea9c2dfe67
|
Scraping all actor release pages for Gamma. Improved actor matching for Gamma API.
|
2020-02-07 01:48:21 +01:00 |
|
|
|
6e1de52a40
|
Added Fame Digital. Added actor release scraping to DDF Network. Improved q and Gamma scraper.
|
2020-02-06 23:15:28 +01:00 |
|
|
|
94bf207397
|
Added Wicked network. Merged Evil Angel, XEmpire and Wicked into generic Gamma scraper.
|
2020-02-01 01:15:40 +01:00 |
|
|
|
c300d4d251
|
Added trailer support to Vogov. Set preferred trailer resolution to 480p. Added 480p and other resolution trailers support to XEmpire.
|
2020-01-30 03:53:54 +01:00 |
|
|
|
c93116dee2
|
Added actor expand button to profile.
|
2020-01-24 23:36:06 +01:00 |
|
|
|
f8175f6054
|
Added generic Gamma photo and actor scraper for XEmpire, 21Sextury, Blowpass and Evil Angel.
|
2020-01-22 22:25:58 +01:00 |
|
|
|
a310f9bb1d
|
Added support for release photo fallbacks. Limited photo fetching concurrency. Modifier XEmpire scraper for AllBlackX support and improved photo scraping. Added movie property to Evil Angel scraper.
|
2019-12-12 03:12:05 +01:00 |
|
|
|
04a89efa58
|
Refactored 21sextury scraper.
|
2019-12-09 05:00:49 +01:00 |
|
|
|
bead69de49
|
Added basic actor and network overview. Added DDF Network actor scraper. Various bug fixes and layout improvements.
|
2019-11-30 05:55:32 +01:00 |
|
|
|
d113123778
|
Fixed countries seed file. Updated MOFOS scraper. Improved Reality Kings scraper. Limiting photos for XEmpire scraper.
|
2019-11-27 04:58:38 +01:00 |
|
|
|
b489c8fc33
|
Major refactor, cleand up site scrape module, fixed and cleaned up release scrape module. Removed old CLI code
|
2019-11-16 03:33:36 +01:00 |
|
|
|
f9f9cc7977
|
Added tag filter to releases query, enabled on homepage.
|
2019-11-13 03:14:24 +01:00 |
|
|
|
832e96ced1
|
Improved site and network pages. Fixed various issues.
|
2019-11-12 01:22:20 +01:00 |
|
|
|
5745cd33d8
|
Added Dogfart scraper. Added 'date added' property to release page.
|
2019-11-04 05:47:37 +01:00 |
|
|
|
d5073a73ce
|
Added media support to XEmpire (HardX) scraper.
|
2019-10-29 03:13:56 +01:00 |
|
|
|
298eabe56e
|
Improved Vixen and XEmpire scrapers. Added media to Blowpass scraper. Improved release fetch code.
|
2019-09-26 03:27:01 +02:00 |
|
|
|
05263a97ea
|
Scrolling content container instead of whole page. Improved title source in XEmpire scraper. Fixed scene page breaking when no photos are available.
|
2019-09-25 01:38:06 +02:00 |
|
|
|
d526e4daea
|
Added Reality Kings scraper. Improved site finder.
|
2019-04-08 01:49:45 +02:00 |
|
|
|
ec056a177a
|
Added 21Sextury scraper. Various improvements.
|
2019-04-07 20:51:14 +02:00 |
|
|
|
2b818e379a
|
Scrapers can now iterate through pages. Filtering unique releases before saving to database. Improved scrapers and rendering.
|
2019-04-05 03:45:40 +02:00 |
|
|
|
b3beeef3e4
|
Added Private scraper. Added Vixen scraper to repository.
|
2019-04-04 04:00:28 +02:00 |
|
|
|
8421cd8648
|
Added parameters column to sites database, fixes Perv City scraper. Getting shoot ID from all existing scrapers.
|
2019-03-26 01:26:47 +01:00 |
|
|
|
4d7f323e86
|
Replaced network and tag files with SQLite database.
|
2019-03-25 03:57:33 +01:00 |
|
|
|
845f46e9ad
|
Added Kink scraper with elaborate site specification.
|
2019-03-24 05:28:18 +01:00 |
|
|
|
4fcabb4aae
|
Added tags and duration to scraping. Added LegalPorno scraper.
|
2019-03-24 01:29:22 +01:00 |
|
|
|
e8d4b76403
|
Improved module structure. Added individual scene scrapers for Jules Jordan and XEmpire.
|
2019-03-23 22:48:39 +01:00 |
|
|
|
1a170bfbd5
|
Added Jules Jordan scraper. Added render argument to stop going into ncurses mode during dev.
|
2019-03-18 04:46:53 +01:00 |
|
|
|
02c421b737
|
Displaying results in terminal table with select, scroll and experimental search. Expanded broken character handling for PervCity scraper.
|
2019-03-11 04:19:36 +01:00 |
|
|
|
af9565b296
|
Completed Perv City scraper. Outputting results as list.
|
2019-03-04 04:19:03 +01:00 |
|
|
|
53ea694894
|
Added include and exclude config options. Moved network definitions to dedicated file. Scraping all XEmpire sites. Added definitions for Perv City.
|
2019-03-04 02:46:33 +01:00 |
|
