Commit Graph

211 Commits

Author SHA1 Message Date
3ec7b15886 Improved scraping and association behavior. 2019-11-19 04:36:15 +01:00
e8130c3634 Scraping actor profiles from FreeOnes. 2019-11-17 03:56:45 +01:00
bd041c528d Fixed ID number/string incompatability in duplicate detection. Expanded Reality Kings scraper to handle older scenes and fix URLs. 2019-11-17 00:45:31 +01:00
2857387441 Added bash CLI shorthand. Properly setting parameters in site results. Removed obsolete URL restriction from Reality Kings scraper. 2019-11-16 23:37:33 +01:00
b489c8fc33 Major refactor, cleand up site scrape module, fixed and cleaned up release scrape module. Removed old CLI code 2019-11-16 03:33:36 +01:00
5620dfcb65 Added filter bar to all pages. Added 'upcoming' marker. Improved date tidbit. 2019-11-15 05:10:59 +01:00
bf223adc55 Redesigned release page. Added 'single site' marker, linking directly to network page. Fixed Dogfart scraper duration. 2019-11-14 05:13:38 +01:00
117d669a69 Added Private Black, improved Private scraper to handle their non-private.com sites. 2019-11-14 00:00:29 +01:00
f9f9cc7977 Added tag filter to releases query, enabled on homepage. 2019-11-13 03:14:24 +01:00
832e96ced1 Improved site and network pages. Fixed various issues. 2019-11-12 01:22:20 +01:00
681f1bca85 Added tag page. Added default 'anal' tag to Vixen scraper for Tushy and Tushy Raw. 2019-11-11 05:18:28 +01:00
e9277028e2 Added Mike Adriano scraper (True Anal, All Anal, Swallowed, Nympho). Updated README. 2019-11-09 01:22:50 +01:00
f8f6428e36 Added media support to Private scraper. 2019-11-05 01:41:13 +01:00
c466d791f5 Removed upsert from store releases, observing effects; fixes ? inserted as . Removed query from stored Dogfart URLs. 2019-11-05 00:54:47 +01:00
e4399380d3 Fixed photo plucker to prevent duplicate at end. 2019-11-04 06:04:43 +01:00
5745cd33d8 Added Dogfart scraper. Added 'date added' property to release page. 2019-11-04 05:47:37 +01:00
2198c7ceb0 Added media support to Bang Bros scraper. Added untracked files. 2019-10-31 01:53:26 +01:00
382e40b651 Added studio support. Added studios for LegalPorno. Improved media fetch error handling. Fixed DDFNetwork scraper, added media support. 2019-10-30 04:45:42 +01:00
ffe2564bb3 Added full photo album to Jules Jordan scraper. 2019-10-29 04:49:27 +01:00
eb50af7b81 Added media support to Brazzers scraper. 2019-10-29 03:50:39 +01:00
d5073a73ce Added media support to XEmpire (HardX) scraper. 2019-10-29 03:13:56 +01:00
a4d936523b Added media to LegalPorno scraper. 2019-10-29 01:47:16 +01:00
f7f5e8a306 Deriving transsexual tag from actors in Evil Angel scraper. 2019-10-28 02:12:11 +01:00
2c32ed6549 Completed Evil Angel scraper. Added trans tags. 2019-09-28 03:26:04 +02:00
298eabe56e Improved Vixen and XEmpire scrapers. Added media to Blowpass scraper. Improved release fetch code. 2019-09-26 03:27:01 +02:00
96d8cfbcb6 Improved media handling, added trailer support. Fetching media from Vixen network frontpages. 2019-09-25 04:52:58 +02:00
b12d74cbb3 Fixed Vixen scraper, site restructured. Added Deeper to Vixen network. 2019-09-25 02:44:25 +02:00
c78f7f957f Merge branch 'master' of unknown.name:pendulum/traxxx 2019-09-25 01:38:21 +02:00
05263a97ea Scrolling content container instead of whole page. Improved title source in XEmpire scraper. Fixed scene page breaking when no photos are available. 2019-09-25 01:38:06 +02:00
a9f64a82a2 Legalporno title scene ID fix
Old regex would fail on some videos
e.g.
Little Sofi Smile plays with two big cocks AF001
Whitney Wright Gets Punished by Two Big Black Cocks AB015
2019-09-23 18:32:47 +02:00
cf4987ba48 Using media database for images. 2019-09-10 16:48:04 +02:00
926c227b85 Refactored database to separate IDs from slugs 2019-09-08 03:53:09 +02:00
f2a6b58370 Added release page with photo viewer. Added photo count to database. Improved styling. 2019-07-06 05:29:12 +02:00
e3558fc0c5 Using grid layout with thumbnails. 2019-05-08 05:50:13 +02:00
3df5a821b6 Saving results to database. Showing webpage. 2019-05-06 02:01:57 +02:00
b486b6abdd Added Bang Bros scraper. 2019-04-12 03:12:53 +02:00
82419be402 Changed scene fetch title source for BlowPass scraper. 2019-04-10 04:44:36 +02:00
7dd2432837 Changed title source for 21Sextury scene fetch, 2019-04-10 03:57:34 +02:00
bc01cbe6dc Added Bang Bros data (no scraper yet). Added 21Sextury scene fetch date fallback. 2019-04-10 03:42:20 +02:00
763ffb341a Added Naughty America scraper. 2019-04-08 03:07:16 +02:00
d526e4daea Added Reality Kings scraper. Improved site finder. 2019-04-08 01:49:45 +02:00
ec056a177a Added 21Sextury scraper. Various improvements. 2019-04-07 20:51:14 +02:00
d5b9fec0db Added duration property to scraper template. 2019-04-07 05:21:27 +02:00
6b9d99f495 Added description property to recent scrapers (apparently forgotten). Reconfigured eslint for scrapers. 2019-04-07 05:19:44 +02:00
c8abb302e4 Added DDFNetwork scraper. Modified tag matching query to be case insensitive. 2019-04-07 05:01:06 +02:00
885a815022 Added tag groups. Added MOFOS scraped. Improved entry ID handling. 2019-04-07 02:15:57 +02:00
3a90f98d41 Added Blowpass scraper. Split shootId and pageId. 2019-04-06 23:24:26 +02:00
2b818e379a Scrapers can now iterate through pages. Filtering unique releases before saving to database. Improved scrapers and rendering. 2019-04-05 03:45:40 +02:00
6190247ac5 Added Brazzers scraper. Removed scene-only sites in database in favor of automatic network fallback. 2019-04-04 20:22:47 +02:00
b3beeef3e4 Added Private scraper. Added Vixen scraper to repository. 2019-04-04 04:00:28 +02:00