Commit Graph
263 Commits
Author SHA1 Message Date
pendulum 9224b441e2 Added Brazzers and Jules Jordan as profile sources. Changed profile structure for proper bust-waist-hip properties and improved stability. 2019-11-21 04:05:32 +01:00
pendulum 9fcc40dd17 Added avatars. Added PornHub and LegalPorno actor profile scrapers. 2019-11-20 04:53:36 +01:00
pendulum 3ec7b15886 Improved scraping and association behavior. 2019-11-19 04:36:15 +01:00
pendulum e8130c3634 Scraping actor profiles from FreeOnes. 2019-11-17 03:56:45 +01:00
pendulum bd041c528d Fixed ID number/string incompatability in duplicate detection. Expanded Reality Kings scraper to handle older scenes and fix URLs. 2019-11-17 00:45:31 +01:00
pendulum 2857387441 Added bash CLI shorthand. Properly setting parameters in site results. Removed obsolete URL restriction from Reality Kings scraper. 2019-11-16 23:37:33 +01:00
pendulum b489c8fc33 Major refactor, cleand up site scrape module, fixed and cleaned up release scrape module. Removed old CLI code 2019-11-16 03:33:36 +01:00
pendulum 5620dfcb65 Added filter bar to all pages. Added 'upcoming' marker. Improved date tidbit. 2019-11-15 05:10:59 +01:00
pendulum bf223adc55 Redesigned release page. Added 'single site' marker, linking directly to network page. Fixed Dogfart scraper duration. 2019-11-14 05:13:38 +01:00
pendulum 117d669a69 Added Private Black, improved Private scraper to handle their non-private.com sites. 2019-11-14 00:00:29 +01:00
pendulum f9f9cc7977 Added tag filter to releases query, enabled on homepage. 2019-11-13 03:14:24 +01:00
pendulum 832e96ced1 Improved site and network pages. Fixed various issues. 2019-11-12 01:22:20 +01:00
pendulum 681f1bca85 Added tag page. Added default 'anal' tag to Vixen scraper for Tushy and Tushy Raw. 2019-11-11 05:18:28 +01:00
pendulum e9277028e2 Added Mike Adriano scraper (True Anal, All Anal, Swallowed, Nympho). Updated README. 2019-11-09 01:22:50 +01:00
pendulum f8f6428e36 Added media support to Private scraper. 2019-11-05 01:41:13 +01:00
pendulum c466d791f5 Removed upsert from store releases, observing effects; fixes ? inserted as . Removed query from stored Dogfart URLs. 2019-11-05 00:54:47 +01:00
pendulum e4399380d3 Fixed photo plucker to prevent duplicate at end. 2019-11-04 06:04:43 +01:00
pendulum 5745cd33d8 Added Dogfart scraper. Added 'date added' property to release page. 2019-11-04 05:47:37 +01:00
pendulum 2198c7ceb0 Added media support to Bang Bros scraper. Added untracked files. 2019-10-31 01:53:26 +01:00
pendulum 382e40b651 Added studio support. Added studios for LegalPorno. Improved media fetch error handling. Fixed DDFNetwork scraper, added media support. 2019-10-30 04:45:42 +01:00
pendulum ffe2564bb3 Added full photo album to Jules Jordan scraper. 2019-10-29 04:49:27 +01:00
pendulum eb50af7b81 Added media support to Brazzers scraper. 2019-10-29 03:50:39 +01:00
pendulum d5073a73ce Added media support to XEmpire (HardX) scraper. 2019-10-29 03:13:56 +01:00
pendulum a4d936523b Added media to LegalPorno scraper. 2019-10-29 01:47:16 +01:00
pendulum f7f5e8a306 Deriving transsexual tag from actors in Evil Angel scraper. 2019-10-28 02:12:11 +01:00
pendulum 2c32ed6549 Completed Evil Angel scraper. Added trans tags. 2019-09-28 03:26:04 +02:00
pendulum 298eabe56e Improved Vixen and XEmpire scrapers. Added media to Blowpass scraper. Improved release fetch code. 2019-09-26 03:27:01 +02:00
pendulum 96d8cfbcb6 Improved media handling, added trailer support. Fetching media from Vixen network frontpages. 2019-09-25 04:52:58 +02:00
pendulum b12d74cbb3 Fixed Vixen scraper, site restructured. Added Deeper to Vixen network. 2019-09-25 02:44:25 +02:00
pendulum c78f7f957f Merge branch 'master' of unknown.name:pendulum/traxxx 2019-09-25 01:38:21 +02:00
pendulum 05263a97ea Scrolling content container instead of whole page. Improved title source in XEmpire scraper. Fixed scene page breaking when no photos are available. 2019-09-25 01:38:06 +02:00
boiii a9f64a82a2 Legalporno title scene ID fix
Old regex would fail on some videos
e.g.
Little Sofi Smile plays with two big cocks AF001
Whitney Wright Gets Punished by Two Big Black Cocks AB015
2019-09-23 18:32:47 +02:00
pendulum cf4987ba48 Using media database for images. 2019-09-10 16:48:04 +02:00
pendulum 926c227b85 Refactored database to separate IDs from slugs 2019-09-08 03:53:09 +02:00
pendulum f2a6b58370 Added release page with photo viewer. Added photo count to database. Improved styling. 2019-07-06 05:29:12 +02:00
pendulum e3558fc0c5 Using grid layout with thumbnails. 2019-05-08 05:50:13 +02:00
pendulum 3df5a821b6 Saving results to database. Showing webpage. 2019-05-06 02:01:57 +02:00
pendulum b486b6abdd Added Bang Bros scraper. 2019-04-12 03:12:53 +02:00
pendulum 82419be402 Changed scene fetch title source for BlowPass scraper. 2019-04-10 04:44:36 +02:00
pendulum 7dd2432837 Changed title source for 21Sextury scene fetch, 2019-04-10 03:57:34 +02:00
pendulum bc01cbe6dc Added Bang Bros data (no scraper yet). Added 21Sextury scene fetch date fallback. 2019-04-10 03:42:20 +02:00
pendulum 763ffb341a Added Naughty America scraper. 2019-04-08 03:07:16 +02:00
pendulum d526e4daea Added Reality Kings scraper. Improved site finder. 2019-04-08 01:49:45 +02:00
pendulum ec056a177a Added 21Sextury scraper. Various improvements. 2019-04-07 20:51:14 +02:00
pendulum d5b9fec0db Added duration property to scraper template. 2019-04-07 05:21:27 +02:00
pendulum 6b9d99f495 Added description property to recent scrapers (apparently forgotten). Reconfigured eslint for scrapers. 2019-04-07 05:19:44 +02:00
pendulum c8abb302e4 Added DDFNetwork scraper. Modified tag matching query to be case insensitive. 2019-04-07 05:01:06 +02:00
pendulum 885a815022 Added tag groups. Added MOFOS scraped. Improved entry ID handling. 2019-04-07 02:15:57 +02:00
pendulum 3a90f98d41 Added Blowpass scraper. Split shootId and pageId. 2019-04-06 23:24:26 +02:00
pendulum 2b818e379a Scrapers can now iterate through pages. Filtering unique releases before saving to database. Improved scrapers and rendering. 2019-04-05 03:45:40 +02:00