Commit Graph
945 Commits
Author SHA1 Message Date
pendulum 71cb85c3e1 Allowing scrapers to return raw tags and site URLs or slugs, to gradually remove site and tag fetching from individual scrapers. Added media and deep fetchin support to Perv City scraper. 2019-12-05 01:26:22 +01:00
pendulum 55e3130062 Move tag posters and photos to media database. 2019-12-04 21:58:08 +01:00
pendulum cf81aa99e0 Added rudimentary tags page. Improved social match behavior. 2019-12-01 05:32:47 +01:00
pendulum bead69de49 Added basic actor and network overview. Added DDF Network actor scraper. Various bug fixes and layout improvements. 2019-11-30 05:55:32 +01:00
pendulum 0dbe853f39 Resolving actor birth and residence place before storage. Layout improvements. 2019-11-29 05:46:06 +01:00
pendulum 4be508b388 Drastic actor page redesign. Storing one avatar per actor, other profile photos as 'photo' role; no longer assuming first photo is avatar. 2019-11-28 05:36:22 +01:00
pendulum 884ef248e4 Fixed actor birthdate and social links scraping. 2019-11-27 05:12:51 +01:00
pendulum d113123778 Fixed countries seed file. Updated MOFOS scraper. Improved Reality Kings scraper. Limiting photos for XEmpire scraper. 2019-11-27 04:58:38 +01:00
pendulum de36ed97e4 Added profile scraping in try/catch block. Re-added boobs enhanced info to actor page. 2019-11-21 11:43:07 +01:00
pendulum 31a8f1cac1 Improved profile scrapers. Sorting avatars on actor page by index. 2019-11-21 04:24:55 +01:00
pendulum 9224b441e2 Added Brazzers and Jules Jordan as profile sources. Changed profile structure for proper bust-waist-hip properties and improved stability. 2019-11-21 04:05:32 +01:00
pendulum 9fcc40dd17 Added avatars. Added PornHub and LegalPorno actor profile scrapers. 2019-11-20 04:53:36 +01:00
pendulum a13d92b84e Fixed date bug. 2019-11-19 04:41:56 +01:00
pendulum 3ec7b15886 Improved scraping and association behavior. 2019-11-19 04:36:15 +01:00
pendulum e8130c3634 Scraping actor profiles from FreeOnes. 2019-11-17 03:56:45 +01:00
pendulum bd041c528d Fixed ID number/string incompatability in duplicate detection. Expanded Reality Kings scraper to handle older scenes and fix URLs. 2019-11-17 00:45:31 +01:00
pendulum 2857387441 Added bash CLI shorthand. Properly setting parameters in site results. Removed obsolete URL restriction from Reality Kings scraper. 2019-11-16 23:37:33 +01:00
pendulum b489c8fc33 Major refactor, cleand up site scrape module, fixed and cleaned up release scrape module. Removed old CLI code 2019-11-16 03:33:36 +01:00
pendulum 5620dfcb65 Added filter bar to all pages. Added 'upcoming' marker. Improved date tidbit. 2019-11-15 05:10:59 +01:00
pendulum 0575dbc7e4 Generalized filters bar, added to network page. 2019-11-15 02:37:17 +01:00
pendulum 1c3f17ec82 Added timerange filters. Refactored releases module for more efficient queries. 2019-11-15 01:27:58 +01:00
pendulum bf223adc55 Redesigned release page. Added 'single site' marker, linking directly to network page. Fixed Dogfart scraper duration. 2019-11-14 05:13:38 +01:00
pendulum 117d669a69 Added Private Black, improved Private scraper to handle their non-private.com sites. 2019-11-14 00:00:29 +01:00
pendulum f9f9cc7977 Added tag filter to releases query, enabled on homepage. 2019-11-13 03:14:24 +01:00
pendulum 832e96ced1 Improved site and network pages. Fixed various issues. 2019-11-12 01:22:20 +01:00
pendulum 681f1bca85 Added tag page. Added default 'anal' tag to Vixen scraper for Tushy and Tushy Raw. 2019-11-11 05:18:28 +01:00
pendulum 50816d7b28 Generating thumbnails. Added site overview page. 2019-11-11 03:20:00 +01:00
pendulum 6ed484af76 Moved icons into network directories. Improved network logo handling. 2019-11-10 04:47:41 +01:00
pendulum a9b91ff76c Added actors page. Added site logos with overview on network page. 2019-11-10 04:20:22 +01:00
pendulum 82c9bc664a Added network page and sites back-end. Split release tiles into own component. 2019-11-09 04:43:58 +01:00
pendulum e9277028e2 Added Mike Adriano scraper (True Anal, All Anal, Swallowed, Nympho). Updated README. 2019-11-09 01:22:50 +01:00
pendulum 0567b1b2ff Refactored seed files to use programmatic upsert instead of SQL duplicate ignore. 2019-11-06 02:47:10 +01:00
pendulum f8f6428e36 Added media support to Private scraper. 2019-11-05 01:41:13 +01:00
pendulum c466d791f5 Removed upsert from store releases, observing effects; fixes ? inserted as . Removed query from stored Dogfart URLs. 2019-11-05 00:54:47 +01:00
pendulum e4399380d3 Fixed photo plucker to prevent duplicate at end. 2019-11-04 06:04:43 +01:00
pendulum 5745cd33d8 Added Dogfart scraper. Added 'date added' property to release page. 2019-11-04 05:47:37 +01:00
pendulum 2198c7ceb0 Added media support to Bang Bros scraper. Added untracked files. 2019-10-31 01:53:26 +01:00
pendulum 382e40b651 Added studio support. Added studios for LegalPorno. Improved media fetch error handling. Fixed DDFNetwork scraper, added media support. 2019-10-30 04:45:42 +01:00
pendulum ffe2564bb3 Added full photo album to Jules Jordan scraper. 2019-10-29 04:49:27 +01:00
pendulum eb50af7b81 Added media support to Brazzers scraper. 2019-10-29 03:50:39 +01:00
pendulum d5073a73ce Added media support to XEmpire (HardX) scraper. 2019-10-29 03:13:56 +01:00
pendulum a4d936523b Added media to LegalPorno scraper. 2019-10-29 01:47:16 +01:00
pendulum 5f853792b8 Added icon component. Stylized filter bar. 2019-10-28 02:54:37 +01:00
pendulum f7f5e8a306 Deriving transsexual tag from actors in Evil Angel scraper. 2019-10-28 02:12:11 +01:00
pendulum 0e784a274f Reworked tag matching. Added tag filter groundwork. 2019-10-28 00:58:54 +01:00
pendulum 2c32ed6549 Completed Evil Angel scraper. Added trans tags. 2019-09-28 03:26:04 +02:00
pendulum 298eabe56e Improved Vixen and XEmpire scrapers. Added media to Blowpass scraper. Improved release fetch code. 2019-09-26 03:27:01 +02:00
pendulum 96d8cfbcb6 Improved media handling, added trailer support. Fetching media from Vixen network frontpages. 2019-09-25 04:52:58 +02:00
pendulum b12d74cbb3 Fixed Vixen scraper, site restructured. Added Deeper to Vixen network. 2019-09-25 02:44:25 +02:00
pendulum c78f7f957f Merge branch 'master' of unknown.name:pendulum/traxxx 2019-09-25 01:38:21 +02:00