Commit Graph

1292 Commits

Author SHA1 Message Date
ThePendulum b6123b9418 Added source maps. Fixed DDFNetwork avatar and improved photo fetch error handling. 2019-12-10 00:30:55 +01:00
ThePendulum 04a89efa58 Refactored 21sextury scraper. 2019-12-09 05:00:49 +01:00
ThePendulum d874c508de 1.38.0 2019-12-07 04:41:21 +01:00
ThePendulum 222260d3cf Generalized tags to allow them to be assigned to anything. 2019-12-07 04:41:16 +01:00
ThePendulum 85c2654add 1.37.0 2019-12-07 04:17:18 +01:00
ThePendulum 30f4a418e3 Allowing scrapers to return multiple trailer qualities, implemented for Brazzers. Removed tag and site matching from Brazzers scraper. 2019-12-07 04:17:14 +01:00
ThePendulum 5455f5483b 1.36.5 2019-12-07 03:59:59 +01:00
ThePendulum c4d620c6ff Refactored media module for better duplicate handling, readability and DRY. 2019-12-07 03:59:55 +01:00
ThePendulum b9617c76a1 1.36.4 2019-12-07 00:42:58 +01:00
ThePendulum 98b9c885ec Added support for Reality Kings sites 'Look At Her Now' and 'Tranny Surprise'. 2019-12-07 00:42:47 +01:00
ThePendulum 2a1fd87ee8 1.36.3 2019-12-06 05:09:11 +01:00
ThePendulum a2925febeb Moved tag posters back to img/, as they are part of the project. Still using database to track which tags have a poster. 2019-12-06 05:09:08 +01:00
ThePendulum 5d58d31dfa 1.36.2 2019-12-05 04:26:59 +01:00
ThePendulum 7cb888801f Updated Naughty America scraper, added media support.. 2019-12-05 04:26:54 +01:00
ThePendulum 6a90dc587c 1.36.1 2019-12-05 01:34:02 +01:00
ThePendulum 2697aaa0af Removed release_date selection, not working as desired. Removed site and tag fetching from Kink scraper. 2019-12-05 01:33:57 +01:00
ThePendulum 71cb85c3e1 Allowing scrapers to return raw tags and site URLs or slugs, to gradually remove site and tag fetching from individual scrapers. Added media and deep fetchin support to Perv City scraper. 2019-12-05 01:26:22 +01:00
ThePendulum 7840af2843 1.36.0 2019-12-04 21:58:27 +01:00
ThePendulum 55e3130062 Move tag posters and photos to media database. 2019-12-04 21:58:08 +01:00
ThePendulum cf81aa99e0 Added rudimentary tags page. Improved social match behavior. 2019-12-01 05:32:47 +01:00
ThePendulum bead69de49 Added basic actor and network overview. Added DDF Network actor scraper. Various bug fixes and layout improvements. 2019-11-30 05:55:32 +01:00
ThePendulum 0dbe853f39 Resolving actor birth and residence place before storage. Layout improvements. 2019-11-29 05:46:06 +01:00
ThePendulum 4be508b388 Drastic actor page redesign. Storing one avatar per actor, other profile photos as 'photo' role; no longer assuming first photo is avatar. 2019-11-28 05:36:22 +01:00
ThePendulum 884ef248e4 Fixed actor birthdate and social links scraping. 2019-11-27 05:12:51 +01:00
ThePendulum d113123778 Fixed countries seed file. Updated MOFOS scraper. Improved Reality Kings scraper. Limiting photos for XEmpire scraper. 2019-11-27 04:58:38 +01:00
ThePendulum de36ed97e4 Added profile scraping in try/catch block. Re-added boobs enhanced info to actor page. 2019-11-21 11:43:07 +01:00
ThePendulum 31a8f1cac1 Improved profile scrapers. Sorting avatars on actor page by index. 2019-11-21 04:24:55 +01:00
ThePendulum 9224b441e2 Added Brazzers and Jules Jordan as profile sources. Changed profile structure for proper bust-waist-hip properties and improved stability. 2019-11-21 04:05:32 +01:00
ThePendulum 9fcc40dd17 Added avatars. Added PornHub and LegalPorno actor profile scrapers. 2019-11-20 04:53:36 +01:00
ThePendulum a13d92b84e Fixed date bug. 2019-11-19 04:41:56 +01:00
ThePendulum 3ec7b15886 Improved scraping and association behavior. 2019-11-19 04:36:15 +01:00
ThePendulum 7e9fd19c2a 1.35.0 2019-11-17 03:56:48 +01:00
ThePendulum e8130c3634 Scraping actor profiles from FreeOnes. 2019-11-17 03:56:45 +01:00
ThePendulum abcdb52335 1.34.2 2019-11-17 00:45:34 +01:00
ThePendulum bd041c528d Fixed ID number/string incompatability in duplicate detection. Expanded Reality Kings scraper to handle older scenes and fix URLs. 2019-11-17 00:45:31 +01:00
ThePendulum 88c8bb1ced 1.34.1 2019-11-16 23:37:37 +01:00
ThePendulum 2857387441 Added bash CLI shorthand. Properly setting parameters in site results. Removed obsolete URL restriction from Reality Kings scraper. 2019-11-16 23:37:33 +01:00
ThePendulum 5c551bade2 1.34.0 2019-11-16 03:33:41 +01:00
ThePendulum b489c8fc33 Major refactor, cleand up site scrape module, fixed and cleaned up release scrape module. Removed old CLI code 2019-11-16 03:33:36 +01:00
ThePendulum b07f88d023 1.33.1 2019-11-15 05:11:04 +01:00
ThePendulum 5620dfcb65 Added filter bar to all pages. Added 'upcoming' marker. Improved date tidbit. 2019-11-15 05:10:59 +01:00
ThePendulum a612045ee0 1.33.0 2019-11-15 02:37:27 +01:00
ThePendulum 0575dbc7e4 Generalized filters bar, added to network page. 2019-11-15 02:37:17 +01:00
ThePendulum 23492bb5d0 1.32.0 2019-11-15 01:28:02 +01:00
ThePendulum 1c3f17ec82 Added timerange filters. Refactored releases module for more efficient queries. 2019-11-15 01:27:58 +01:00
ThePendulum a089bf892c 1.31.0 2019-11-14 05:13:45 +01:00
ThePendulum bf223adc55 Redesigned release page. Added 'single site' marker, linking directly to network page. Fixed Dogfart scraper duration. 2019-11-14 05:13:38 +01:00
ThePendulum 4fa13bb163 Redesigned homepage. 2019-11-14 01:18:19 +01:00
ThePendulum 4497cc41b6 1.30.0 2019-11-14 00:00:35 +01:00
ThePendulum 117d669a69 Added Private Black, improved Private scraper to handle their non-private.com sites. 2019-11-14 00:00:29 +01:00