Commit Graph
100 Commits
Author SHA1 Message Date
pendulum 13b45e1709 Fixed Babel dependencies. 2019-12-15 23:01:48 +01:00
pendulum 07a6c77ce2 Improvements, GrapQL experiments. Fixed Babel dependencies. 2019-12-15 22:16:55 +01:00
pendulum 7ba716cd6f Experimenting using GraphQL in favor of REST. 2019-12-15 05:42:51 +01:00
pendulum 36c5fa3b52 1.43.1 2019-12-13 16:59:06 +01:00
pendulum fed2b0be8a When poster is not available during scraping, first photo is stored as poster; removed client-side fallback. Added screencap album fallback to Jules Jordan scraper. Simplified JJ page traversal. 2019-12-13 16:59:04 +01:00
pendulum 5b5d383363 1.43.0 2019-12-13 05:04:07 +01:00
pendulum c998fcf933 Added photo album support to Blowpass scraper. 2019-12-13 05:04:04 +01:00
pendulum c9e0c29d51 1.42.2 2019-12-13 03:57:04 +01:00
pendulum e69b7744c8 Showing movie covers as poster when available. 2019-12-13 03:57:01 +01:00
pendulum 73f9d568b0 1.42.1 2019-12-13 03:28:58 +01:00
pendulum 77307d2d13 Refactored media module to generalize avatar and poster storage into photo storage. 2019-12-13 03:28:52 +01:00
pendulum 20011a74e8 1.42.0 2019-12-12 05:18:48 +01:00
pendulum a03a00f5d9 Added Sperm Swallowers and The Ass Factory to Jules Jordan scraper. Added photo source. 2019-12-12 05:18:43 +01:00
pendulum ad1a0376e7 1.41.1 2019-12-12 04:04:38 +01:00
pendulum 0b819713b5 Fixed off-by-one in photo plucker. Fixed source duplicate photo function not handling fallback sources. 2019-12-12 04:04:35 +01:00
pendulum dbaf1a9a9c 1.41.0 2019-12-12 03:12:09 +01:00
pendulum a310f9bb1d Added support for release photo fallbacks. Limited photo fetching concurrency. Modifier XEmpire scraper for AllBlackX support and improved photo scraping. Added movie property to Evil Angel scraper. 2019-12-12 03:12:05 +01:00
pendulum c26d5b8655 1.40.4 2019-12-11 05:23:57 +01:00
pendulum a11a141fda Fixed broken DAP thumb. 2019-12-11 05:23:53 +01:00
pendulum 97266b7670 1.40.3 2019-12-11 05:20:45 +01:00
pendulum f251b0b17c Updated DAP and DATP posters. 2019-12-11 05:20:38 +01:00
pendulum c85aa32eea 1.40.2 2019-12-11 05:15:29 +01:00
pendulum b9af7255f6 Fixed release actor origin bug. 2019-12-11 05:15:23 +01:00
pendulum b7c1028663 1.40.1 2019-12-11 02:25:29 +01:00
pendulum 18f37e3fbd Moved all tag photos to public asset directory. 2019-12-11 02:25:25 +01:00
pendulum 1d1b36bf76 1.40.0 2019-12-10 22:35:04 +01:00
pendulum b9bac6d8f9 Added Kelly Madison profile scraper. 2019-12-10 22:35:00 +01:00
pendulum 8802bb4317 1.39.1 2019-12-10 05:19:11 +01:00
pendulum 3956994580 Swapped poster and photo for Kelly Madison scraper. 2019-12-10 05:19:08 +01:00
pendulum 00252b6727 1.39.0 2019-12-10 05:10:11 +01:00
pendulum 85e55eebaf Added Kelly Madison Media (Teen Fidelity) release scraper. 2019-12-10 05:10:08 +01:00
pendulum 691124fa1c 1.38.1 2019-12-10 00:30:58 +01:00
pendulum b6123b9418 Added source maps. Fixed DDFNetwork avatar and improved photo fetch error handling. 2019-12-10 00:30:55 +01:00
pendulum 04a89efa58 Refactored 21sextury scraper. 2019-12-09 05:00:49 +01:00
pendulum d874c508de 1.38.0 2019-12-07 04:41:21 +01:00
pendulum 222260d3cf Generalized tags to allow them to be assigned to anything. 2019-12-07 04:41:16 +01:00
pendulum 85c2654add 1.37.0 2019-12-07 04:17:18 +01:00
pendulum 30f4a418e3 Allowing scrapers to return multiple trailer qualities, implemented for Brazzers. Removed tag and site matching from Brazzers scraper. 2019-12-07 04:17:14 +01:00
pendulum 5455f5483b 1.36.5 2019-12-07 03:59:59 +01:00
pendulum c4d620c6ff Refactored media module for better duplicate handling, readability and DRY. 2019-12-07 03:59:55 +01:00
pendulum b9617c76a1 1.36.4 2019-12-07 00:42:58 +01:00
pendulum 98b9c885ec Added support for Reality Kings sites 'Look At Her Now' and 'Tranny Surprise'. 2019-12-07 00:42:47 +01:00
pendulum 2a1fd87ee8 1.36.3 2019-12-06 05:09:11 +01:00
pendulum a2925febeb Moved tag posters back to img/, as they are part of the project. Still using database to track which tags have a poster. 2019-12-06 05:09:08 +01:00
pendulum 5d58d31dfa 1.36.2 2019-12-05 04:26:59 +01:00
pendulum 7cb888801f Updated Naughty America scraper, added media support.. 2019-12-05 04:26:54 +01:00
pendulum 6a90dc587c 1.36.1 2019-12-05 01:34:02 +01:00
pendulum 2697aaa0af Removed release_date selection, not working as desired. Removed site and tag fetching from Kink scraper. 2019-12-05 01:33:57 +01:00
pendulum 71cb85c3e1 Allowing scrapers to return raw tags and site URLs or slugs, to gradually remove site and tag fetching from individual scrapers. Added media and deep fetchin support to Perv City scraper. 2019-12-05 01:26:22 +01:00
pendulum 7840af2843 1.36.0 2019-12-04 21:58:27 +01:00
pendulum 55e3130062 Move tag posters and photos to media database. 2019-12-04 21:58:08 +01:00
pendulum cf81aa99e0 Added rudimentary tags page. Improved social match behavior. 2019-12-01 05:32:47 +01:00
pendulum bead69de49 Added basic actor and network overview. Added DDF Network actor scraper. Various bug fixes and layout improvements. 2019-11-30 05:55:32 +01:00
pendulum 0dbe853f39 Resolving actor birth and residence place before storage. Layout improvements. 2019-11-29 05:46:06 +01:00
pendulum 4be508b388 Drastic actor page redesign. Storing one avatar per actor, other profile photos as 'photo' role; no longer assuming first photo is avatar. 2019-11-28 05:36:22 +01:00
pendulum 884ef248e4 Fixed actor birthdate and social links scraping. 2019-11-27 05:12:51 +01:00
pendulum d113123778 Fixed countries seed file. Updated MOFOS scraper. Improved Reality Kings scraper. Limiting photos for XEmpire scraper. 2019-11-27 04:58:38 +01:00
pendulum de36ed97e4 Added profile scraping in try/catch block. Re-added boobs enhanced info to actor page. 2019-11-21 11:43:07 +01:00
pendulum 31a8f1cac1 Improved profile scrapers. Sorting avatars on actor page by index. 2019-11-21 04:24:55 +01:00
pendulum 9224b441e2 Added Brazzers and Jules Jordan as profile sources. Changed profile structure for proper bust-waist-hip properties and improved stability. 2019-11-21 04:05:32 +01:00
pendulum 9fcc40dd17 Added avatars. Added PornHub and LegalPorno actor profile scrapers. 2019-11-20 04:53:36 +01:00
pendulum a13d92b84e Fixed date bug. 2019-11-19 04:41:56 +01:00
pendulum 3ec7b15886 Improved scraping and association behavior. 2019-11-19 04:36:15 +01:00
pendulum 7e9fd19c2a 1.35.0 2019-11-17 03:56:48 +01:00
pendulum e8130c3634 Scraping actor profiles from FreeOnes. 2019-11-17 03:56:45 +01:00
pendulum abcdb52335 1.34.2 2019-11-17 00:45:34 +01:00
pendulum bd041c528d Fixed ID number/string incompatability in duplicate detection. Expanded Reality Kings scraper to handle older scenes and fix URLs. 2019-11-17 00:45:31 +01:00
pendulum 88c8bb1ced 1.34.1 2019-11-16 23:37:37 +01:00
pendulum 2857387441 Added bash CLI shorthand. Properly setting parameters in site results. Removed obsolete URL restriction from Reality Kings scraper. 2019-11-16 23:37:33 +01:00
pendulum 5c551bade2 1.34.0 2019-11-16 03:33:41 +01:00
pendulum b489c8fc33 Major refactor, cleand up site scrape module, fixed and cleaned up release scrape module. Removed old CLI code 2019-11-16 03:33:36 +01:00
pendulum b07f88d023 1.33.1 2019-11-15 05:11:04 +01:00
pendulum 5620dfcb65 Added filter bar to all pages. Added 'upcoming' marker. Improved date tidbit. 2019-11-15 05:10:59 +01:00
pendulum a612045ee0 1.33.0 2019-11-15 02:37:27 +01:00
pendulum 0575dbc7e4 Generalized filters bar, added to network page. 2019-11-15 02:37:17 +01:00
pendulum 23492bb5d0 1.32.0 2019-11-15 01:28:02 +01:00
pendulum 1c3f17ec82 Added timerange filters. Refactored releases module for more efficient queries. 2019-11-15 01:27:58 +01:00
pendulum a089bf892c 1.31.0 2019-11-14 05:13:45 +01:00
pendulum bf223adc55 Redesigned release page. Added 'single site' marker, linking directly to network page. Fixed Dogfart scraper duration. 2019-11-14 05:13:38 +01:00
pendulum 4fa13bb163 Redesigned homepage. 2019-11-14 01:18:19 +01:00
pendulum 4497cc41b6 1.30.0 2019-11-14 00:00:35 +01:00
pendulum 117d669a69 Added Private Black, improved Private scraper to handle their non-private.com sites. 2019-11-14 00:00:29 +01:00
pendulum 4e4852db0d 1.29.0 2019-11-13 03:14:28 +01:00
pendulum f9f9cc7977 Added tag filter to releases query, enabled on homepage. 2019-11-13 03:14:24 +01:00
pendulum d1212725bb 1.28.1 2019-11-12 01:22:26 +01:00
pendulum 832e96ced1 Improved site and network pages. Fixed various issues. 2019-11-12 01:22:20 +01:00
pendulum 3c76d39301 1.28.0 2019-11-11 05:18:31 +01:00
pendulum 681f1bca85 Added tag page. Added default 'anal' tag to Vixen scraper for Tushy and Tushy Raw. 2019-11-11 05:18:28 +01:00
pendulum 4c1087ca53 1.27.0 2019-11-11 03:20:04 +01:00
pendulum 50816d7b28 Generating thumbnails. Added site overview page. 2019-11-11 03:20:00 +01:00
pendulum 948597d265 1.26.1 2019-11-10 04:47:46 +01:00
pendulum 6ed484af76 Moved icons into network directories. Improved network logo handling. 2019-11-10 04:47:41 +01:00
pendulum be012bfa40 1.26.0 2019-11-10 04:20:26 +01:00
pendulum a9b91ff76c Added actors page. Added site logos with overview on network page. 2019-11-10 04:20:22 +01:00
pendulum 76618cee83 1.25.0 2019-11-09 04:44:02 +01:00
pendulum 82c9bc664a Added network page and sites back-end. Split release tiles into own component. 2019-11-09 04:43:58 +01:00
pendulum 708f704d1b 1.24.0 2019-11-09 01:22:53 +01:00
pendulum e9277028e2 Added Mike Adriano scraper (True Anal, All Anal, Swallowed, Nympho). Updated README. 2019-11-09 01:22:50 +01:00
pendulum 9f0a48f581 1.23.0 2019-11-06 02:47:13 +01:00
pendulum 0567b1b2ff Refactored seed files to use programmatic upsert instead of SQL duplicate ignore. 2019-11-06 02:47:10 +01:00