Commit Graph

593 Commits

Author SHA1 Message Date
9255467091 Refactored MOFOS scraper to use generic MindGeek scraper. Added Digital Playground and Fake Hub. 2020-01-14 19:56:46 +01:00
ef76909d3c Merged Reality Kings and Babes into MindGeek scraper. Kept classic latest wrapper for Look At Her Now and Tranny Surprise. 2020-01-14 04:50:42 +01:00
f5704451f8 Wrapping up 2020-01-14 01:51:18 +01:00
8c76568f44 Added Babes network 2020-01-14 01:50:11 +01:00
859cb7e1f3 Added support for Family Strokes. 2020-01-13 23:45:09 +01:00
97cb4a061e Added Team Skeet scraper. 2020-01-12 05:30:46 +01:00
8f72e61928 Added Jay Rock network. Fixed site logo not showing up without URL. 2020-01-11 05:31:04 +01:00
f572f38b5c Added Jay's POV scraper. 2020-01-10 22:10:11 +01:00
89afc5e169 Switching to logger. 2020-01-10 04:40:41 +01:00
4b36de2f55 Fixed Evil Angel upcoming and actor association issues. Moving from console.log to logger. 2020-01-10 02:43:04 +01:00
863df38b29 Simplified tag media seed file. Renamed tags. Media refactor experiment. 2020-01-08 23:33:24 +01:00
4c28c8b640 Fixed duplicate query. Updated Jules Jordan logo's. 2020-01-08 19:23:50 +01:00
a773e0bf54 Added Manuel Ferrara site to Jules Jordan. Refactored Jules Jordan photo scraper for better compatability and quality. 2020-01-08 05:12:14 +01:00
0a19f2e624 Added Bang! deep scrape. Improved network page layout. Added Bang Bros logos. 2020-01-07 04:23:28 +01:00
89064e9e0c Simplified single-site network overview. Added Jules Jordan favicons. 2020-01-07 00:30:51 +01:00
bb5b8085f6 Added Bang! scraper. Showing studio on tile. Added favicons to tiles. 2020-01-06 05:19:38 +01:00
72b175e9e2 Removed views in favor of PostGraphile filter and sort plugins. Updated site modules to GraphQL. Added tag posters. 2020-01-04 02:51:58 +01:00
70e27a6cd9 Moved networks to GraphQL. 2020-01-03 00:59:02 +01:00
e77dbca954 Fixed actor data and avatar fetching and display. 2020-01-02 17:13:57 +01:00
5a6bf2b42f Further refactoring. Fixed actor pages and more. 2019-12-31 03:12:52 +01:00
1c43884102 Refactoring client to reflect database changes. 2019-12-19 04:42:50 +01:00
31aee71edb Normalized database. Updated seed files. Simplified seed upsert. 2019-12-19 02:35:07 +01:00
6950a76cb5 Abstracted fragments and curation. Using GraphQL for tags. 2019-12-16 05:30:25 +01:00
f4c2e6c08c Replaced default height and weight fields with fields taking units argument. 2019-12-16 02:39:13 +01:00
577c03f9b7 Fixed queries. 2019-12-15 23:46:42 +01:00
ce92d13327 Fixed site fallback handling. 2019-12-15 23:14:43 +01:00
07a6c77ce2 Improvements, GrapQL experiments. Fixed Babel dependencies. 2019-12-15 22:16:55 +01:00
7ba716cd6f Experimenting using GraphQL in favor of REST. 2019-12-15 05:42:51 +01:00
fed2b0be8a When poster is not available during scraping, first photo is stored as poster; removed client-side fallback. Added screencap album fallback to Jules Jordan scraper. Simplified JJ page traversal. 2019-12-13 16:59:04 +01:00
c998fcf933 Added photo album support to Blowpass scraper. 2019-12-13 05:04:04 +01:00
e69b7744c8 Showing movie covers as poster when available. 2019-12-13 03:57:01 +01:00
77307d2d13 Refactored media module to generalize avatar and poster storage into photo storage. 2019-12-13 03:28:52 +01:00
a03a00f5d9 Added Sperm Swallowers and The Ass Factory to Jules Jordan scraper. Added photo source. 2019-12-12 05:18:43 +01:00
0b819713b5 Fixed off-by-one in photo plucker. Fixed source duplicate photo function not handling fallback sources. 2019-12-12 04:04:35 +01:00
a310f9bb1d Added support for release photo fallbacks. Limited photo fetching concurrency. Modifier XEmpire scraper for AllBlackX support and improved photo scraping. Added movie property to Evil Angel scraper. 2019-12-12 03:12:05 +01:00
b9af7255f6 Fixed release actor origin bug. 2019-12-11 05:15:23 +01:00
18f37e3fbd Moved all tag photos to public asset directory. 2019-12-11 02:25:25 +01:00
b9bac6d8f9 Added Kelly Madison profile scraper. 2019-12-10 22:35:00 +01:00
3956994580 Swapped poster and photo for Kelly Madison scraper. 2019-12-10 05:19:08 +01:00
85e55eebaf Added Kelly Madison Media (Teen Fidelity) release scraper. 2019-12-10 05:10:08 +01:00
b6123b9418 Added source maps. Fixed DDFNetwork avatar and improved photo fetch error handling. 2019-12-10 00:30:55 +01:00
04a89efa58 Refactored 21sextury scraper. 2019-12-09 05:00:49 +01:00
222260d3cf Generalized tags to allow them to be assigned to anything. 2019-12-07 04:41:16 +01:00
30f4a418e3 Allowing scrapers to return multiple trailer qualities, implemented for Brazzers. Removed tag and site matching from Brazzers scraper. 2019-12-07 04:17:14 +01:00
c4d620c6ff Refactored media module for better duplicate handling, readability and DRY. 2019-12-07 03:59:55 +01:00
98b9c885ec Added support for Reality Kings sites 'Look At Her Now' and 'Tranny Surprise'. 2019-12-07 00:42:47 +01:00
7cb888801f Updated Naughty America scraper, added media support.. 2019-12-05 04:26:54 +01:00
2697aaa0af Removed release_date selection, not working as desired. Removed site and tag fetching from Kink scraper. 2019-12-05 01:33:57 +01:00
71cb85c3e1 Allowing scrapers to return raw tags and site URLs or slugs, to gradually remove site and tag fetching from individual scrapers. Added media and deep fetchin support to Perv City scraper. 2019-12-05 01:26:22 +01:00
55e3130062 Move tag posters and photos to media database. 2019-12-04 21:58:08 +01:00