Commit Graph

72 Commits

Author SHA1 Message Date
9255467091 Refactored MOFOS scraper to use generic MindGeek scraper. Added Digital Playground and Fake Hub. 2020-01-14 19:56:46 +01:00
ef76909d3c Merged Reality Kings and Babes into MindGeek scraper. Kept classic latest wrapper for Look At Her Now and Tranny Surprise. 2020-01-14 04:50:42 +01:00
8c76568f44 Added Babes network 2020-01-14 01:50:11 +01:00
859cb7e1f3 Added support for Family Strokes. 2020-01-13 23:45:09 +01:00
97cb4a061e Added Team Skeet scraper. 2020-01-12 05:30:46 +01:00
8f72e61928 Added Jay Rock network. Fixed site logo not showing up without URL. 2020-01-11 05:31:04 +01:00
f572f38b5c Added Jay's POV scraper. 2020-01-10 22:10:11 +01:00
863df38b29 Simplified tag media seed file. Renamed tags. Media refactor experiment. 2020-01-08 23:33:24 +01:00
a773e0bf54 Added Manuel Ferrara site to Jules Jordan. Refactored Jules Jordan photo scraper for better compatability and quality. 2020-01-08 05:12:14 +01:00
0a19f2e624 Added Bang! deep scrape. Improved network page layout. Added Bang Bros logos. 2020-01-07 04:23:28 +01:00
9e6e5605ed Added favicons for all networks. Showing sites on dark background, lightened logos. Updated Kink logos. Changed Bang! studios to sites, removed studio prominence. 2020-01-06 21:49:37 +01:00
5b118446ae Added Kosovo to countries. 2020-01-06 14:55:55 +01:00
bb5b8085f6 Added Bang! scraper. Showing studio on tile. Added favicons to tiles. 2020-01-06 05:19:38 +01:00
30cf597ec9 Improving network overview. Added DDF logos and tag posters. 2020-01-04 04:58:56 +01:00
72b175e9e2 Removed views in favor of PostGraphile filter and sort plugins. Updated site modules to GraphQL. Added tag posters. 2020-01-04 02:51:58 +01:00
1c43884102 Refactoring client to reflect database changes. 2019-12-19 04:42:50 +01:00
31aee71edb Normalized database. Updated seed files. Simplified seed upsert. 2019-12-19 02:35:07 +01:00
6950a76cb5 Abstracted fragments and curation. Using GraphQL for tags. 2019-12-16 05:30:25 +01:00
7ba716cd6f Experimenting using GraphQL in favor of REST. 2019-12-15 05:42:51 +01:00
a03a00f5d9 Added Sperm Swallowers and The Ass Factory to Jules Jordan scraper. Added photo source. 2019-12-12 05:18:43 +01:00
a310f9bb1d Added support for release photo fallbacks. Limited photo fetching concurrency. Modifier XEmpire scraper for AllBlackX support and improved photo scraping. Added movie property to Evil Angel scraper. 2019-12-12 03:12:05 +01:00
f251b0b17c Updated DAP and DATP posters. 2019-12-11 05:20:38 +01:00
b9af7255f6 Fixed release actor origin bug. 2019-12-11 05:15:23 +01:00
18f37e3fbd Moved all tag photos to public asset directory. 2019-12-11 02:25:25 +01:00
85e55eebaf Added Kelly Madison Media (Teen Fidelity) release scraper. 2019-12-10 05:10:08 +01:00
04a89efa58 Refactored 21sextury scraper. 2019-12-09 05:00:49 +01:00
222260d3cf Generalized tags to allow them to be assigned to anything. 2019-12-07 04:41:16 +01:00
98b9c885ec Added support for Reality Kings sites 'Look At Her Now' and 'Tranny Surprise'. 2019-12-07 00:42:47 +01:00
a2925febeb Moved tag posters back to img/, as they are part of the project. Still using database to track which tags have a poster. 2019-12-06 05:09:08 +01:00
71cb85c3e1 Allowing scrapers to return raw tags and site URLs or slugs, to gradually remove site and tag fetching from individual scrapers. Added media and deep fetchin support to Perv City scraper. 2019-12-05 01:26:22 +01:00
55e3130062 Move tag posters and photos to media database. 2019-12-04 21:58:08 +01:00
bead69de49 Added basic actor and network overview. Added DDF Network actor scraper. Various bug fixes and layout improvements. 2019-11-30 05:55:32 +01:00
0dbe853f39 Resolving actor birth and residence place before storage. Layout improvements. 2019-11-29 05:46:06 +01:00
d113123778 Fixed countries seed file. Updated MOFOS scraper. Improved Reality Kings scraper. Limiting photos for XEmpire scraper. 2019-11-27 04:58:38 +01:00
e8130c3634 Scraping actor profiles from FreeOnes. 2019-11-17 03:56:45 +01:00
2857387441 Added bash CLI shorthand. Properly setting parameters in site results. Removed obsolete URL restriction from Reality Kings scraper. 2019-11-16 23:37:33 +01:00
1c3f17ec82 Added timerange filters. Refactored releases module for more efficient queries. 2019-11-15 01:27:58 +01:00
bf223adc55 Redesigned release page. Added 'single site' marker, linking directly to network page. Fixed Dogfart scraper duration. 2019-11-14 05:13:38 +01:00
117d669a69 Added Private Black, improved Private scraper to handle their non-private.com sites. 2019-11-14 00:00:29 +01:00
f9f9cc7977 Added tag filter to releases query, enabled on homepage. 2019-11-13 03:14:24 +01:00
832e96ced1 Improved site and network pages. Fixed various issues. 2019-11-12 01:22:20 +01:00
681f1bca85 Added tag page. Added default 'anal' tag to Vixen scraper for Tushy and Tushy Raw. 2019-11-11 05:18:28 +01:00
e9277028e2 Added Mike Adriano scraper (True Anal, All Anal, Swallowed, Nympho). Updated README. 2019-11-09 01:22:50 +01:00
0567b1b2ff Refactored seed files to use programmatic upsert instead of SQL duplicate ignore. 2019-11-06 02:47:10 +01:00
c466d791f5 Removed upsert from store releases, observing effects; fixes ? inserted as . Removed query from stored Dogfart URLs. 2019-11-05 00:54:47 +01:00
5745cd33d8 Added Dogfart scraper. Added 'date added' property to release page. 2019-11-04 05:47:37 +01:00
2198c7ceb0 Added media support to Bang Bros scraper. Added untracked files. 2019-10-31 01:53:26 +01:00
382e40b651 Added studio support. Added studios for LegalPorno. Improved media fetch error handling. Fixed DDFNetwork scraper, added media support. 2019-10-30 04:45:42 +01:00
f7f5e8a306 Deriving transsexual tag from actors in Evil Angel scraper. 2019-10-28 02:12:11 +01:00
0e784a274f Reworked tag matching. Added tag filter groundwork. 2019-10-28 00:58:54 +01:00