Commit Graph

240 Commits

Author SHA1 Message Date
ThePendulum 944f091ca5 Adapted Score scraper for Scoreland2. 2020-02-03 02:12:02 +01:00
ThePendulum a671190fff Adapted Score scraper for Score Classics. 2020-02-03 02:04:47 +01:00
ThePendulum a96680875c Fixed media duplicate fallbacks being ignored. 2020-02-03 00:51:25 +01:00
ThePendulum a45bebddac Adapter Score scraper for Score Videos. 2020-02-03 00:39:43 +01:00
ThePendulum 0ed1b2eff9 Added generic photo page extract method to media module, to allow pre-filtering sources and relief Dogfart scraper. Added 'transsexual' site tag to Trans Angels. 2020-02-02 22:36:33 +01:00
ThePendulum 10d2ba78d0 Fixed Score searching for actors infinitely. 2020-02-02 15:26:24 +01:00
ThePendulum a97c6defca Added teaser support. Added Score network with scraper for Scoreland. Improved q. Added assets. 2020-02-02 05:14:58 +01:00
ThePendulum 87e2d6bbfd Added actor releases to MindGeek module. 2020-02-01 04:42:35 +01:00
ThePendulum cde9aba0cb Redundant actor sources can now be bundled in configuration. Fixed Men network actor path. 2020-02-01 04:14:08 +01:00
ThePendulum 09ea3125df Fixed release merge order. 2020-02-01 03:30:11 +01:00
ThePendulum abf9893f9d Fixed web server plugins. 2020-02-01 03:02:58 +01:00
ThePendulum 3541a9c402 Integrated Blowpass into generic Gamma scraper. 2020-02-01 02:26:00 +01:00
ThePendulum 94bf207397 Added Wicked network. Merged Evil Angel, XEmpire and Wicked into generic Gamma scraper. 2020-02-01 01:15:40 +01:00
ThePendulum b7f51a8deb Added avatar and actor releases to Bang Bros scraper. 2020-01-31 21:43:16 +01:00
ThePendulum 504bcd02e3 Added Naughty America profile and actor releases scraper. 2020-01-31 19:25:42 +01:00
ThePendulum 83164e44d3 Fixed site search overflowing networks page. 2020-01-31 02:01:30 +01:00
ThePendulum ffdf0690e7 Added option to fetch all of an actor's releases (for supporter scrapers), and a utility to extract posters. 2020-01-31 01:55:55 +01:00
ThePendulum 2fef4b4314 Fetching and returning releases for Evil Angel actors. 2020-01-31 00:39:49 +01:00
ThePendulum 3f113310e3 Added Trans Angels to MindGeek. Interpreting MindGeek 'other' gender as transsexual. 2020-01-31 00:25:51 +01:00
ThePendulum 2458b91ac2 Removed trailer debug log. 2020-01-30 04:15:09 +01:00
ThePendulum 0b4a1a5232 Moved all preferred resolutions to config. 2020-01-30 04:14:51 +01:00
ThePendulum c300d4d251 Added trailer support to Vogov. Set preferred trailer resolution to 480p. Added 480p and other resolution trailers support to XEmpire. 2020-01-30 03:53:54 +01:00
ThePendulum ff61094b69 Added Men network and Icon Male to MindGeek. Added entropy filter to media module to help filter out generic avatars. Added Pure Taboo. Various logo updates. 2020-01-30 01:14:31 +01:00
ThePendulum d61ea26eb5 Added 'ignore' parameter to sites. Added light logo for Metro HD. 2020-01-29 04:02:32 +01:00
ThePendulum 8b840f52d1 Added description property to LegalPorno scraper (rarely used, see GIO337). 2020-01-29 03:19:38 +01:00
ThePendulum 81ede3f511 Improved MindGeek avatar fix. 2020-01-29 02:31:55 +01:00
ThePendulum fc675ae144 Added Metro HD network using MindGeek scraper. Fixed MindGeek profile scraper avatar issue. 2020-01-29 02:24:19 +01:00
ThePendulum 76852daf6d Added VogoV (no trailer yet). Fixed MindGeek profile scraper. 2020-01-28 03:05:53 +01:00
ThePendulum 6d4fd5fd77 Added MindGeek profile scraper for all MG sites. 2020-01-27 22:54:14 +01:00
ThePendulum 32a0188b72 Fixed Boobpedia scraper. Catching non-OK responses for Vixen scraper. 2020-01-27 03:07:06 +01:00
ThePendulum 345103d759 Fixed ;. 2020-01-27 01:54:42 +01:00
ThePendulum eca65f6b4d Inspecting performance. 2020-01-27 00:41:04 +00:00
ThePendulum 68f9043910 Not fetching basic actors when actor names are supplied. Set default media directory to ./media. 2020-01-25 03:26:49 +00:00
ThePendulum ab82329171 Improved q so missing date element returns null. 2020-01-25 01:46:58 +01:00
ThePendulum bceded3ebd Added gender indicator to actor tiles. Fixed PornHub scraper fetching default avatars. 2020-01-25 01:26:13 +01:00
ThePendulum c93116dee2 Added actor expand button to profile. 2020-01-24 23:36:06 +01:00
ThePendulum 6ef5c82c6a Added URL helper to q. Getting social links from Boobpedia. 2020-01-23 23:32:51 +01:00
ThePendulum 42d07e86f8 Context q methods can accept alternative element as first argument. Added BoobPedia profile scraper. Showing fake boobs icon again. 2020-01-23 22:45:46 +01:00
ThePendulum 9db0e97512 Improved actor profile flow. Added images. 2020-01-23 03:52:12 +01:00
ThePendulum b92b9f3e18 Fixed actor avatar duplicates. Added new Jules Jordan logo. 2020-01-22 23:17:39 +01:00
ThePendulum f8175f6054 Added generic Gamma photo and actor scraper for XEmpire, 21Sextury, Blowpass and Evil Angel. 2020-01-22 22:25:58 +01:00
ThePendulum 4e4323704a Getting more and higher quality Vixen photos. 2020-01-18 23:10:31 +01:00
ThePendulum daee426ba6 Removed site and tag matching from Dogfart scraper. Filtering duplicate tag associations before insert attempt. 2020-01-17 01:55:54 +01:00
ThePendulum 4074a5bb64 Added Mile High Media scraper. 2020-01-16 21:56:33 +01:00
ThePendulum 61fee5e4f6 Added q scraping helper. Added Perfect Gonzo scraper. 2020-01-16 21:04:44 +01:00
ThePendulum 5dda81535d Added PornPros satellite sites. 2020-01-15 01:01:16 +01:00
ThePendulum 75c53d338a Added Porn Pros sites and scraper. 2020-01-14 21:45:30 +01:00
ThePendulum 9255467091 Refactored MOFOS scraper to use generic MindGeek scraper. Added Digital Playground and Fake Hub. 2020-01-14 19:56:46 +01:00
ThePendulum ef76909d3c Merged Reality Kings and Babes into MindGeek scraper. Kept classic latest wrapper for Look At Her Now and Tranny Surprise. 2020-01-14 04:50:42 +01:00
ThePendulum f5704451f8 Wrapping up 2020-01-14 01:51:18 +01:00
ThePendulum 8c76568f44 Added Babes network 2020-01-14 01:50:11 +01:00
ThePendulum 859cb7e1f3 Added support for Family Strokes. 2020-01-13 23:45:09 +01:00
ThePendulum 97cb4a061e Added Team Skeet scraper. 2020-01-12 05:30:46 +01:00
ThePendulum 8f72e61928 Added Jay Rock network. Fixed site logo not showing up without URL. 2020-01-11 05:31:04 +01:00
ThePendulum f572f38b5c Added Jay's POV scraper. 2020-01-10 22:10:11 +01:00
ThePendulum 89afc5e169 Switching to logger. 2020-01-10 04:40:41 +01:00
ThePendulum 4b36de2f55 Fixed Evil Angel upcoming and actor association issues. Moving from console.log to logger. 2020-01-10 02:43:04 +01:00
ThePendulum 863df38b29 Simplified tag media seed file. Renamed tags. Media refactor experiment. 2020-01-08 23:33:24 +01:00
ThePendulum 4c28c8b640 Fixed duplicate query. Updated Jules Jordan logo's. 2020-01-08 19:23:50 +01:00
ThePendulum a773e0bf54 Added Manuel Ferrara site to Jules Jordan. Refactored Jules Jordan photo scraper for better compatability and quality. 2020-01-08 05:12:14 +01:00
ThePendulum 0a19f2e624 Added Bang! deep scrape. Improved network page layout. Added Bang Bros logos. 2020-01-07 04:23:28 +01:00
ThePendulum 89064e9e0c Simplified single-site network overview. Added Jules Jordan favicons. 2020-01-07 00:30:51 +01:00
ThePendulum bb5b8085f6 Added Bang! scraper. Showing studio on tile. Added favicons to tiles. 2020-01-06 05:19:38 +01:00
ThePendulum 72b175e9e2 Removed views in favor of PostGraphile filter and sort plugins. Updated site modules to GraphQL. Added tag posters. 2020-01-04 02:51:58 +01:00
ThePendulum 70e27a6cd9 Moved networks to GraphQL. 2020-01-03 00:59:02 +01:00
ThePendulum e77dbca954 Fixed actor data and avatar fetching and display. 2020-01-02 17:13:57 +01:00
ThePendulum 5a6bf2b42f Further refactoring. Fixed actor pages and more. 2019-12-31 03:12:52 +01:00
ThePendulum 1c43884102 Refactoring client to reflect database changes. 2019-12-19 04:42:50 +01:00
ThePendulum 31aee71edb Normalized database. Updated seed files. Simplified seed upsert. 2019-12-19 02:35:07 +01:00
ThePendulum 6950a76cb5 Abstracted fragments and curation. Using GraphQL for tags. 2019-12-16 05:30:25 +01:00
ThePendulum f4c2e6c08c Replaced default height and weight fields with fields taking units argument. 2019-12-16 02:39:13 +01:00
ThePendulum 577c03f9b7 Fixed queries. 2019-12-15 23:46:42 +01:00
ThePendulum ce92d13327 Fixed site fallback handling. 2019-12-15 23:14:43 +01:00
ThePendulum 07a6c77ce2 Improvements, GrapQL experiments. Fixed Babel dependencies. 2019-12-15 22:16:55 +01:00
ThePendulum 7ba716cd6f Experimenting using GraphQL in favor of REST. 2019-12-15 05:42:51 +01:00
ThePendulum fed2b0be8a When poster is not available during scraping, first photo is stored as poster; removed client-side fallback. Added screencap album fallback to Jules Jordan scraper. Simplified JJ page traversal. 2019-12-13 16:59:04 +01:00
ThePendulum c998fcf933 Added photo album support to Blowpass scraper. 2019-12-13 05:04:04 +01:00
ThePendulum e69b7744c8 Showing movie covers as poster when available. 2019-12-13 03:57:01 +01:00
ThePendulum 77307d2d13 Refactored media module to generalize avatar and poster storage into photo storage. 2019-12-13 03:28:52 +01:00
ThePendulum a03a00f5d9 Added Sperm Swallowers and The Ass Factory to Jules Jordan scraper. Added photo source. 2019-12-12 05:18:43 +01:00
ThePendulum 0b819713b5 Fixed off-by-one in photo plucker. Fixed source duplicate photo function not handling fallback sources. 2019-12-12 04:04:35 +01:00
ThePendulum a310f9bb1d Added support for release photo fallbacks. Limited photo fetching concurrency. Modifier XEmpire scraper for AllBlackX support and improved photo scraping. Added movie property to Evil Angel scraper. 2019-12-12 03:12:05 +01:00
ThePendulum b9af7255f6 Fixed release actor origin bug. 2019-12-11 05:15:23 +01:00
ThePendulum 18f37e3fbd Moved all tag photos to public asset directory. 2019-12-11 02:25:25 +01:00
ThePendulum b9bac6d8f9 Added Kelly Madison profile scraper. 2019-12-10 22:35:00 +01:00
ThePendulum 3956994580 Swapped poster and photo for Kelly Madison scraper. 2019-12-10 05:19:08 +01:00
ThePendulum 85e55eebaf Added Kelly Madison Media (Teen Fidelity) release scraper. 2019-12-10 05:10:08 +01:00
ThePendulum b6123b9418 Added source maps. Fixed DDFNetwork avatar and improved photo fetch error handling. 2019-12-10 00:30:55 +01:00
ThePendulum 04a89efa58 Refactored 21sextury scraper. 2019-12-09 05:00:49 +01:00
ThePendulum 222260d3cf Generalized tags to allow them to be assigned to anything. 2019-12-07 04:41:16 +01:00
ThePendulum 30f4a418e3 Allowing scrapers to return multiple trailer qualities, implemented for Brazzers. Removed tag and site matching from Brazzers scraper. 2019-12-07 04:17:14 +01:00
ThePendulum c4d620c6ff Refactored media module for better duplicate handling, readability and DRY. 2019-12-07 03:59:55 +01:00
ThePendulum 98b9c885ec Added support for Reality Kings sites 'Look At Her Now' and 'Tranny Surprise'. 2019-12-07 00:42:47 +01:00
ThePendulum 7cb888801f Updated Naughty America scraper, added media support.. 2019-12-05 04:26:54 +01:00
ThePendulum 2697aaa0af Removed release_date selection, not working as desired. Removed site and tag fetching from Kink scraper. 2019-12-05 01:33:57 +01:00
ThePendulum 71cb85c3e1 Allowing scrapers to return raw tags and site URLs or slugs, to gradually remove site and tag fetching from individual scrapers. Added media and deep fetchin support to Perv City scraper. 2019-12-05 01:26:22 +01:00
ThePendulum 55e3130062 Move tag posters and photos to media database. 2019-12-04 21:58:08 +01:00
ThePendulum cf81aa99e0 Added rudimentary tags page. Improved social match behavior. 2019-12-01 05:32:47 +01:00
ThePendulum bead69de49 Added basic actor and network overview. Added DDF Network actor scraper. Various bug fixes and layout improvements. 2019-11-30 05:55:32 +01:00
ThePendulum 0dbe853f39 Resolving actor birth and residence place before storage. Layout improvements. 2019-11-29 05:46:06 +01:00