Commit Graph

193 Commits

Author SHA1 Message Date
ThePendulum 1407700511 Added Interracial Pass sites. Fixed Hush removing poster from base release. 2020-03-05 17:07:07 +01:00
ThePendulum 981b121980 Split Hussie Pass into Hush networks Hush Pass, Hussie Pass and Interracial Pass. 2020-03-05 05:07:14 +01:00
ThePendulum f10e4af29b Allowing scrapers to force channel allocation attempt. Added Hush Pass subsite handling to Hussie Pass scraper. 2020-03-05 03:44:27 +01:00
ThePendulum 956afa6ae7 Added Hussie Pass scraper. 2020-03-05 02:47:52 +01:00
ThePendulum 15af3e91e0 Coalescing shoot ID in search. Added stop words for common TLDs. Sorting tags in search results. 2020-03-02 04:15:47 +01:00
ThePendulum e57f440665 Added Amateur Allure. 2020-03-01 05:28:08 +01:00
ThePendulum 3290a5f686 Focusing and auto-hiding search tooltip. Separated Girl Girl from Jules Jordan. 2020-03-01 00:21:54 +01:00
ThePendulum 8dd5925af6 Improved search engine query and added stop words. Added 'secondary' property to tag aliases, for tag aliases to be included in searches and alias lists. 2020-02-29 22:47:48 +01:00
ThePendulum f1f33080f6 Ignoring undefined video entropy. 2020-02-28 03:56:58 +01:00
ThePendulum 3dc8547431 Added fake data and Markov experiments. 2020-02-27 05:44:24 +01:00
ThePendulum 97cf5b2b6b Added seed file for test data. 2020-02-27 00:38:11 +01:00
ThePendulum 800a25743d Storing image dimensions and file size to database. Added new site Filthy Femdom to Kink. 2020-02-24 04:01:58 +01:00
ThePendulum 6d1f30f703 Passing matching site to profile scrapers. Allowing scrapers to pass avatar metadata. Added scraper and copyright properties to media. Auto-adding copyright from site or scraper to avatars. Separated Porn Pros from Whale Member. 2020-02-24 03:12:58 +01:00
ThePendulum 5acaa9c6bf Marked Metro HD sites as 'native' as to use site URL. 2020-02-23 22:07:35 +01:00
ThePendulum 0ede7e0f82 Added various Porn Pros archive sites. 2020-02-23 05:00:08 +01:00
ThePendulum e5c6ccd252 Scraping upcoming Vixen scenes. Fetching release media groups sequentially to prevent collisions. 2020-02-22 04:37:48 +01:00
ThePendulum 349a5a506e Queueing and batching media HTTP requests for improved reliability. 2020-02-22 03:22:30 +01:00
ThePendulum 13a8221b92 Added New Sensations. Returning null from q's date formatter when date is invalid. 2020-02-21 03:51:57 +01:00
ThePendulum 377970f874 Added parent-child relations to network, showing parent network in sidebar. Added Burning Angel using Gamma API. 2020-02-20 02:35:23 +01:00
ThePendulum 97f5e49187 Refactored media module. Returning 320p and 720p videos from MindGeek as teasers instead of trailers. 2020-02-19 04:41:53 +01:00
ThePendulum 40bf476ea6 Fixed Porn Pros scraper. Added various Score site logos. 2020-02-18 16:00:36 +01:00
ThePendulum 880cc64022 Added Full Porn Network scraper. 2020-02-15 01:50:22 +01:00
ThePendulum fe3cc901b0 Added PG site search function and enabled site search bar. Added Full Porn network assets. 2020-02-15 01:10:32 +01:00
ThePendulum 5e461f1f1a Added proper Gamma parameters to 21Sextury sites. 2020-02-13 23:05:28 +01:00
ThePendulum 1ff8d37d89 Added upcoming support to Nubiles. Renamed q's formatDate to extractDate, added actual formatDate. 2020-02-13 04:11:32 +01:00
ThePendulum c9c7a33585 Added Cherry Pimps/Pimp.XXX. 2020-02-13 03:44:04 +01:00
ThePendulum b7abd805e2 Added Girl Girl to Jules Jordan. 2020-02-12 23:49:22 +01:00
ThePendulum cd2ca65903 Added Nubiles network. 2020-02-12 23:00:32 +01:00
ThePendulum 98d29c0af0 Added Insex fallback for Paintoy. 2020-02-12 16:26:08 +01:00
ThePendulum 48b10d0f49 Using brief mode on Insex. 2020-02-12 04:59:15 +01:00
ThePendulum b8074205ef Added Insex. Renamed q's stand-alone date function. Separated q's trim function. Release tile uses cover if available, and poster is not available. 2020-02-12 04:39:57 +01:00
ThePendulum fa30366ea4 Moved site tags from tag seed to site seed. 2020-02-12 02:19:43 +01:00
ThePendulum 2f70de8e11 Added preflight method to scrapers. Added Assylum. 2020-02-12 01:54:54 +01:00
ThePendulum df4a2b0bb3 Fetching old scene links from Vivid search API. 2020-02-11 19:05:12 +01:00
ThePendulum dd6a1d9bfd Added Vivid network. Added ASMR Fantasy to Adult Time. Storing deep URL in database. Added href to header links. 2020-02-11 04:58:18 +01:00
ThePendulum ce448da7e0 Added 21 Naturals and 21 Sextreme sites. 2020-02-10 23:11:11 +01:00
ThePendulum 139f0ce7cb Allowing release scrapers to return actor details. Added True Amateurs. 2020-02-09 23:25:54 +01:00
ThePendulum 0f513266a0 Added Black for Wife to JayRock. Switched parameters field to JSON type. 2020-02-09 19:41:39 +01:00
ThePendulum e61ed2bb5f Added 21Sextreme and 21Naturals networks. Scraping all actor release pages for Brazzers. 2020-02-09 02:01:39 +01:00
ThePendulum 8ca458a8ff Added Moms on Moms to Girlsway. 2020-02-08 05:16:04 +01:00
ThePendulum d2cb74a252 Added Fantasy Massage sites. Improved Private scraper, added movie link. 2020-02-08 04:52:32 +01:00
ThePendulum 1546e0836c Split Girlsway from Adult Time. Added Fantasy Massage. Using Gamma scraper for Pure Taboo. Added photo path parameter to Gamma scraper. 2020-02-08 02:49:39 +01:00
ThePendulum 5ba308f07a Added Adult Time. Adding context to logger. 2020-02-07 19:53:16 +01:00
ThePendulum 6b56bad21e Added Twistys. 2020-02-07 04:44:01 +01:00
ThePendulum 30963b94dd Added profile releases for classic Fame Digital sites (Silvia Saint and Silverstone DVD). 2020-02-07 03:40:11 +01:00
ThePendulum 631ac34573 Blowpass now uses Gamma module for latest and upcoming. 2020-02-07 01:06:39 +01:00
ThePendulum 65f98c6387 Refactored 21Sextury module to use Gamma API. 2020-02-06 23:51:13 +01:00
ThePendulum 6e1de52a40 Added Fame Digital. Added actor release scraping to DDF Network. Improved q and Gamma scraper. 2020-02-06 23:15:28 +01:00
ThePendulum 38bab672d4 Better handling of empty profiles. Modified Score scraper for Big Tit Terry Nova. Improved Naughty America and various other logos. 2020-02-05 01:41:30 +01:00
ThePendulum f921bb4ae9 Generating and using URL slugs for releases, improver slugify module. Added 'extract' parameter to MindGeek scraper to get scenes not associate with a channel (see Digital Playground). Added various high res logos. 2020-02-04 03:12:09 +01:00
ThePendulum ef602a3a15 Added basic filename copy. Added HTTP helper to q. Fetching all actor release pages from Naughty America. Added various high res network logos. 2020-02-04 00:18:53 +01:00
ThePendulum 5bae5b6e5f Adapted Score scraper for 18eighteen, 40 Something Mag and 50 Plus Milfs. Updated Score network logo and favicon. 2020-02-03 02:57:53 +01:00
ThePendulum a671190fff Adapted Score scraper for Score Classics. 2020-02-03 02:04:47 +01:00
ThePendulum a45bebddac Adapter Score scraper for Score Videos. 2020-02-03 00:39:43 +01:00
ThePendulum 0ed1b2eff9 Added generic photo page extract method to media module, to allow pre-filtering sources and relief Dogfart scraper. Added 'transsexual' site tag to Trans Angels. 2020-02-02 22:36:33 +01:00
ThePendulum a97c6defca Added teaser support. Added Score network with scraper for Scoreland. Improved q. Added assets. 2020-02-02 05:14:58 +01:00
ThePendulum 94bf207397 Added Wicked network. Merged Evil Angel, XEmpire and Wicked into generic Gamma scraper. 2020-02-01 01:15:40 +01:00
ThePendulum b7f51a8deb Added avatar and actor releases to Bang Bros scraper. 2020-01-31 21:43:16 +01:00
ThePendulum 504bcd02e3 Added Naughty America profile and actor releases scraper. 2020-01-31 19:25:42 +01:00
ThePendulum 3f113310e3 Added Trans Angels to MindGeek. Interpreting MindGeek 'other' gender as transsexual. 2020-01-31 00:25:51 +01:00
ThePendulum ff61094b69 Added Men network and Icon Male to MindGeek. Added entropy filter to media module to help filter out generic avatars. Added Pure Taboo. Various logo updates. 2020-01-30 01:14:31 +01:00
ThePendulum d61ea26eb5 Added 'ignore' parameter to sites. Added light logo for Metro HD. 2020-01-29 04:02:32 +01:00
ThePendulum 8b840f52d1 Added description property to LegalPorno scraper (rarely used, see GIO337). 2020-01-29 03:19:38 +01:00
ThePendulum fc675ae144 Added Metro HD network using MindGeek scraper. Fixed MindGeek profile scraper avatar issue. 2020-01-29 02:24:19 +01:00
ThePendulum 76852daf6d Added VogoV (no trailer yet). Fixed MindGeek profile scraper. 2020-01-28 03:05:53 +01:00
ThePendulum 9db0e97512 Improved actor profile flow. Added images. 2020-01-23 03:52:12 +01:00
ThePendulum f8175f6054 Added generic Gamma photo and actor scraper for XEmpire, 21Sextury, Blowpass and Evil Angel. 2020-01-22 22:25:58 +01:00
ThePendulum 4074a5bb64 Added Mile High Media scraper. 2020-01-16 21:56:33 +01:00
ThePendulum 61fee5e4f6 Added q scraping helper. Added Perfect Gonzo scraper. 2020-01-16 21:04:44 +01:00
ThePendulum 5dda81535d Added PornPros satellite sites. 2020-01-15 01:01:16 +01:00
ThePendulum 75c53d338a Added Porn Pros sites and scraper. 2020-01-14 21:45:30 +01:00
ThePendulum 9255467091 Refactored MOFOS scraper to use generic MindGeek scraper. Added Digital Playground and Fake Hub. 2020-01-14 19:56:46 +01:00
ThePendulum ef76909d3c Merged Reality Kings and Babes into MindGeek scraper. Kept classic latest wrapper for Look At Her Now and Tranny Surprise. 2020-01-14 04:50:42 +01:00
ThePendulum 8c76568f44 Added Babes network 2020-01-14 01:50:11 +01:00
ThePendulum 859cb7e1f3 Added support for Family Strokes. 2020-01-13 23:45:09 +01:00
ThePendulum 97cb4a061e Added Team Skeet scraper. 2020-01-12 05:30:46 +01:00
ThePendulum 8f72e61928 Added Jay Rock network. Fixed site logo not showing up without URL. 2020-01-11 05:31:04 +01:00
ThePendulum f572f38b5c Added Jay's POV scraper. 2020-01-10 22:10:11 +01:00
ThePendulum 863df38b29 Simplified tag media seed file. Renamed tags. Media refactor experiment. 2020-01-08 23:33:24 +01:00
ThePendulum a773e0bf54 Added Manuel Ferrara site to Jules Jordan. Refactored Jules Jordan photo scraper for better compatability and quality. 2020-01-08 05:12:14 +01:00
ThePendulum 0a19f2e624 Added Bang! deep scrape. Improved network page layout. Added Bang Bros logos. 2020-01-07 04:23:28 +01:00
ThePendulum 9e6e5605ed Added favicons for all networks. Showing sites on dark background, lightened logos. Updated Kink logos. Changed Bang! studios to sites, removed studio prominence. 2020-01-06 21:49:37 +01:00
ThePendulum 5b118446ae Added Kosovo to countries. 2020-01-06 14:55:55 +01:00
ThePendulum bb5b8085f6 Added Bang! scraper. Showing studio on tile. Added favicons to tiles. 2020-01-06 05:19:38 +01:00
ThePendulum 30cf597ec9 Improving network overview. Added DDF logos and tag posters. 2020-01-04 04:58:56 +01:00
ThePendulum 72b175e9e2 Removed views in favor of PostGraphile filter and sort plugins. Updated site modules to GraphQL. Added tag posters. 2020-01-04 02:51:58 +01:00
ThePendulum 1c43884102 Refactoring client to reflect database changes. 2019-12-19 04:42:50 +01:00
ThePendulum 31aee71edb Normalized database. Updated seed files. Simplified seed upsert. 2019-12-19 02:35:07 +01:00
ThePendulum 6950a76cb5 Abstracted fragments and curation. Using GraphQL for tags. 2019-12-16 05:30:25 +01:00
ThePendulum 7ba716cd6f Experimenting using GraphQL in favor of REST. 2019-12-15 05:42:51 +01:00
ThePendulum a03a00f5d9 Added Sperm Swallowers and The Ass Factory to Jules Jordan scraper. Added photo source. 2019-12-12 05:18:43 +01:00
ThePendulum a310f9bb1d Added support for release photo fallbacks. Limited photo fetching concurrency. Modifier XEmpire scraper for AllBlackX support and improved photo scraping. Added movie property to Evil Angel scraper. 2019-12-12 03:12:05 +01:00
ThePendulum f251b0b17c Updated DAP and DATP posters. 2019-12-11 05:20:38 +01:00
ThePendulum b9af7255f6 Fixed release actor origin bug. 2019-12-11 05:15:23 +01:00
ThePendulum 18f37e3fbd Moved all tag photos to public asset directory. 2019-12-11 02:25:25 +01:00
ThePendulum 85e55eebaf Added Kelly Madison Media (Teen Fidelity) release scraper. 2019-12-10 05:10:08 +01:00
ThePendulum 04a89efa58 Refactored 21sextury scraper. 2019-12-09 05:00:49 +01:00
ThePendulum 222260d3cf Generalized tags to allow them to be assigned to anything. 2019-12-07 04:41:16 +01:00
ThePendulum 98b9c885ec Added support for Reality Kings sites 'Look At Her Now' and 'Tranny Surprise'. 2019-12-07 00:42:47 +01:00
ThePendulum a2925febeb Moved tag posters back to img/, as they are part of the project. Still using database to track which tags have a poster. 2019-12-06 05:09:08 +01:00