Commit Graph

411 Commits

Author SHA1 Message Date
ThePendulum 50154baa40 Changed entity logo thumbnails from x80 (height) to 300x (width) for improved sharpness in square logos. 2020-07-07 19:33:07 +02:00
ThePendulum 0fd1edd8fd Added Teen Core Club profile scraper. Added all TCC channels. Added various TCC logos. 2020-07-07 04:37:12 +02:00
ThePendulum f4ef2d4cc2 Auto-shrinking pagination. Various Teen Core Club curations. 2020-07-05 04:10:35 +02:00
ThePendulum c47fae3a1b Setting composed title as page title. Using Teen Core Club title if it isn't shoot ID. 2020-07-03 04:42:20 +02:00
ThePendulum 945c2c45ce Updated tag page layout. Added shoot date property. Showing parent favicon on compact entity page. Re-added 'new' indicator on tile. Added Family Sinner to Mile High Media. Various fixes and improvements. 2020-07-03 01:28:22 +02:00
ThePendulum 749864e922 Added 'independent' property for network-like channels. Changed release tile design. Adding Brazzers timeline events as tags. Added Property Sex to MindGeek. Changed DP, DAP and DVP tag slugs. Changed Porn Pros logo. Added better BAM Visions and Mug Fucked logos. 2020-07-02 04:04:28 +02:00
ThePendulum 98c19b560f Updated mindgeek scraper for entities. Various fixes. 2020-06-28 22:29:18 +02:00
ThePendulum 3462d7af2a Entity refactor. Facilitating channels without parent. 2020-06-28 00:15:13 +02:00
ThePendulum 0e8b4caac3 Added generic entity page. 2020-06-27 04:50:13 +02:00
ThePendulum af56378ee2 Refactored various modules for entities. Updated and refactored Kink scraper. 2020-06-27 02:57:30 +02:00
ThePendulum 4959dfd14f Refactored deep and store modules to use entities. 2020-06-25 02:26:25 +02:00
ThePendulum 1907ce1e54 Changed sites from argument query to group by network. 2020-06-15 03:58:35 +02:00
ThePendulum 79465d9634 Added Teen Core Club. Changed network to entity in GraphQL query. 2020-06-08 03:41:12 +02:00
ThePendulum 8abcc7194a Updated Full Porn Network scraper. 2020-05-29 22:43:03 +02:00
ThePendulum 88a88227c4 Applying tag filters to URL. 2020-05-27 01:40:10 +02:00
ThePendulum 86377fec5f Enabled pagination on network page. 2020-05-26 04:11:29 +02:00
ThePendulum fe69ec4175 Added new tag filter stub. 2020-05-25 04:39:58 +02:00
ThePendulum b180572d5f Changed sort filters to tabs. 2020-05-25 02:02:28 +02:00
ThePendulum f4c85b7a67 Updated tags and posters. 2020-05-24 05:14:01 +02:00
ThePendulum 9843023c1f Added Filthy Family and 'legacy' scraper to Bang Bros. Added trans generic avatar. Added pagination support to site actions. 2020-05-24 03:54:29 +02:00
ThePendulum 75d49517b7 Added pagination to actor overview. Lazy loading actor avatars. Reduced hash digest length. 2020-05-23 04:32:50 +02:00
ThePendulum f38be7a706 Added components. 2020-05-22 00:55:11 +02:00
ThePendulum 532a4b679b Using batch insert for profiles to prevent errors on large inserts. 2020-05-21 03:44:44 +02:00
ThePendulum 7275fb10e3 Improved Gamma scraper for (XEmpire) actors. 2020-05-20 03:00:46 +02:00
ThePendulum 057362d011 Added basic release and actor API. 2020-05-20 01:11:32 +02:00
ThePendulum 6973d39cbd Replacing one or multiple space-like characters with single space in actor description. Using logo thumbnails in descriptions. 2020-05-19 05:06:01 +02:00
ThePendulum 52ce2934ac Hiding profile descriptions in compact mode. 2020-05-19 04:51:47 +02:00
ThePendulum c0898b84d6 Showing all unique descriptions on profile with network logo. Fixed Fame Digital scraper. 2020-05-19 04:46:49 +02:00
ThePendulum 0c4628677f Fixed profile location interpolation. Generalizing ethnicity, hair color and eye color. 2020-05-19 01:10:32 +02:00
ThePendulum 4826ae8571 Added oil tag. Removed Fame Digital from profile config. 2020-05-18 04:28:38 +02:00
ThePendulum 8733fdc657 Improved actor scraping and display. 2020-05-18 01:22:56 +02:00
ThePendulum 05ee57378a Storing actor avatars. Using 1 second interval queue for location resolve as per OSM code of conduct. 2020-05-16 04:36:45 +02:00
ThePendulum 21d4dd6bfa Scraping and storing actor profiles. 2020-05-15 04:40:59 +02:00
ThePendulum 11eb66f834 Switched to tabs. Adding missing actor entries when scraping actors, with batch ID. 2020-05-14 04:26:05 +02:00
ThePendulum f1eb29c713 Added thumb and lazy image scripts. Added FreeOnes and Boobpedia as sites. 2020-05-13 23:17:39 +02:00
ThePendulum dac451bb86 Using alias actor ID when available. Using basic SVG flags instead of PNG. Moved PNG and HD SVG flags to assets. 2020-05-13 20:27:06 +02:00
ThePendulum 6040a3f41f Associating actors without network. 2020-05-13 02:56:20 +02:00
ThePendulum af9d8f7858 Drastically improved memory performance media module using streams and temp files. 2020-05-07 01:53:07 +02:00
ThePendulum e3dfaf4440 Staging release media store by role. 2020-04-16 16:24:59 +02:00
ThePendulum fc58850e56 Added media limit sampling. 2020-04-11 22:49:37 +02:00
ThePendulum cb68319ac0 Added lazy loading to tag photos. Changed tag thumb location. 2020-04-08 14:50:43 +02:00
ThePendulum 24b297011e Added various tag posters. 2020-04-02 04:05:55 +02:00
ThePendulum ad7874649f Added self hash filtering to media module. Moved Girl Girl back to Jules Jordan. 2020-04-02 01:10:50 +02:00
ThePendulum a5d859471d Added Jesse Loads Monster Facials. Added various logos. 2020-03-29 23:42:41 +02:00
ThePendulum 93d4f0ff1a Added WIP media module. Returning releases from release search database function. Fixed page loop in update module. 2020-03-29 04:00:46 +02:00
ThePendulum 95d115b585 Added Aziani. Added URL origin parameter to relevant qu methods. 2020-03-28 01:40:02 +01:00
ThePendulum fb59bf552a Added actor assignment to new actors module. Showing network icon on network-specific actors. Improved dark theme. Changed tag tile design. Added Digital Playground logos. 2020-03-27 04:39:13 +01:00
ThePendulum bb3f6fc408 Added more SFW photos. 2020-03-25 04:25:10 +01:00
ThePendulum 15a386ad05 Added compact sidebar. Added tag sections and posters. 2020-03-25 02:48:54 +01:00
ThePendulum d724f96728 Added new actors module boilerplate. Added tag posters. 2020-03-24 03:48:24 +01:00
ThePendulum aa488cc6e3 Changed tags on tag overview. 2020-03-23 04:58:23 +01:00
ThePendulum 58ead7b426 Added dark and SFW modes. 2020-03-23 01:43:49 +01:00
ThePendulum fdb2b132f6 Improved release storage module. Added new tags module. Added movie scraping. 2020-03-22 03:50:24 +01:00
ThePendulum d765543b30 Improved update runner. Improved HTTP module API, added default user agent. Added PornCZ and Czechav logos. 2020-03-21 02:48:24 +01:00
ThePendulum 4b310e9dfa Added configurable proxy to HTTP module (also used by qu). Added network and site URL to search documents. 2020-03-19 01:54:25 +01:00
ThePendulum 0f09fd53eb Refactoring deep scrape. Added tag posters. 2020-03-16 04:10:52 +01:00
ThePendulum 4fc0053bd9 Added tag photo directories to repo. 2020-03-13 21:59:44 +01:00
ThePendulum 8d484ba728 Added tag photos. Auto-adding BTS tag to BAM Visions scenes. 2020-03-13 21:54:44 +01:00
ThePendulum 8e4573e5ad Retouched BAM Visions logo. 2020-03-12 02:35:14 +01:00
ThePendulum 37e188a0df Added site aliases. Migrated various scrapers to qu. Added BAM Visions base. 2020-03-12 00:15:25 +01:00
ThePendulum cd12b53071 Added SexyHub. Added favicon. 2020-03-07 04:27:20 +01:00
ThePendulum aad91fe4ae Added Girls Under Arrest to Adult Time. Added mobile album support to some Girlsway sites. Fixed Moms On Moms link. 2020-03-06 23:40:15 +01:00
ThePendulum db01599569 Added profile scraper with releases to Hush. Added qtexts to q to return text nodes individually. Including network in profile site. 2020-03-06 02:49:55 +01:00
ThePendulum 1407700511 Added Interracial Pass sites. Fixed Hush removing poster from base release. 2020-03-05 17:07:07 +01:00
ThePendulum 981b121980 Split Hussie Pass into Hush networks Hush Pass, Hussie Pass and Interracial Pass. 2020-03-05 05:07:14 +01:00
ThePendulum 956afa6ae7 Added Hussie Pass scraper. 2020-03-05 02:47:52 +01:00
ThePendulum 46d978fe29 Added application avatars. 2020-03-02 03:59:47 +01:00
ThePendulum e57f440665 Added Amateur Allure. 2020-03-01 05:28:08 +01:00
ThePendulum 3290a5f686 Focusing and auto-hiding search tooltip. Separated Girl Girl from Jules Jordan. 2020-03-01 00:21:54 +01:00
ThePendulum 638a71f36c Added rudimentary release search. 2020-02-26 01:15:50 +01:00
ThePendulum 800a25743d Storing image dimensions and file size to database. Added new site Filthy Femdom to Kink. 2020-02-24 04:01:58 +01:00
ThePendulum 6d1f30f703 Passing matching site to profile scrapers. Allowing scrapers to pass avatar metadata. Added scraper and copyright properties to media. Auto-adding copyright from site or scraper to avatars. Separated Porn Pros from Whale Member. 2020-02-24 03:12:58 +01:00
ThePendulum 0ede7e0f82 Added various Porn Pros archive sites. 2020-02-23 05:00:08 +01:00
ThePendulum 13a8221b92 Added New Sensations. Returning null from q's date formatter when date is invalid. 2020-02-21 03:51:57 +01:00
ThePendulum 377970f874 Added parent-child relations to network, showing parent network in sidebar. Added Burning Angel using Gamma API. 2020-02-20 02:35:23 +01:00
ThePendulum 97f5e49187 Refactored media module. Returning 320p and 720p videos from MindGeek as teasers instead of trailers. 2020-02-19 04:41:53 +01:00
ThePendulum 86a2c8f0f5 Re-added background to Porn Pros network logo. 2020-02-18 16:05:15 +01:00
ThePendulum 40bf476ea6 Fixed Porn Pros scraper. Added various Score site logos. 2020-02-18 16:00:36 +01:00
ThePendulum 880cc64022 Added Full Porn Network scraper. 2020-02-15 01:50:22 +01:00
ThePendulum fe3cc901b0 Added PG site search function and enabled site search bar. Added Full Porn network assets. 2020-02-15 01:10:32 +01:00
ThePendulum c9c7a33585 Added Cherry Pimps/Pimp.XXX. 2020-02-13 03:44:04 +01:00
ThePendulum b7abd805e2 Added Girl Girl to Jules Jordan. 2020-02-12 23:49:22 +01:00
ThePendulum cd2ca65903 Added Nubiles network. 2020-02-12 23:00:32 +01:00
ThePendulum 98d29c0af0 Added Insex fallback for Paintoy. 2020-02-12 16:26:08 +01:00
ThePendulum b8074205ef Added Insex. Renamed q's stand-alone date function. Separated q's trim function. Release tile uses cover if available, and poster is not available. 2020-02-12 04:39:57 +01:00
ThePendulum 2f70de8e11 Added preflight method to scrapers. Added Assylum. 2020-02-12 01:54:54 +01:00
ThePendulum dd6a1d9bfd Added Vivid network. Added ASMR Fantasy to Adult Time. Storing deep URL in database. Added href to header links. 2020-02-11 04:58:18 +01:00
ThePendulum ce448da7e0 Added 21 Naturals and 21 Sextreme sites. 2020-02-10 23:11:11 +01:00
ThePendulum 139f0ce7cb Allowing release scrapers to return actor details. Added True Amateurs. 2020-02-09 23:25:54 +01:00
ThePendulum 0f513266a0 Added Black for Wife to JayRock. Switched parameters field to JSON type. 2020-02-09 19:41:39 +01:00
ThePendulum e61ed2bb5f Added 21Sextreme and 21Naturals networks. Scraping all actor release pages for Brazzers. 2020-02-09 02:01:39 +01:00
ThePendulum 8ca458a8ff Added Moms on Moms to Girlsway. 2020-02-08 05:16:04 +01:00
ThePendulum 1546e0836c Split Girlsway from Adult Time. Added Fantasy Massage. Using Gamma scraper for Pure Taboo. Added photo path parameter to Gamma scraper. 2020-02-08 02:49:39 +01:00
ThePendulum 5ba308f07a Added Adult Time. Adding context to logger. 2020-02-07 19:53:16 +01:00
ThePendulum 6b56bad21e Added Twistys. 2020-02-07 04:44:01 +01:00
ThePendulum 30963b94dd Added profile releases for classic Fame Digital sites (Silvia Saint and Silverstone DVD). 2020-02-07 03:40:11 +01:00
ThePendulum 6e1de52a40 Added Fame Digital. Added actor release scraping to DDF Network. Improved q and Gamma scraper. 2020-02-06 23:15:28 +01:00
ThePendulum 38bab672d4 Better handling of empty profiles. Modified Score scraper for Big Tit Terry Nova. Improved Naughty America and various other logos. 2020-02-05 01:41:30 +01:00
ThePendulum e6dbb60e4a Added various higher quality logos. 2020-02-04 04:07:49 +01:00
ThePendulum f921bb4ae9 Generating and using URL slugs for releases, improver slugify module. Added 'extract' parameter to MindGeek scraper to get scenes not associate with a channel (see Digital Playground). Added various high res logos. 2020-02-04 03:12:09 +01:00
ThePendulum ef602a3a15 Added basic filename copy. Added HTTP helper to q. Fetching all actor release pages from Naughty America. Added various high res network logos. 2020-02-04 00:18:53 +01:00
ThePendulum 5bae5b6e5f Adapted Score scraper for 18eighteen, 40 Something Mag and 50 Plus Milfs. Updated Score network logo and favicon. 2020-02-03 02:57:53 +01:00
ThePendulum a97c6defca Added teaser support. Added Score network with scraper for Scoreland. Improved q. Added assets. 2020-02-02 05:14:58 +01:00
ThePendulum 94bf207397 Added Wicked network. Merged Evil Angel, XEmpire and Wicked into generic Gamma scraper. 2020-02-01 01:15:40 +01:00
ThePendulum 504bcd02e3 Added Naughty America profile and actor releases scraper. 2020-01-31 19:25:42 +01:00
ThePendulum 3f113310e3 Added Trans Angels to MindGeek. Interpreting MindGeek 'other' gender as transsexual. 2020-01-31 00:25:51 +01:00
ThePendulum ff61094b69 Added Men network and Icon Male to MindGeek. Added entropy filter to media module to help filter out generic avatars. Added Pure Taboo. Various logo updates. 2020-01-30 01:14:31 +01:00
ThePendulum d61ea26eb5 Added 'ignore' parameter to sites. Added light logo for Metro HD. 2020-01-29 04:02:32 +01:00
ThePendulum 8b840f52d1 Added description property to LegalPorno scraper (rarely used, see GIO337). 2020-01-29 03:19:38 +01:00
ThePendulum fc675ae144 Added Metro HD network using MindGeek scraper. Fixed MindGeek profile scraper avatar issue. 2020-01-29 02:24:19 +01:00
ThePendulum 76852daf6d Added VogoV (no trailer yet). Fixed MindGeek profile scraper. 2020-01-28 03:05:53 +01:00
ThePendulum 9db0e97512 Improved actor profile flow. Added images. 2020-01-23 03:52:12 +01:00
ThePendulum b92b9f3e18 Fixed actor avatar duplicates. Added new Jules Jordan logo. 2020-01-22 23:17:39 +01:00
ThePendulum 4074a5bb64 Added Mile High Media scraper. 2020-01-16 21:56:33 +01:00
ThePendulum 61fee5e4f6 Added q scraping helper. Added Perfect Gonzo scraper. 2020-01-16 21:04:44 +01:00
ThePendulum 5dda81535d Added PornPros satellite sites. 2020-01-15 01:01:16 +01:00
ThePendulum 75c53d338a Added Porn Pros sites and scraper. 2020-01-14 21:45:30 +01:00
ThePendulum 9255467091 Refactored MOFOS scraper to use generic MindGeek scraper. Added Digital Playground and Fake Hub. 2020-01-14 19:56:46 +01:00
ThePendulum f5704451f8 Wrapping up 2020-01-14 01:51:18 +01:00
ThePendulum 859cb7e1f3 Added support for Family Strokes. 2020-01-13 23:45:09 +01:00
ThePendulum 97cb4a061e Added Team Skeet scraper. 2020-01-12 05:30:46 +01:00
ThePendulum 8f72e61928 Added Jay Rock network. Fixed site logo not showing up without URL. 2020-01-11 05:31:04 +01:00
ThePendulum f572f38b5c Added Jay's POV scraper. 2020-01-10 22:10:11 +01:00
ThePendulum 4b36de2f55 Fixed Evil Angel upcoming and actor association issues. Moving from console.log to logger. 2020-01-10 02:43:04 +01:00
ThePendulum 863df38b29 Simplified tag media seed file. Renamed tags. Media refactor experiment. 2020-01-08 23:33:24 +01:00
ThePendulum 4c28c8b640 Fixed duplicate query. Updated Jules Jordan logo's. 2020-01-08 19:23:50 +01:00
ThePendulum a773e0bf54 Added Manuel Ferrara site to Jules Jordan. Refactored Jules Jordan photo scraper for better compatability and quality. 2020-01-08 05:12:14 +01:00
ThePendulum 0a19f2e624 Added Bang! deep scrape. Improved network page layout. Added Bang Bros logos. 2020-01-07 04:23:28 +01:00
ThePendulum 89064e9e0c Simplified single-site network overview. Added Jules Jordan favicons. 2020-01-07 00:30:51 +01:00
ThePendulum 9e6e5605ed Added favicons for all networks. Showing sites on dark background, lightened logos. Updated Kink logos. Changed Bang! studios to sites, removed studio prominence. 2020-01-06 21:49:37 +01:00
ThePendulum 5b118446ae Added Kosovo to countries. 2020-01-06 14:55:55 +01:00
ThePendulum bb5b8085f6 Added Bang! scraper. Showing studio on tile. Added favicons to tiles. 2020-01-06 05:19:38 +01:00
ThePendulum 30cf597ec9 Improving network overview. Added DDF logos and tag posters. 2020-01-04 04:58:56 +01:00
ThePendulum 72b175e9e2 Removed views in favor of PostGraphile filter and sort plugins. Updated site modules to GraphQL. Added tag posters. 2020-01-04 02:51:58 +01:00
ThePendulum a03a00f5d9 Added Sperm Swallowers and The Ass Factory to Jules Jordan scraper. Added photo source. 2019-12-12 05:18:43 +01:00
ThePendulum a310f9bb1d Added support for release photo fallbacks. Limited photo fetching concurrency. Modifier XEmpire scraper for AllBlackX support and improved photo scraping. Added movie property to Evil Angel scraper. 2019-12-12 03:12:05 +01:00
ThePendulum a11a141fda Fixed broken DAP thumb. 2019-12-11 05:23:53 +01:00
ThePendulum f251b0b17c Updated DAP and DATP posters. 2019-12-11 05:20:38 +01:00
ThePendulum b9af7255f6 Fixed release actor origin bug. 2019-12-11 05:15:23 +01:00
ThePendulum 18f37e3fbd Moved all tag photos to public asset directory. 2019-12-11 02:25:25 +01:00
ThePendulum 85e55eebaf Added Kelly Madison Media (Teen Fidelity) release scraper. 2019-12-10 05:10:08 +01:00
ThePendulum 04a89efa58 Refactored 21sextury scraper. 2019-12-09 05:00:49 +01:00
ThePendulum 98b9c885ec Added support for Reality Kings sites 'Look At Her Now' and 'Tranny Surprise'. 2019-12-07 00:42:47 +01:00
ThePendulum a2925febeb Moved tag posters back to img/, as they are part of the project. Still using database to track which tags have a poster. 2019-12-06 05:09:08 +01:00
ThePendulum 7cb888801f Updated Naughty America scraper, added media support.. 2019-12-05 04:26:54 +01:00
ThePendulum 55e3130062 Move tag posters and photos to media database. 2019-12-04 21:58:08 +01:00
ThePendulum cf81aa99e0 Added rudimentary tags page. Improved social match behavior. 2019-12-01 05:32:47 +01:00
ThePendulum bead69de49 Added basic actor and network overview. Added DDF Network actor scraper. Various bug fixes and layout improvements. 2019-11-30 05:55:32 +01:00
ThePendulum 0dbe853f39 Resolving actor birth and residence place before storage. Layout improvements. 2019-11-29 05:46:06 +01:00
ThePendulum 4be508b388 Drastic actor page redesign. Storing one avatar per actor, other profile photos as 'photo' role; no longer assuming first photo is avatar. 2019-11-28 05:36:22 +01:00
ThePendulum d113123778 Fixed countries seed file. Updated MOFOS scraper. Improved Reality Kings scraper. Limiting photos for XEmpire scraper. 2019-11-27 04:58:38 +01:00
ThePendulum e8130c3634 Scraping actor profiles from FreeOnes. 2019-11-17 03:56:45 +01:00
ThePendulum b489c8fc33 Major refactor, cleand up site scrape module, fixed and cleaned up release scrape module. Removed old CLI code 2019-11-16 03:33:36 +01:00
ThePendulum bf223adc55 Redesigned release page. Added 'single site' marker, linking directly to network page. Fixed Dogfart scraper duration. 2019-11-14 05:13:38 +01:00
ThePendulum 117d669a69 Added Private Black, improved Private scraper to handle their non-private.com sites. 2019-11-14 00:00:29 +01:00
ThePendulum f9f9cc7977 Added tag filter to releases query, enabled on homepage. 2019-11-13 03:14:24 +01:00
ThePendulum 832e96ced1 Improved site and network pages. Fixed various issues. 2019-11-12 01:22:20 +01:00
ThePendulum 681f1bca85 Added tag page. Added default 'anal' tag to Vixen scraper for Tushy and Tushy Raw. 2019-11-11 05:18:28 +01:00
ThePendulum 50816d7b28 Generating thumbnails. Added site overview page. 2019-11-11 03:20:00 +01:00
ThePendulum 6ed484af76 Moved icons into network directories. Improved network logo handling. 2019-11-10 04:47:41 +01:00
ThePendulum a9b91ff76c Added actors page. Added site logos with overview on network page. 2019-11-10 04:20:22 +01:00