Commit Graph

593 Commits

Author SHA1 Message Date
0ede7e0f82 Added various Porn Pros archive sites. 2020-02-23 05:00:08 +01:00
74274f879e Re-added image entropy filter. 2020-02-22 23:50:25 +01:00
915eb75719 Refactored Vixen scraper, using API endpoint and added actor profile and releases scraper. Release scraper will return base release when present and 'deep' argument is false. 2020-02-22 23:25:10 +01:00
5e1a1005f1 Refactored Vixen scene scraper. Using better poster source for Vixen. Returning video as teaser instead of trailer. 2020-02-22 05:29:02 +01:00
e5c6ccd252 Scraping upcoming Vixen scenes. Fetching release media groups sequentially to prevent collisions. 2020-02-22 04:37:48 +01:00
349a5a506e Queueing and batching media HTTP requests for improved reliability. 2020-02-22 03:22:30 +01:00
13a8221b92 Added New Sensations. Returning null from q's date formatter when date is invalid. 2020-02-21 03:51:57 +01:00
7ac5a8e08c Catching media failures per batch. Refined teaser logging. 2020-02-20 22:27:00 +01:00
377970f874 Added parent-child relations to network, showing parent network in sidebar. Added Burning Angel using Gamma API. 2020-02-20 02:35:23 +01:00
2c490753a4 Removed stray console log from Gamma scraper. 2020-02-19 04:50:10 +01:00
8889ea5cf3 Using hasTeaser param instead of date comparison to skip upcoming release teasers in Gamma scraper. 2020-02-19 04:49:54 +01:00
372ff54261 Added teaser source to Gamma scraper. Not adding Gamma teaser for upcoming releases. 2020-02-19 04:47:20 +01:00
97f5e49187 Refactored media module. Returning 320p and 720p videos from MindGeek as teasers instead of trailers. 2020-02-19 04:41:53 +01:00
40bf476ea6 Fixed Porn Pros scraper. Added various Score site logos. 2020-02-18 16:00:36 +01:00
d1532e1bec Fixed scene URLs for Full Porn Network. 2020-02-15 02:47:50 +01:00
30e58fb397 Added actor description to Full Porn Network profile scraper. 2020-02-15 02:06:21 +01:00
b6fe91b016 Added profile avatar and release scraping to Full Porn Network. 2020-02-15 02:04:46 +01:00
880cc64022 Added Full Porn Network scraper. 2020-02-15 01:50:22 +01:00
5e461f1f1a Added proper Gamma parameters to 21Sextury sites. 2020-02-13 23:05:28 +01:00
1ff8d37d89 Added upcoming support to Nubiles. Renamed q's formatDate to extractDate, added actual formatDate. 2020-02-13 04:11:32 +01:00
c9c7a33585 Added Cherry Pimps/Pimp.XXX. 2020-02-13 03:44:04 +01:00
b7abd805e2 Added Girl Girl to Jules Jordan. 2020-02-12 23:49:22 +01:00
cd2ca65903 Added Nubiles network. 2020-02-12 23:00:32 +01:00
98d29c0af0 Added Insex fallback for Paintoy. 2020-02-12 16:26:08 +01:00
48b10d0f49 Using brief mode on Insex. 2020-02-12 04:59:15 +01:00
b8074205ef Added Insex. Renamed q's stand-alone date function. Separated q's trim function. Release tile uses cover if available, and poster is not available. 2020-02-12 04:39:57 +01:00
2f70de8e11 Added preflight method to scrapers. Added Assylum. 2020-02-12 01:54:54 +01:00
df4a2b0bb3 Fetching old scene links from Vivid search API. 2020-02-11 19:05:12 +01:00
dd6a1d9bfd Added Vivid network. Added ASMR Fantasy to Adult Time. Storing deep URL in database. Added href to header links. 2020-02-11 04:58:18 +01:00
ce448da7e0 Added 21 Naturals and 21 Sextreme sites. 2020-02-10 23:11:11 +01:00
139f0ce7cb Allowing release scrapers to return actor details. Added True Amateurs. 2020-02-09 23:25:54 +01:00
0f513266a0 Added Black for Wife to JayRock. Switched parameters field to JSON type. 2020-02-09 19:41:39 +01:00
9d9eda29be Added scene count to actor inspect. Preferring network slug over data brand for scene URLs in MindGeek scraper, since milehighmedia.com's brand is milehigh, resulting in milehigh.com. 2020-02-09 03:09:06 +01:00
e61ed2bb5f Added 21Sextreme and 21Naturals networks. Scraping all actor release pages for Brazzers. 2020-02-09 02:01:39 +01:00
8ca458a8ff Added Moms on Moms to Girlsway. 2020-02-08 05:16:04 +01:00
d2cb74a252 Added Fantasy Massage sites. Improved Private scraper, added movie link. 2020-02-08 04:52:32 +01:00
1546e0836c Split Girlsway from Adult Time. Added Fantasy Massage. Using Gamma scraper for Pure Taboo. Added photo path parameter to Gamma scraper. 2020-02-08 02:49:39 +01:00
5ba308f07a Added Adult Time. Adding context to logger. 2020-02-07 19:53:16 +01:00
6b56bad21e Added Twistys. 2020-02-07 04:44:01 +01:00
30963b94dd Added profile releases for classic Fame Digital sites (Silvia Saint and Silverstone DVD). 2020-02-07 03:40:11 +01:00
be5dd4acd8 Added actor release URL resolver for Peter North on Fame Digital. 2020-02-07 01:59:43 +01:00
ea9c2dfe67 Scraping all actor release pages for Gamma. Improved actor matching for Gamma API. 2020-02-07 01:48:21 +01:00
631ac34573 Blowpass now uses Gamma module for latest and upcoming. 2020-02-07 01:06:39 +01:00
be83505ecf Added channel support to Gamma scene scraper. 2020-02-06 23:59:32 +01:00
44f0064b42 Cleaned up Gamma profile scraper. 2020-02-06 23:52:00 +01:00
65f98c6387 Refactored 21Sextury module to use Gamma API. 2020-02-06 23:51:13 +01:00
6e1de52a40 Added Fame Digital. Added actor release scraping to DDF Network. Improved q and Gamma scraper. 2020-02-06 23:15:28 +01:00
054dfba6b5 Fixed Score module to scrape releases for actors with just one page. 2020-02-06 00:22:31 +01:00
d4801bb240 Returning window.document instead of element as document from q. Fixed actor collisions when scrapers return same scene multiple times. Scraping all Score actor release pages. Fixed 21Sextury and PureTaboo photo scraping. 2020-02-05 23:57:55 +01:00
38bab672d4 Better handling of empty profiles. Modified Score scraper for Big Tit Terry Nova. Improved Naughty America and various other logos. 2020-02-05 01:41:30 +01:00