Commit Graph
100 Commits
Author SHA1 Message Date
DebaucheryLibrarian 07f0249717 Upgraded pg, knex and postgraphile. Updated nvmrc version to latest node LTS. Fixed Gamma scraper not passing request headers to new http module. 2020-12-14 03:16:47 +01:00
DebaucheryLibrarian 80b0f9ee0f 1.145.0 2020-12-05 02:44:54 +01:00
DebaucheryLibrarian 71196688ae Removed console log. 2020-12-05 02:44:39 +01:00
DebaucheryLibrarian f0bec85ef8 Added Fuck'n'Drive and Jizz On Teens latest layouts to First Anal Quest scraper. 2020-12-05 02:24:31 +01:00
DebaucheryLibrarian 2e0fba3de9 Added First Anal Quest and Double View Casting profile scrapers. 2020-12-04 23:53:20 +01:00
DebaucheryLibrarian be1821b9eb Changed --inspect to --report to avoid conflict with Node's own debug tools. 2020-12-02 21:26:55 +01:00
DebaucheryLibrarian f5939c81d3 1.144.0 2020-12-02 03:17:42 +01:00
DebaucheryLibrarian 2656e3adb0 Added First Anal Quest and Double View Casting latest and scene scraper. 2020-12-02 03:17:32 +01:00
DebaucheryLibrarian bfbfa761ef 1.143.2 2020-12-01 23:00:24 +01:00
DebaucheryLibrarian 6f19a8a642 Using ageFromBirth for age on scene date. Using infinite depth and colors for inspect. 2020-12-01 23:00:14 +01:00
DebaucheryLibrarian bfbd2ddc00 1.143.1 2020-11-30 03:09:37 +01:00
DebaucheryLibrarian eaa40190cc Fixed entity link in search results. 2020-11-30 03:09:31 +01:00
DebaucheryLibrarian 2758b90019 1.143.0 2020-11-29 04:00:12 +01:00
DebaucheryLibrarian 9a61d2305c Added fixed actor age. Added male profiles to Littlr Caprice Dreams scraper. Added various tag photos. 2020-11-29 03:59:47 +01:00
DebaucheryLibrarian 71c884fe48 Improved Little Caprice Dreams scraper. 2020-11-28 00:46:30 +01:00
DebaucheryLibrarian 9a183c7ffb Added channel matching to Little Caprice Dreams. 2020-11-27 03:23:12 +01:00
DebaucheryLibrarian 60485751e2 Added support for upcoming scenes to Bang scraper. 2020-11-26 22:07:54 +01:00
DebaucheryLibrarian 4e559f63e3 Including all children of included networks, separated included children into dedicated property. 2020-11-26 04:26:52 +01:00
DebaucheryLibrarian 1b407254a7 Increased hard limit in release API. 2020-11-26 04:01:01 +01:00
DebaucheryLibrarian 0b86def315 Ignoring non-scene page (possible CF or similar protection) in Vixen scraper. 2020-11-26 03:27:21 +01:00
DebaucheryLibrarian 6633ce78d0 Returning empty array instead of null from empty Vixen page. 2020-11-26 03:14:32 +01:00
DebaucheryLibrarian 54df9d0c78 Fixed empty page breaking Vixen scraper. 2020-11-26 03:13:43 +01:00
DebaucheryLibrarian 980efbc93d Added series as channels with logos and photo album scraping to Little Caprice. Added various tag photos. 2020-11-24 04:29:44 +01:00
DebaucheryLibrarian 711a9441a6 Added Little Caprice Dreams scraped (WIP). 2020-11-23 04:32:56 +01:00
DebaucheryLibrarian eae9ee3cbe 1.142.2 2020-11-23 00:38:30 +01:00
DebaucheryLibrarian 8688c28d0f Replaced queueMethod in media sources for new interval/concurrency options. 2020-11-23 00:38:22 +01:00
DebaucheryLibrarian aa1bba84aa 1.142.1 2020-11-23 00:30:28 +01:00
DebaucheryLibrarian ca7c8f0afd Updated place resolve module to use new HTTP module. 2020-11-23 00:30:20 +01:00
DebaucheryLibrarian d4c5da2a76 1.142.0 2020-11-23 00:05:16 +01:00
DebaucheryLibrarian 0633197793 Removed direct bhttp usage from scrapers in favor of local http module. Deleted legacy scrapers, as old code is available via git repo history. 2020-11-23 00:05:02 +01:00
DebaucheryLibrarian 3d427f7e1d Allowing HTTP rate limits to be set by configuration or argument. 2020-11-22 23:50:24 +01:00
DebaucheryLibrarian 6a5063cf32 Fixed PornCZ scene photos attribute. 2020-11-22 04:13:21 +01:00
DebaucheryLibrarian 081a5a1e8c Updated HTTP call in Gamma scraper. 2020-11-22 04:09:44 +01:00
DebaucheryLibrarian b9b777c621 Using new HTTP module with a dynamic rate limiter. 2020-11-22 04:07:09 +01:00
DebaucheryLibrarian 5d0fe44130 1.141.2 2020-11-19 02:01:24 +01:00
DebaucheryLibrarian 77f9193669 Updated Dorcel scraper, added movie support. 2020-11-19 02:01:13 +01:00
DebaucheryLibrarian ecc90be12c 1.141.1 2020-11-15 23:50:11 +01:00
DebaucheryLibrarian d14ef90136 Scraping actor scenes from Hussie Pass. Adding entity to actor base releases. 2020-11-15 23:50:04 +01:00
DebaucheryLibrarian b952b758d7 1.141.0 2020-11-15 04:33:40 +01:00
DebaucheryLibrarian df9a6eac05 Updated Hussie Pass scraper for new site design. Added cock size to profiles. 2020-11-15 04:33:24 +01:00
DebaucheryLibrarian b3a5d7f379 Fixed JayRock status response, 2020-11-13 01:23:06 +01:00
DebaucheryLibrarian cc7c9f3b31 1.140.2 2020-11-13 01:16:27 +01:00
DebaucheryLibrarian 8a22ff07a6 Merged legacy JayRock scraper into new scraper for CosPimps. 2020-11-13 01:16:17 +01:00
DebaucheryLibrarian 2063d66550 Ignoring placeholder avatar in Jay Rock scraper. 2020-11-10 22:44:15 +01:00
DebaucheryLibrarian e698146d94 1.140.1 2020-11-05 02:22:23 +01:00
DebaucheryLibrarian 4408507371 Added creampie tag photo. 2020-11-05 02:22:15 +01:00
DebaucheryLibrarian 574f53c66d 1.140.0 2020-11-04 04:03:02 +01:00
DebaucheryLibrarian a3c18ca577 Rewrote Jay Rock scraper for new website. 2020-11-04 04:02:51 +01:00
DebaucheryLibrarian ec7acd46a0 1.139.7 2020-11-03 03:36:43 +01:00
DebaucheryLibrarian 6976eb337d Added various tag photos. 2020-11-03 03:36:34 +01:00
DebaucheryLibrarian 994413c509 1.139.6 2020-11-02 04:55:16 +01:00
DebaucheryLibrarian 0078dba085 Added various tag photos. 2020-11-02 04:49:16 +01:00
DebaucheryLibrarian 9a636b81a6 1.139.5 2020-11-01 05:25:38 +01:00
DebaucheryLibrarian 734de26559 Added various tag photos. 2020-11-01 05:25:29 +01:00
DebaucheryLibrarian aa5e9a9c8b 1.139.4 2020-11-01 03:25:37 +01:00
DebaucheryLibrarian 8586817963 Fixed Insex html table selector. 2020-11-01 03:25:30 +01:00
DebaucheryLibrarian ccca6a7714 1.139.3 2020-11-01 02:58:29 +01:00
DebaucheryLibrarian c1fffe5cdb Added alternative layout to Insex for updated Topgrl and Sexually Broken sites. 2020-11-01 02:58:21 +01:00
DebaucheryLibrarian 7c11b2204e 1.139.2 2020-10-31 04:53:50 +01:00
DebaucheryLibrarian 72859ede85 Added various tag photos. 2020-10-31 04:53:40 +01:00
DebaucheryLibrarian 30c002d0f2 1.139.1 2020-10-30 17:51:56 +01:00
DebaucheryLibrarian 3855d96135 Removed 'null' from scene tile URL if no slug is available. 2020-10-30 17:51:47 +01:00
DebaucheryLibrarian 7974be05e9 1.139.0 2020-10-30 17:37:19 +01:00
DebaucheryLibrarian 39f8c037a5 Replaced bhttp with patched fork. Improved Jesse Loads Monster Facials scraper reliability (WIP). Added various tag photos. 2020-10-30 17:37:10 +01:00
DebaucheryLibrarian 4af7597441 1.138.9 2020-10-29 16:06:27 +01:00
DebaucheryLibrarian c37d4ad01f Filtering invalid actors from releases before storing. 2020-10-29 16:06:20 +01:00
DebaucheryLibrarian 2801732f57 1.138.8 2020-10-29 15:21:08 +01:00
DebaucheryLibrarian b188bc5744 Filtering out empty or unidentified scenes from update scraper, with warning. Improved Jesse Loads Monster Facials reliability. 2020-10-29 15:20:59 +01:00
DebaucheryLibrarian f4b1fb4831 1.138.7 2020-10-28 15:28:43 +01:00
DebaucheryLibrarian 8c553d5b3d Added traxxx dummy network to default excludes. 2020-10-28 15:28:39 +01:00
DebaucheryLibrarian e40d7ba181 1.138.6 2020-10-28 03:51:15 +01:00
DebaucheryLibrarian 4469376dd2 Using temporary table instead of WHERE IN to stack depth error when finding duplicate actors. 2020-10-28 03:50:52 +01:00
DebaucheryLibrarian 64a52fbb1e 1.138.5 2020-10-28 01:36:21 +01:00
DebaucheryLibrarian bf9b334b73 Adding scraper config by scraper slug to current 'includes' parameter. 2020-10-28 01:36:13 +01:00
DebaucheryLibrarian 1869877178 Added release covers table to flush routine. 2020-10-27 02:40:30 +01:00
DebaucheryLibrarian 209fe67bb0 1.138.4 2020-10-27 02:34:15 +01:00
DebaucheryLibrarian 7257776ba8 Mapping avatar to media ID in orphan delete. 2020-10-27 02:34:06 +01:00
DebaucheryLibrarian af7fa56e02 1.138.3 2020-10-27 02:10:03 +01:00
DebaucheryLibrarian 1d3ec96e8d Detecting profile avatars in orphaned media flush. 2020-10-27 02:09:52 +01:00
DebaucheryLibrarian 99a7bfeb4c Added traxxx dummy network. 2020-10-26 01:42:38 +01:00
DebaucheryLibrarian 15810333b9 1.138.2 2020-10-25 21:43:45 +01:00
DebaucheryLibrarian 0027be65eb Fixed CzechAV to accomodate teasers instead of photos. Fixed error trying to flush non-existent media file. 2020-10-25 21:43:36 +01:00
DebaucheryLibrarian 0e804db130 1.138.1 2020-10-25 01:29:41 +02:00
DebaucheryLibrarian 57a44d6643 Expanded README. 2020-10-25 01:29:25 +02:00
DebaucheryLibrarian 7e3e0d8f30 Merge branch 'experimental' into master 2020-10-25 01:22:50 +02:00
DebaucheryLibrarian 07b94f1513 Updated README. 2020-10-25 01:22:40 +02:00
DebaucheryLibrarian 9619f7e7ed 1.138.0 2020-10-25 01:17:51 +02:00
DebaucheryLibrarian 0bd7fca876 Added orphaned media flush and batch release flush. 2020-10-25 00:52:40 +02:00
DebaucheryLibrarian ef852f0191 1.137.6 2020-10-20 21:04:36 +02:00
DebaucheryLibrarian 6791053c83 Fixed entity alias available through wrong type endpoint. 2020-10-20 21:04:29 +02:00
DebaucheryLibrarian 47238b2969 1.137.5 2020-10-20 15:37:50 +02:00
DebaucheryLibrarian 9f3c686913 Added thumbnail and favicon to entity REST API. 2020-10-20 15:37:42 +02:00
DebaucheryLibrarian cefd91a7b9 1.137.4 2020-10-20 15:29:51 +02:00
DebaucheryLibrarian ecdd6d8fb0 Added logo path to entity API. 2020-10-20 15:28:58 +02:00
DebaucheryLibrarian 60eb599416 Added alias to entity search query. 2020-10-20 00:25:32 +02:00
DebaucheryLibrarian 8e7b944b52 1.137.3 2020-10-20 00:21:25 +02:00
DebaucheryLibrarian 6b17f9d1f2 Allowing entity to be fetched by alias. 2020-10-20 00:21:15 +02:00
DebaucheryLibrarian cb459d4cc7 1.137.2 2020-10-20 00:08:24 +02:00
DebaucheryLibrarian d795266114 Removed no-date-limit as argument due yargs conflict. 2020-10-20 00:08:14 +02:00
DebaucheryLibrarian 3e303e4b10 1.137.1 2020-10-20 00:05:34 +02:00