Commit Graph

111 Commits

Author SHA1 Message Date
DebaucheryLibrarian
50c5f921f5 Using new bulk insert utility for releases, media and actors. 2020-08-14 23:21:53 +02:00
DebaucheryLibrarian
e996a45bf5 Added new bulk upsert utility. 2020-08-14 23:05:25 +02:00
DebaucheryLibrarian
9ef5ea8fb6 Added the awkward pagination to PornCZ scraper. 2020-07-23 00:55:55 +02:00
DebaucheryLibrarian
46c6c4dd21 Added PornCZ. 2020-07-22 04:12:20 +02:00
DebaucheryLibrarian
dff4d15872 Updated profile scrapers to use base actor instead of actor name. Fixes for Reality Kings and Cherry Pimps scrapers. 2020-07-21 01:44:51 +02:00
DebaucheryLibrarian
939eba8e61 Changed qu's HTML element detection. Passing base actor instead of actorName to profile scrapers. 2020-07-21 01:16:26 +02:00
DebaucheryLibrarian
a88c2f0760 Added m3u8 stream support to media module. Added Elegant Angel. Added regex parameter to qu's number method. Various tags. 2020-07-17 03:39:13 +02:00
DebaucheryLibrarian
6adfded074 Refactored Mike Adriano scraper. Changed logo and favicon. Added style methods to qu. 2020-07-16 03:47:07 +02:00
DebaucheryLibrarian
17b3ba1272 Added partial 'fcuk' (Exploited College Girls) scraper. Added file parameter for actor names and scene URLs. 2020-07-15 03:24:47 +02:00
DebaucheryLibrarian
b7be97fcf9 Added Amateur Euro, For Bondage, Mamacitaz, TransBella and VIP Sex Vault. Refactored Kelly Madison scraper using qu, fixed trailers and improved reliability. 2020-07-14 03:46:31 +02:00
1eab3be7f6 Added Lets Doe It scraper. Added timestamp matching to qu's duration method. 2020-07-13 03:51:17 +02:00
6fd2bc2687 Added Kink profile scraper. Fixed --force causing media collisions. 2020-07-13 00:12:01 +02:00
a7707b7b28 Merged DDF Network with Porn World. Fixed and updated DDF/PW scraper. 2020-07-12 22:36:53 +02:00
9c8cfe3bdb Re-wrote broken Perv City scraper, added profile scraping. 2020-07-12 05:10:23 +02:00
44a8ced30c Separated actor expand buttons. Refactored Brazzers scraper. Fixed actor releases not included in shallow scrape. Added number query and data-src default to qu img. Updated README. Removed post-install migrate and seed. 2020-07-09 02:00:54 +02:00
9e5d3aa139 Added 'visible' property to entities. Added various Teen Core Club logos. 2020-07-08 02:53:46 +02:00
abe7de5701 Added scene scraping to Teen Core Club. 2020-07-06 04:13:48 +02:00
48a127409e Added date precision. Added Teen Core Club update scraper. 2020-07-03 04:12:56 +02:00
749864e922 Added 'independent' property for network-like channels. Changed release tile design. Adding Brazzers timeline events as tags. Added Property Sex to MindGeek. Changed DP, DAP and DVP tag slugs. Changed Porn Pros logo. Added better BAM Visions and Mug Fucked logos. 2020-07-02 04:04:28 +02:00
1f444e58ce Allowing image sources to specify queue method. Using 5s queue for Whale Member to avoid CDN time-outs. 2020-07-01 04:47:05 +02:00
4959dfd14f Refactored deep and store modules to use entities. 2020-06-25 02:26:25 +02:00
8abcc7194a Updated Full Porn Network scraper. 2020-05-29 22:43:03 +02:00
88a88227c4 Applying tag filters to URL. 2020-05-27 01:40:10 +02:00
86377fec5f Enabled pagination on network page. 2020-05-26 04:11:29 +02:00
057362d011 Added basic release and actor API. 2020-05-20 01:11:32 +02:00
0c4628677f Fixed profile location interpolation. Generalizing ethnicity, hair color and eye color. 2020-05-19 01:10:32 +02:00
05ee57378a Storing actor avatars. Using 1 second interval queue for location resolve as per OSM code of conduct. 2020-05-16 04:36:45 +02:00
21d4dd6bfa Scraping and storing actor profiles. 2020-05-15 04:40:59 +02:00
11eb66f834 Switched to tabs. Adding missing actor entries when scraping actors, with batch ID. 2020-05-14 04:26:05 +02:00
af9d8f7858 Drastically improved memory performance media module using streams and temp files. 2020-05-07 01:53:07 +02:00
2ac879d276 Fixed Vixen scraper, using new token URL for trailers. 2020-04-26 03:51:59 +02:00
9a712e7371 Media module saves files. 2020-03-31 04:05:31 +02:00
4eaacf5697 Expanded new media module. Added network to channel site to fix actor glitch. 2020-03-30 03:01:08 +02:00
95d115b585 Added Aziani. Added URL origin parameter to relevant qu methods. 2020-03-28 01:40:02 +01:00
d29e296799 Added database structure for profiles and tattoos. Improved sidebar appearance. Expanded new actors module. 2020-03-26 03:32:07 +01:00
58ead7b426 Added dark and SFW modes. 2020-03-23 01:43:49 +01:00
fdb2b132f6 Improved release storage module. Added new tags module. Added movie scraping. 2020-03-22 03:50:24 +01:00
d765543b30 Improved update runner. Improved HTTP module API, added default user agent. Added PornCZ and Czechav logos. 2020-03-21 02:48:24 +01:00
4b310e9dfa Added configurable proxy to HTTP module (also used by qu). Added network and site URL to search documents. 2020-03-19 01:54:25 +01:00
0f09fd53eb Refactoring deep scrape. Added tag posters. 2020-03-16 04:10:52 +01:00
370605554b Added profile scraper with scenes to BAM Visions. Passing 'includes' object instead of withReleases boolean to Gamma. 2020-03-12 02:19:45 +01:00
0d0acb6f3c Fixed release sites for profile scraping. 2020-03-11 03:01:37 +01:00
61a795d634 Added 'includes' argument to scrapers to help them avoid unnecessary requests. Added movie actors and movie tags views. 2020-03-09 16:54:45 +01:00
638757b6e4 Added rudimentary movie relations. 2020-03-09 05:06:37 +01:00
6cbb7f9c1e Major API change for 'q', renamed to 'qu', refactored modules. Fixed Gamma URL entry ID regex. 2020-03-09 02:02:29 +01:00
acad99bdfe Changed q get and geta APIs to include status, refactored scrapers. Showing front- and back-cover on movie tiles and release page (fix). Removed icons from main navigation. Returning scenes from Jules Jordan movie scraper. 2020-03-08 04:23:10 +01:00
db01599569 Added profile scraper with releases to Hush. Added qtexts to q to return text nodes individually. Including network in profile site. 2020-03-06 02:49:55 +01:00
3dc8547431 Added fake data and Markov experiments. 2020-02-27 05:44:24 +01:00
97cf5b2b6b Added seed file for test data. 2020-02-27 00:38:11 +01:00
51ffcb5be7 Added opt-out trim to capitalize util. 2020-02-26 04:10:01 +01:00