 ThePendulum
|
3b2bf921f3
|
Replaced batch ranges with 'New' sorting.
|
2020-04-16 22:23:25 +02:00 |
|
ThePendulum
|
e3dfaf4440
|
Staging release media store by role.
|
2020-04-16 16:24:59 +02:00 |
|
ThePendulum
|
fc58850e56
|
Added media limit sampling.
|
2020-04-11 22:49:37 +02:00 |
|
ThePendulum
|
cb68319ac0
|
Added lazy loading to tag photos. Changed tag thumb location.
|
2020-04-08 14:50:43 +02:00 |
|
ThePendulum
|
c39bfb234d
|
Blurring video when paused in SFW mode.
|
2020-04-02 02:23:54 +02:00 |
|
ThePendulum
|
ad7874649f
|
Added self hash filtering to media module. Moved Girl Girl back to Jules Jordan.
|
2020-04-02 01:10:50 +02:00 |
|
ThePendulum
|
9a712e7371
|
Media module saves files.
|
2020-03-31 04:05:31 +02:00 |
|
ThePendulum
|
4eaacf5697
|
Expanded new media module. Added network to channel site to fix actor glitch.
|
2020-03-30 03:01:08 +02:00 |
|
ThePendulum
|
a5d859471d
|
Added Jesse Loads Monster Facials. Added various logos.
|
2020-03-29 23:42:41 +02:00 |
|
ThePendulum
|
93d4f0ff1a
|
Added WIP media module. Returning releases from release search database function. Fixed page loop in update module.
|
2020-03-29 04:00:46 +02:00 |
|
ThePendulum
|
6d9f96c5d5
|
Improved duplicate filtering, now also applying to upcoming updates. Updated Gamma fetchLatest method parameters. Added shortcut for SFW-mode.
|
2020-03-28 04:37:04 +01:00 |
|
ThePendulum
|
95d115b585
|
Added Aziani. Added URL origin parameter to relevant qu methods.
|
2020-03-28 01:40:02 +01:00 |
|
ThePendulum
|
238ebcbf34
|
Moved SFW mode to server, added HTTP header trigger.
|
2020-03-27 17:37:13 +01:00 |
|
ThePendulum
|
fb59bf552a
|
Added actor assignment to new actors module. Showing network icon on network-specific actors. Improved dark theme. Changed tag tile design. Added Digital Playground logos.
|
2020-03-27 04:39:13 +01:00 |
|
ThePendulum
|
d29e296799
|
Added database structure for profiles and tattoos. Improved sidebar appearance. Expanded new actors module.
|
2020-03-26 03:32:07 +01:00 |
|
ThePendulum
|
d724f96728
|
Added new actors module boilerplate. Added tag posters.
|
2020-03-24 03:48:24 +01:00 |
|
ThePendulum
|
58ead7b426
|
Added dark and SFW modes.
|
2020-03-23 01:43:49 +01:00 |
|
ThePendulum
|
fdb2b132f6
|
Improved release storage module. Added new tags module. Added movie scraping.
|
2020-03-22 03:50:24 +01:00 |
|
ThePendulum
|
d765543b30
|
Improved update runner. Improved HTTP module API, added default user agent. Added PornCZ and Czechav logos.
|
2020-03-21 02:48:24 +01:00 |
|
ThePendulum
|
4b310e9dfa
|
Added configurable proxy to HTTP module (also used by qu). Added network and site URL to search documents.
|
2020-03-19 01:54:25 +01:00 |
|
ThePendulum
|
e4b269956e
|
Attaching channel site and studio to stored releases.
|
2020-03-17 00:58:03 +01:00 |
|
ThePendulum
|
0f09fd53eb
|
Refactoring deep scrape. Added tag posters.
|
2020-03-16 04:10:52 +01:00 |
|
ThePendulum
|
c8ebe7892a
|
Refactored update scraper into new module.
|
2020-03-14 02:56:28 +01:00 |
|
ThePendulum
|
8d484ba728
|
Added tag photos. Auto-adding BTS tag to BAM Visions scenes.
|
2020-03-13 21:54:44 +01:00 |
|
ThePendulum
|
01b59f0a9b
|
Changed withReleases boolean to include object in Vixen and Fame Digital scrapers.
|
2020-03-12 02:21:59 +01:00 |
|
ThePendulum
|
370605554b
|
Added profile scraper with scenes to BAM Visions. Passing 'includes' object instead of withReleases boolean to Gamma.
|
2020-03-12 02:19:45 +01:00 |
|
ThePendulum
|
25795e2cce
|
Added latest and scene scrapers to BAM Visions.
|
2020-03-12 00:59:32 +01:00 |
|
ThePendulum
|
37e188a0df
|
Added site aliases. Migrated various scrapers to qu. Added BAM Visions base.
|
2020-03-12 00:15:25 +01:00 |
|
ThePendulum
|
6a950c8b57
|
Fixed logger in web server.
|
2020-03-11 03:03:19 +01:00 |
|
ThePendulum
|
0d0acb6f3c
|
Fixed release sites for profile scraping.
|
2020-03-11 03:01:37 +01:00 |
|
ThePendulum
|
d97b1ab894
|
Split up profile scrape runner. Fixed wrong search document date key. Added search update CLI.
|
2020-03-10 23:46:55 +01:00 |
|
ThePendulum
|
db63be8f92
|
Photo plucker will use discarded photos as fallback. Returning high res photo sources from LegalPorno.
|
2020-03-10 04:42:15 +01:00 |
|
ThePendulum
|
5c55750c0c
|
Fixed qu issues. Fixed media issues. Simplified and expanded date component in search query.
|
2020-03-10 00:17:57 +01:00 |
|
ThePendulum
|
61a795d634
|
Added 'includes' argument to scrapers to help them avoid unnecessary requests. Added movie actors and movie tags views.
|
2020-03-09 16:54:45 +01:00 |
|
ThePendulum
|
638757b6e4
|
Added rudimentary movie relations.
|
2020-03-09 05:06:37 +01:00 |
|
ThePendulum
|
6cbb7f9c1e
|
Major API change for 'q', renamed to 'qu', refactored modules. Fixed Gamma URL entry ID regex.
|
2020-03-09 02:02:29 +01:00 |
|
ThePendulum
|
acad99bdfe
|
Changed q get and geta APIs to include status, refactored scrapers. Showing front- and back-cover on movie tiles and release page (fix). Removed icons from main navigation. Returning scenes from Jules Jordan movie scraper.
|
2020-03-08 04:23:10 +01:00 |
|
ThePendulum
|
628c5a2013
|
Fixed Gamma scene scraper extracting the wrong scene ID from non-standard URLs.
|
2020-03-07 23:40:38 +01:00 |
|
ThePendulum
|
cd12b53071
|
Added SexyHub. Added favicon.
|
2020-03-07 04:27:20 +01:00 |
|
ThePendulum
|
ff3e956fc7
|
Added mobile album scraping to Blowpass, improved wrapper.
|
2020-03-07 02:35:13 +01:00 |
|
ThePendulum
|
ea0e37aa49
|
Fixed Vivid requesting unavailable HTTPS resource, and breaking on non-existing parameters object.
|
2020-03-07 00:32:04 +01:00 |
|
ThePendulum
|
6820608a09
|
Gamma won't attempt to fetch photos when 'photos' parameter is false.
|
2020-03-06 23:50:52 +01:00 |
|
ThePendulum
|
aad91fe4ae
|
Added Girls Under Arrest to Adult Time. Added mobile album support to some Girlsway sites. Fixed Moms On Moms link.
|
2020-03-06 23:40:15 +01:00 |
|
ThePendulum
|
a579e3c88f
|
Enabled mobile album scraping for Burning Angel and Fame Digital.
|
2020-03-06 23:08:55 +01:00 |
|
ThePendulum
|
5d468b58fd
|
Enabled mobile album fetching for Pure Taboo and Fantasy Massage.
|
2020-03-06 19:44:20 +01:00 |
|
ThePendulum
|
96eef822d6
|
Allowing mobile parameter to be set on Gamma network. Added mobile to 21Naturals and 21Sextreme, moved 21Sextury mobile to network.
|
2020-03-06 19:26:23 +01:00 |
|
ThePendulum
|
5c63bd860b
|
Tags module filters out undefined tags. Gamma will return [] instead of undefined when no tags are available.
|
2020-03-06 18:59:32 +01:00 |
|
ThePendulum
|
90172ea19a
|
Added mobile album support to Gamma scraper.
|
2020-03-06 04:28:01 +01:00 |
|
ThePendulum
|
fa7b2a7a23
|
Fixed subnetwork spacing in network sidebar. Using derived entry IDs for main Hush scrapers.
|
2020-03-06 03:15:49 +01:00 |
|
ThePendulum
|
db01599569
|
Added profile scraper with releases to Hush. Added qtexts to q to return text nodes individually. Including network in profile site.
|
2020-03-06 02:49:55 +01:00 |
|
ThePendulum
|
3889faee26
|
Added optional sequential scraping and acc release injection. Added Hush Pass and Interracial Pass logos.
|
2020-03-05 23:01:03 +01:00 |
|
ThePendulum
|
fd6e90e74c
|
Added tour layout scraper to Hush, enabling Interracial POVs, POV Pornstars and See Him Fuck.
|
2020-03-05 20:31:11 +01:00 |
|
ThePendulum
|
1407700511
|
Added Interracial Pass sites. Fixed Hush removing poster from base release.
|
2020-03-05 17:07:07 +01:00 |
|
ThePendulum
|
981b121980
|
Split Hussie Pass into Hush networks Hush Pass, Hussie Pass and Interracial Pass.
|
2020-03-05 05:07:14 +01:00 |
|
ThePendulum
|
f10e4af29b
|
Allowing scrapers to force channel allocation attempt. Added Hush Pass subsite handling to Hussie Pass scraper.
|
2020-03-05 03:44:27 +01:00 |
|
ThePendulum
|
956afa6ae7
|
Added Hussie Pass scraper.
|
2020-03-05 02:47:52 +01:00 |
|
ThePendulum
|
6c3cba1b87
|
Added actor photos to Brazzers scene scrape. Added no-video poster to Score. Not flattening actor avatar fallbacks.
|
2020-03-04 17:21:40 +01:00 |
|
ThePendulum
|
15af3e91e0
|
Coalescing shoot ID in search. Added stop words for common TLDs. Sorting tags in search results.
|
2020-03-02 04:15:47 +01:00 |
|
ThePendulum
|
e79a6b33fb
|
Added 'newly added' filter. Handling paywalled videos in Private scraper. Added shoot ID to search.
|
2020-03-02 03:41:41 +01:00 |
|
ThePendulum
|
e57f440665
|
Added Amateur Allure.
|
2020-03-01 05:28:08 +01:00 |
|
ThePendulum
|
8dd5925af6
|
Improved search engine query and added stop words. Added 'secondary' property to tag aliases, for tag aliases to be included in searches and alias lists.
|
2020-02-29 22:47:48 +01:00 |
|
ThePendulum
|
b03775fa07
|
Using generic slugify for MindGeek channel.
|
2020-02-29 05:00:50 +01:00 |
|
ThePendulum
|
a828fee476
|
Handling NULL actors and tags in search table query. Added limit parameter to home URL, default to 30.
|
2020-02-29 03:22:51 +01:00 |
|
ThePendulum
|
f1f33080f6
|
Ignoring undefined video entropy.
|
2020-02-28 03:56:58 +01:00 |
|
ThePendulum
|
3dc8547431
|
Added fake data and Markov experiments.
|
2020-02-27 05:44:24 +01:00 |
|
ThePendulum
|
97cf5b2b6b
|
Added seed file for test data.
|
2020-02-27 00:38:11 +01:00 |
|
ThePendulum
|
3c30e9107a
|
Using dedicated releases search table for ts vector documents.
|
2020-02-26 22:33:15 +01:00 |
|
ThePendulum
|
51ffcb5be7
|
Added opt-out trim to capitalize util.
|
2020-02-26 04:10:01 +01:00 |
|
ThePendulum
|
646ff064a7
|
Updated Score scraper to accept site and with-releases argument.
|
2020-02-25 22:32:13 +01:00 |
|
ThePendulum
|
800a25743d
|
Storing image dimensions and file size to database. Added new site Filthy Femdom to Kink.
|
2020-02-24 04:01:58 +01:00 |
|
ThePendulum
|
6d1f30f703
|
Passing matching site to profile scrapers. Allowing scrapers to pass avatar metadata. Added scraper and copyright properties to media. Auto-adding copyright from site or scraper to avatars. Separated Porn Pros from Whale Member.
|
2020-02-24 03:12:58 +01:00 |
|
ThePendulum
|
0ae7d2669a
|
Added profile scraping to Private.
|
2020-02-24 00:31:36 +01:00 |
|
ThePendulum
|
164681427a
|
Fixed Kelly Madison posters, marking frontpage video as teaser.
|
2020-02-23 22:37:14 +01:00 |
|
ThePendulum
|
0d719d88ea
|
Removed Boob Pedia as gender source, unreliable.
|
2020-02-23 22:26:14 +01:00 |
|
ThePendulum
|
8359f78e2e
|
Fixed RK scraper returning dick size as bust size.
|
2020-02-23 22:01:12 +01:00 |
|
ThePendulum
|
0ede7e0f82
|
Added various Porn Pros archive sites.
|
2020-02-23 05:00:08 +01:00 |
|
ThePendulum
|
74274f879e
|
Re-added image entropy filter.
|
2020-02-22 23:50:25 +01:00 |
|
ThePendulum
|
915eb75719
|
Refactored Vixen scraper, using API endpoint and added actor profile and releases scraper. Release scraper will return base release when present and 'deep' argument is false.
|
2020-02-22 23:25:10 +01:00 |
|
ThePendulum
|
5e1a1005f1
|
Refactored Vixen scene scraper. Using better poster source for Vixen. Returning video as teaser instead of trailer.
|
2020-02-22 05:29:02 +01:00 |
|
ThePendulum
|
e5c6ccd252
|
Scraping upcoming Vixen scenes. Fetching release media groups sequentially to prevent collisions.
|
2020-02-22 04:37:48 +01:00 |
|
ThePendulum
|
349a5a506e
|
Queueing and batching media HTTP requests for improved reliability.
|
2020-02-22 03:22:30 +01:00 |
|
ThePendulum
|
13a8221b92
|
Added New Sensations. Returning null from q's date formatter when date is invalid.
|
2020-02-21 03:51:57 +01:00 |
|
ThePendulum
|
7ac5a8e08c
|
Catching media failures per batch. Refined teaser logging.
|
2020-02-20 22:27:00 +01:00 |
|
ThePendulum
|
377970f874
|
Added parent-child relations to network, showing parent network in sidebar. Added Burning Angel using Gamma API.
|
2020-02-20 02:35:23 +01:00 |
|
ThePendulum
|
2c490753a4
|
Removed stray console log from Gamma scraper.
|
2020-02-19 04:50:10 +01:00 |
|
ThePendulum
|
8889ea5cf3
|
Using hasTeaser param instead of date comparison to skip upcoming release teasers in Gamma scraper.
|
2020-02-19 04:49:54 +01:00 |
|
ThePendulum
|
372ff54261
|
Added teaser source to Gamma scraper. Not adding Gamma teaser for upcoming releases.
|
2020-02-19 04:47:20 +01:00 |
|
ThePendulum
|
97f5e49187
|
Refactored media module. Returning 320p and 720p videos from MindGeek as teasers instead of trailers.
|
2020-02-19 04:41:53 +01:00 |
|
ThePendulum
|
40bf476ea6
|
Fixed Porn Pros scraper. Added various Score site logos.
|
2020-02-18 16:00:36 +01:00 |
|
ThePendulum
|
d1532e1bec
|
Fixed scene URLs for Full Porn Network.
|
2020-02-15 02:47:50 +01:00 |
|
ThePendulum
|
30e58fb397
|
Added actor description to Full Porn Network profile scraper.
|
2020-02-15 02:06:21 +01:00 |
|
ThePendulum
|
b6fe91b016
|
Added profile avatar and release scraping to Full Porn Network.
|
2020-02-15 02:04:46 +01:00 |
|
ThePendulum
|
880cc64022
|
Added Full Porn Network scraper.
|
2020-02-15 01:50:22 +01:00 |
|
ThePendulum
|
5e461f1f1a
|
Added proper Gamma parameters to 21Sextury sites.
|
2020-02-13 23:05:28 +01:00 |
|
ThePendulum
|
1ff8d37d89
|
Added upcoming support to Nubiles. Renamed q's formatDate to extractDate, added actual formatDate.
|
2020-02-13 04:11:32 +01:00 |
|
ThePendulum
|
c9c7a33585
|
Added Cherry Pimps/Pimp.XXX.
|
2020-02-13 03:44:04 +01:00 |
|
ThePendulum
|
b7abd805e2
|
Added Girl Girl to Jules Jordan.
|
2020-02-12 23:49:22 +01:00 |
|
ThePendulum
|
cd2ca65903
|
Added Nubiles network.
|
2020-02-12 23:00:32 +01:00 |
|
ThePendulum
|
98d29c0af0
|
Added Insex fallback for Paintoy.
|
2020-02-12 16:26:08 +01:00 |
|
ThePendulum
|
48b10d0f49
|
Using brief mode on Insex.
|
2020-02-12 04:59:15 +01:00 |