 ThePendulum
|
532a4b679b
|
Using batch insert for profiles to prevent errors on large inserts.
|
2020-05-21 03:44:44 +02:00 |
|
ThePendulum
|
7275fb10e3
|
Improved Gamma scraper for (XEmpire) actors.
|
2020-05-20 03:00:46 +02:00 |
|
ThePendulum
|
c0898b84d6
|
Showing all unique descriptions on profile with network logo. Fixed Fame Digital scraper.
|
2020-05-19 04:46:49 +02:00 |
|
ThePendulum
|
0c4628677f
|
Fixed profile location interpolation. Generalizing ethnicity, hair color and eye color.
|
2020-05-19 01:10:32 +02:00 |
|
ThePendulum
|
4826ae8571
|
Added oil tag. Removed Fame Digital from profile config.
|
2020-05-18 04:28:38 +02:00 |
|
ThePendulum
|
885aa4f627
|
Passing context object with site or network instead of scraper slug and 'site or network' to all profile scrapers.
|
2020-05-18 03:22:03 +02:00 |
|
ThePendulum
|
8733fdc657
|
Improved actor scraping and display.
|
2020-05-18 01:22:56 +02:00 |
|
ThePendulum
|
05ee57378a
|
Storing actor avatars. Using 1 second interval queue for location resolve as per OSM code of conduct.
|
2020-05-16 04:36:45 +02:00 |
|
ThePendulum
|
11eb66f834
|
Switched to tabs. Adding missing actor entries when scraping actors, with batch ID.
|
2020-05-14 04:26:05 +02:00 |
|
ThePendulum
|
f1eb29c713
|
Added thumb and lazy image scripts. Added FreeOnes and Boobpedia as sites.
|
2020-05-13 23:17:39 +02:00 |
|
ThePendulum
|
dac451bb86
|
Using alias actor ID when available. Using basic SVG flags instead of PNG. Moved PNG and HD SVG flags to assets.
|
2020-05-13 20:27:06 +02:00 |
|
ThePendulum
|
6040a3f41f
|
Associating actors without network.
|
2020-05-13 02:56:20 +02:00 |
|
ThePendulum
|
af9d8f7858
|
Drastically improved memory performance media module using streams and temp files.
|
2020-05-07 01:53:07 +02:00 |
|
ThePendulum
|
3b2bf921f3
|
Replaced batch ranges with 'New' sorting.
|
2020-04-16 22:23:25 +02:00 |
|
ThePendulum
|
cb68319ac0
|
Added lazy loading to tag photos. Changed tag thumb location.
|
2020-04-08 14:50:43 +02:00 |
|
ThePendulum
|
24b297011e
|
Added various tag posters.
|
2020-04-02 04:05:55 +02:00 |
|
ThePendulum
|
ad7874649f
|
Added self hash filtering to media module. Moved Girl Girl back to Jules Jordan.
|
2020-04-02 01:10:50 +02:00 |
|
ThePendulum
|
a5d859471d
|
Added Jesse Loads Monster Facials. Added various logos.
|
2020-03-29 23:42:41 +02:00 |
|
ThePendulum
|
93d4f0ff1a
|
Added WIP media module. Returning releases from release search database function. Fixed page loop in update module.
|
2020-03-29 04:00:46 +02:00 |
|
ThePendulum
|
6d9f96c5d5
|
Improved duplicate filtering, now also applying to upcoming updates. Updated Gamma fetchLatest method parameters. Added shortcut for SFW-mode.
|
2020-03-28 04:37:04 +01:00 |
|
ThePendulum
|
95d115b585
|
Added Aziani. Added URL origin parameter to relevant qu methods.
|
2020-03-28 01:40:02 +01:00 |
|
ThePendulum
|
238ebcbf34
|
Moved SFW mode to server, added HTTP header trigger.
|
2020-03-27 17:37:13 +01:00 |
|
ThePendulum
|
d29e296799
|
Added database structure for profiles and tattoos. Improved sidebar appearance. Expanded new actors module.
|
2020-03-26 03:32:07 +01:00 |
|
ThePendulum
|
bb3f6fc408
|
Added more SFW photos.
|
2020-03-25 04:25:10 +01:00 |
|
ThePendulum
|
15a386ad05
|
Added compact sidebar. Added tag sections and posters.
|
2020-03-25 02:48:54 +01:00 |
|
ThePendulum
|
d724f96728
|
Added new actors module boilerplate. Added tag posters.
|
2020-03-24 03:48:24 +01:00 |
|
ThePendulum
|
aa488cc6e3
|
Changed tags on tag overview.
|
2020-03-23 04:58:23 +01:00 |
|
ThePendulum
|
58ead7b426
|
Added dark and SFW modes.
|
2020-03-23 01:43:49 +01:00 |
|
ThePendulum
|
fdb2b132f6
|
Improved release storage module. Added new tags module. Added movie scraping.
|
2020-03-22 03:50:24 +01:00 |
|
ThePendulum
|
0f09fd53eb
|
Refactoring deep scrape. Added tag posters.
|
2020-03-16 04:10:52 +01:00 |
|
ThePendulum
|
c8ebe7892a
|
Refactored update scraper into new module.
|
2020-03-14 02:56:28 +01:00 |
|
ThePendulum
|
8d484ba728
|
Added tag photos. Auto-adding BTS tag to BAM Visions scenes.
|
2020-03-13 21:54:44 +01:00 |
|
ThePendulum
|
8e4573e5ad
|
Retouched BAM Visions logo.
|
2020-03-12 02:35:14 +01:00 |
|
ThePendulum
|
25795e2cce
|
Added latest and scene scrapers to BAM Visions.
|
2020-03-12 00:59:32 +01:00 |
|
ThePendulum
|
37e188a0df
|
Added site aliases. Migrated various scrapers to qu. Added BAM Visions base.
|
2020-03-12 00:15:25 +01:00 |
|
ThePendulum
|
61a795d634
|
Added 'includes' argument to scrapers to help them avoid unnecessary requests. Added movie actors and movie tags views.
|
2020-03-09 16:54:45 +01:00 |
|
ThePendulum
|
6cbb7f9c1e
|
Major API change for 'q', renamed to 'qu', refactored modules. Fixed Gamma URL entry ID regex.
|
2020-03-09 02:02:29 +01:00 |
|
ThePendulum
|
cd12b53071
|
Added SexyHub. Added favicon.
|
2020-03-07 04:27:20 +01:00 |
|
ThePendulum
|
ff3e956fc7
|
Added mobile album scraping to Blowpass, improved wrapper.
|
2020-03-07 02:35:13 +01:00 |
|
ThePendulum
|
ea0e37aa49
|
Fixed Vivid requesting unavailable HTTPS resource, and breaking on non-existing parameters object.
|
2020-03-07 00:32:04 +01:00 |
|
ThePendulum
|
6820608a09
|
Gamma won't attempt to fetch photos when 'photos' parameter is false.
|
2020-03-06 23:50:52 +01:00 |
|
ThePendulum
|
aad91fe4ae
|
Added Girls Under Arrest to Adult Time. Added mobile album support to some Girlsway sites. Fixed Moms On Moms link.
|
2020-03-06 23:40:15 +01:00 |
|
ThePendulum
|
a579e3c88f
|
Enabled mobile album scraping for Burning Angel and Fame Digital.
|
2020-03-06 23:08:55 +01:00 |
|
ThePendulum
|
5d468b58fd
|
Enabled mobile album fetching for Pure Taboo and Fantasy Massage.
|
2020-03-06 19:44:20 +01:00 |
|
ThePendulum
|
96eef822d6
|
Allowing mobile parameter to be set on Gamma network. Added mobile to 21Naturals and 21Sextreme, moved 21Sextury mobile to network.
|
2020-03-06 19:26:23 +01:00 |
|
ThePendulum
|
5c63bd860b
|
Tags module filters out undefined tags. Gamma will return [] instead of undefined when no tags are available.
|
2020-03-06 18:59:32 +01:00 |
|
ThePendulum
|
90172ea19a
|
Added mobile album support to Gamma scraper.
|
2020-03-06 04:28:01 +01:00 |
|
ThePendulum
|
db01599569
|
Added profile scraper with releases to Hush. Added qtexts to q to return text nodes individually. Including network in profile site.
|
2020-03-06 02:49:55 +01:00 |
|
ThePendulum
|
3889faee26
|
Added optional sequential scraping and acc release injection. Added Hush Pass and Interracial Pass logos.
|
2020-03-05 23:01:03 +01:00 |
|
ThePendulum
|
fd6e90e74c
|
Added tour layout scraper to Hush, enabling Interracial POVs, POV Pornstars and See Him Fuck.
|
2020-03-05 20:31:11 +01:00 |
|
ThePendulum
|
1407700511
|
Added Interracial Pass sites. Fixed Hush removing poster from base release.
|
2020-03-05 17:07:07 +01:00 |
|
ThePendulum
|
981b121980
|
Split Hussie Pass into Hush networks Hush Pass, Hussie Pass and Interracial Pass.
|
2020-03-05 05:07:14 +01:00 |
|
ThePendulum
|
f10e4af29b
|
Allowing scrapers to force channel allocation attempt. Added Hush Pass subsite handling to Hussie Pass scraper.
|
2020-03-05 03:44:27 +01:00 |
|
ThePendulum
|
956afa6ae7
|
Added Hussie Pass scraper.
|
2020-03-05 02:47:52 +01:00 |
|
ThePendulum
|
15af3e91e0
|
Coalescing shoot ID in search. Added stop words for common TLDs. Sorting tags in search results.
|
2020-03-02 04:15:47 +01:00 |
|
ThePendulum
|
e57f440665
|
Added Amateur Allure.
|
2020-03-01 05:28:08 +01:00 |
|
ThePendulum
|
3290a5f686
|
Focusing and auto-hiding search tooltip. Separated Girl Girl from Jules Jordan.
|
2020-03-01 00:21:54 +01:00 |
|
ThePendulum
|
8dd5925af6
|
Improved search engine query and added stop words. Added 'secondary' property to tag aliases, for tag aliases to be included in searches and alias lists.
|
2020-02-29 22:47:48 +01:00 |
|
ThePendulum
|
f1f33080f6
|
Ignoring undefined video entropy.
|
2020-02-28 03:56:58 +01:00 |
|
ThePendulum
|
3dc8547431
|
Added fake data and Markov experiments.
|
2020-02-27 05:44:24 +01:00 |
|
ThePendulum
|
97cf5b2b6b
|
Added seed file for test data.
|
2020-02-27 00:38:11 +01:00 |
|
ThePendulum
|
800a25743d
|
Storing image dimensions and file size to database. Added new site Filthy Femdom to Kink.
|
2020-02-24 04:01:58 +01:00 |
|
ThePendulum
|
6d1f30f703
|
Passing matching site to profile scrapers. Allowing scrapers to pass avatar metadata. Added scraper and copyright properties to media. Auto-adding copyright from site or scraper to avatars. Separated Porn Pros from Whale Member.
|
2020-02-24 03:12:58 +01:00 |
|
ThePendulum
|
5acaa9c6bf
|
Marked Metro HD sites as 'native' as to use site URL.
|
2020-02-23 22:07:35 +01:00 |
|
ThePendulum
|
0ede7e0f82
|
Added various Porn Pros archive sites.
|
2020-02-23 05:00:08 +01:00 |
|
ThePendulum
|
e5c6ccd252
|
Scraping upcoming Vixen scenes. Fetching release media groups sequentially to prevent collisions.
|
2020-02-22 04:37:48 +01:00 |
|
ThePendulum
|
349a5a506e
|
Queueing and batching media HTTP requests for improved reliability.
|
2020-02-22 03:22:30 +01:00 |
|
ThePendulum
|
13a8221b92
|
Added New Sensations. Returning null from q's date formatter when date is invalid.
|
2020-02-21 03:51:57 +01:00 |
|
ThePendulum
|
377970f874
|
Added parent-child relations to network, showing parent network in sidebar. Added Burning Angel using Gamma API.
|
2020-02-20 02:35:23 +01:00 |
|
ThePendulum
|
97f5e49187
|
Refactored media module. Returning 320p and 720p videos from MindGeek as teasers instead of trailers.
|
2020-02-19 04:41:53 +01:00 |
|
ThePendulum
|
40bf476ea6
|
Fixed Porn Pros scraper. Added various Score site logos.
|
2020-02-18 16:00:36 +01:00 |
|
ThePendulum
|
880cc64022
|
Added Full Porn Network scraper.
|
2020-02-15 01:50:22 +01:00 |
|
ThePendulum
|
fe3cc901b0
|
Added PG site search function and enabled site search bar. Added Full Porn network assets.
|
2020-02-15 01:10:32 +01:00 |
|
ThePendulum
|
5e461f1f1a
|
Added proper Gamma parameters to 21Sextury sites.
|
2020-02-13 23:05:28 +01:00 |
|
ThePendulum
|
1ff8d37d89
|
Added upcoming support to Nubiles. Renamed q's formatDate to extractDate, added actual formatDate.
|
2020-02-13 04:11:32 +01:00 |
|
ThePendulum
|
c9c7a33585
|
Added Cherry Pimps/Pimp.XXX.
|
2020-02-13 03:44:04 +01:00 |
|
ThePendulum
|
b7abd805e2
|
Added Girl Girl to Jules Jordan.
|
2020-02-12 23:49:22 +01:00 |
|
ThePendulum
|
cd2ca65903
|
Added Nubiles network.
|
2020-02-12 23:00:32 +01:00 |
|
ThePendulum
|
98d29c0af0
|
Added Insex fallback for Paintoy.
|
2020-02-12 16:26:08 +01:00 |
|
ThePendulum
|
48b10d0f49
|
Using brief mode on Insex.
|
2020-02-12 04:59:15 +01:00 |
|
ThePendulum
|
b8074205ef
|
Added Insex. Renamed q's stand-alone date function. Separated q's trim function. Release tile uses cover if available, and poster is not available.
|
2020-02-12 04:39:57 +01:00 |
|
ThePendulum
|
fa30366ea4
|
Moved site tags from tag seed to site seed.
|
2020-02-12 02:19:43 +01:00 |
|
ThePendulum
|
2f70de8e11
|
Added preflight method to scrapers. Added Assylum.
|
2020-02-12 01:54:54 +01:00 |
|
ThePendulum
|
df4a2b0bb3
|
Fetching old scene links from Vivid search API.
|
2020-02-11 19:05:12 +01:00 |
|
ThePendulum
|
dd6a1d9bfd
|
Added Vivid network. Added ASMR Fantasy to Adult Time. Storing deep URL in database. Added href to header links.
|
2020-02-11 04:58:18 +01:00 |
|
ThePendulum
|
ce448da7e0
|
Added 21 Naturals and 21 Sextreme sites.
|
2020-02-10 23:11:11 +01:00 |
|
ThePendulum
|
139f0ce7cb
|
Allowing release scrapers to return actor details. Added True Amateurs.
|
2020-02-09 23:25:54 +01:00 |
|
ThePendulum
|
0f513266a0
|
Added Black for Wife to JayRock. Switched parameters field to JSON type.
|
2020-02-09 19:41:39 +01:00 |
|
ThePendulum
|
e61ed2bb5f
|
Added 21Sextreme and 21Naturals networks. Scraping all actor release pages for Brazzers.
|
2020-02-09 02:01:39 +01:00 |
|
ThePendulum
|
8ca458a8ff
|
Added Moms on Moms to Girlsway.
|
2020-02-08 05:16:04 +01:00 |
|
ThePendulum
|
d2cb74a252
|
Added Fantasy Massage sites. Improved Private scraper, added movie link.
|
2020-02-08 04:52:32 +01:00 |
|
ThePendulum
|
1546e0836c
|
Split Girlsway from Adult Time. Added Fantasy Massage. Using Gamma scraper for Pure Taboo. Added photo path parameter to Gamma scraper.
|
2020-02-08 02:49:39 +01:00 |
|
ThePendulum
|
5ba308f07a
|
Added Adult Time. Adding context to logger.
|
2020-02-07 19:53:16 +01:00 |
|
ThePendulum
|
6b56bad21e
|
Added Twistys.
|
2020-02-07 04:44:01 +01:00 |
|
ThePendulum
|
30963b94dd
|
Added profile releases for classic Fame Digital sites (Silvia Saint and Silverstone DVD).
|
2020-02-07 03:40:11 +01:00 |
|
ThePendulum
|
631ac34573
|
Blowpass now uses Gamma module for latest and upcoming.
|
2020-02-07 01:06:39 +01:00 |
|
ThePendulum
|
65f98c6387
|
Refactored 21Sextury module to use Gamma API.
|
2020-02-06 23:51:13 +01:00 |
|
ThePendulum
|
6e1de52a40
|
Added Fame Digital. Added actor release scraping to DDF Network. Improved q and Gamma scraper.
|
2020-02-06 23:15:28 +01:00 |
|
ThePendulum
|
38bab672d4
|
Better handling of empty profiles. Modified Score scraper for Big Tit Terry Nova. Improved Naughty America and various other logos.
|
2020-02-05 01:41:30 +01:00 |
|
ThePendulum
|
f921bb4ae9
|
Generating and using URL slugs for releases, improver slugify module. Added 'extract' parameter to MindGeek scraper to get scenes not associate with a channel (see Digital Playground). Added various high res logos.
|
2020-02-04 03:12:09 +01:00 |