DebaucheryLibrarian
|
cc83b832f1
|
Attach base actor to scenes scraped from profile.
|
2020-12-16 00:50:58 +01:00 |
|
DebaucheryLibrarian
|
2e0fba3de9
|
Added First Anal Quest and Double View Casting profile scrapers.
|
2020-12-04 23:53:20 +01:00 |
|
DebaucheryLibrarian
|
be1821b9eb
|
Changed --inspect to --report to avoid conflict with Node's own debug tools.
|
2020-12-02 21:26:55 +01:00 |
|
DebaucheryLibrarian
|
9a61d2305c
|
Added fixed actor age. Added male profiles to Littlr Caprice Dreams scraper. Added various tag photos.
|
2020-11-29 03:59:47 +01:00 |
|
DebaucheryLibrarian
|
71c884fe48
|
Improved Little Caprice Dreams scraper.
|
2020-11-28 00:46:30 +01:00 |
|
DebaucheryLibrarian
|
1b407254a7
|
Increased hard limit in release API.
|
2020-11-26 04:01:01 +01:00 |
|
DebaucheryLibrarian
|
d14ef90136
|
Scraping actor scenes from Hussie Pass. Adding entity to actor base releases.
|
2020-11-15 23:50:04 +01:00 |
|
DebaucheryLibrarian
|
df9a6eac05
|
Updated Hussie Pass scraper for new site design. Added cock size to profiles.
|
2020-11-15 04:33:24 +01:00 |
|
DebaucheryLibrarian
|
39f8c037a5
|
Replaced bhttp with patched fork. Improved Jesse Loads Monster Facials scraper reliability (WIP). Added various tag photos.
|
2020-10-30 17:37:10 +01:00 |
|
DebaucheryLibrarian
|
c37d4ad01f
|
Filtering invalid actors from releases before storing.
|
2020-10-29 16:06:20 +01:00 |
|
DebaucheryLibrarian
|
4469376dd2
|
Using temporary table instead of WHERE IN to stack depth error when finding duplicate actors.
|
2020-10-28 03:50:52 +01:00 |
|
DebaucheryLibrarian
|
3c84a814a8
|
Added Zero Tolerance with Addicted 2 Girls and GenderX.
|
2020-09-04 03:07:28 +02:00 |
|
DebaucheryLibrarian
|
f6353ca14c
|
Storing actor profile URL when provided from scene page.
|
2020-08-31 02:43:41 +02:00 |
|
DebaucheryLibrarian
|
1bfdf4b232
|
Storing actor profiles from scene pages.
|
2020-08-30 04:18:47 +02:00 |
|
DebaucheryLibrarian
|
2835c66694
|
Added chapters and shoot location. Added In The Crack.
|
2020-08-20 04:57:38 +02:00 |
|
DebaucheryLibrarian
|
50c5f921f5
|
Using new bulk insert utility for releases, media and actors.
|
2020-08-14 23:21:53 +02:00 |
|
DebaucheryLibrarian
|
7413d7db25
|
Improved and documented actor profile scraping.
|
2020-08-12 20:51:08 +02:00 |
|
DebaucheryLibrarian
|
747c2e1637
|
Checking nationality against alpha2 and alpha2. Improved Team Skeet profile scraper.
|
2020-07-23 04:39:12 +02:00 |
|
DebaucheryLibrarian
|
d56da74168
|
Added Hitzefrei. Fixed date averaging.
|
2020-07-21 04:04:07 +02:00 |
|
DebaucheryLibrarian
|
dff4d15872
|
Updated profile scrapers to use base actor instead of actor name. Fixes for Reality Kings and Cherry Pimps scrapers.
|
2020-07-21 01:44:51 +02:00 |
|
DebaucheryLibrarian
|
939eba8e61
|
Changed qu's HTML element detection. Passing base actor instead of actorName to profile scrapers.
|
2020-07-21 01:16:26 +02:00 |
|
DebaucheryLibrarian
|
a88c2f0760
|
Added m3u8 stream support to media module. Added Elegant Angel. Added regex parameter to qu's number method. Various tags.
|
2020-07-17 03:39:13 +02:00 |
|
DebaucheryLibrarian
|
66d6322c1d
|
Updated GraphQL queries to Datetime. Updated template to latest guideline.
|
2020-07-16 15:55:03 +02:00 |
 ThePendulum
|
6fd2bc2687
|
Added Kink profile scraper. Fixed --force causing media collisions.
|
2020-07-13 00:12:01 +02:00 |
|
ThePendulum
|
9c8cfe3bdb
|
Re-wrote broken Perv City scraper, added profile scraping.
|
2020-07-12 05:10:23 +02:00 |
|
ThePendulum
|
44a8ced30c
|
Separated actor expand buttons. Refactored Brazzers scraper. Fixed actor releases not included in shallow scrape. Added number query and data-src default to qu img. Updated README. Removed post-install migrate and seed.
|
2020-07-09 02:00:54 +02:00 |
|
ThePendulum
|
3462d7af2a
|
Entity refactor. Facilitating channels without parent.
|
2020-06-28 00:15:13 +02:00 |
|
ThePendulum
|
4959dfd14f
|
Refactored deep and store modules to use entities.
|
2020-06-25 02:26:25 +02:00 |
|
ThePendulum
|
f0a89df6ab
|
Refactoring to use entities over sites and networks.
|
2020-06-17 04:07:24 +02:00 |
|
ThePendulum
|
9843023c1f
|
Added Filthy Family and 'legacy' scraper to Bang Bros. Added trans generic avatar. Added pagination support to site actions.
|
2020-05-24 03:54:29 +02:00 |
|
ThePendulum
|
75d49517b7
|
Added pagination to actor overview. Lazy loading actor avatars. Reduced hash digest length.
|
2020-05-23 04:32:50 +02:00 |
|
ThePendulum
|
532a4b679b
|
Using batch insert for profiles to prevent errors on large inserts.
|
2020-05-21 03:44:44 +02:00 |
|
ThePendulum
|
b6691e1991
|
Added release type distinction to REST API.
|
2020-05-20 01:38:58 +02:00 |
|
ThePendulum
|
057362d011
|
Added basic release and actor API.
|
2020-05-20 01:11:32 +02:00 |
|
ThePendulum
|
6973d39cbd
|
Replacing one or multiple space-like characters with single space in actor description. Using logo thumbnails in descriptions.
|
2020-05-19 05:06:01 +02:00 |
|
ThePendulum
|
c0898b84d6
|
Showing all unique descriptions on profile with network logo. Fixed Fame Digital scraper.
|
2020-05-19 04:46:49 +02:00 |
|
ThePendulum
|
9883c3d9c2
|
Not scraping existing actor profiles unless --force is used.
|
2020-05-19 02:02:48 +02:00 |
|
ThePendulum
|
0c4628677f
|
Fixed profile location interpolation. Generalizing ethnicity, hair color and eye color.
|
2020-05-19 01:10:32 +02:00 |
|
ThePendulum
|
003e07491d
|
Added network to profile context when site is available.
|
2020-05-18 03:34:41 +02:00 |
|
ThePendulum
|
885aa4f627
|
Passing context object with site or network instead of scraper slug and 'site or network' to all profile scrapers.
|
2020-05-18 03:22:03 +02:00 |
|
ThePendulum
|
8733fdc657
|
Improved actor scraping and display.
|
2020-05-18 01:22:56 +02:00 |
|
ThePendulum
|
af5543190a
|
Showing avatar on release actor tile. Fixed social URL validation.
|
2020-05-17 05:24:46 +02:00 |
|
ThePendulum
|
61965d480c
|
Added birthday to Bang actor scraper.
|
2020-05-17 05:08:41 +02:00 |
|
ThePendulum
|
f42ca7bd52
|
Added Bang! actor scraper. Fixed date interpolation. Showing date and age of death on profile (only if actor has already died).
|
2020-05-17 04:59:09 +02:00 |
|
ThePendulum
|
7f86399033
|
Fixed averaging interpolating function.
|
2020-05-17 03:04:58 +02:00 |
|
ThePendulum
|
985ab9d2dc
|
Added profile interpolation.
|
2020-05-17 03:00:44 +02:00 |
|
ThePendulum
|
05ee57378a
|
Storing actor avatars. Using 1 second interval queue for location resolve as per OSM code of conduct.
|
2020-05-16 04:36:45 +02:00 |
|
ThePendulum
|
21d4dd6bfa
|
Scraping and storing actor profiles.
|
2020-05-15 04:40:59 +02:00 |
|
ThePendulum
|
11eb66f834
|
Switched to tabs. Adding missing actor entries when scraping actors, with batch ID.
|
2020-05-14 04:26:05 +02:00 |
|
ThePendulum
|
f1eb29c713
|
Added thumb and lazy image scripts. Added FreeOnes and Boobpedia as sites.
|
2020-05-13 23:17:39 +02:00 |
|
ThePendulum
|
dac451bb86
|
Using alias actor ID when available. Using basic SVG flags instead of PNG. Moved PNG and HD SVG flags to assets.
|
2020-05-13 20:27:06 +02:00 |
|
ThePendulum
|
6040a3f41f
|
Associating actors without network.
|
2020-05-13 02:56:20 +02:00 |
|
ThePendulum
|
95d115b585
|
Added Aziani. Added URL origin parameter to relevant qu methods.
|
2020-03-28 01:40:02 +01:00 |
|
ThePendulum
|
fb59bf552a
|
Added actor assignment to new actors module. Showing network icon on network-specific actors. Improved dark theme. Changed tag tile design. Added Digital Playground logos.
|
2020-03-27 04:39:13 +01:00 |
|
ThePendulum
|
d29e296799
|
Added database structure for profiles and tattoos. Improved sidebar appearance. Expanded new actors module.
|
2020-03-26 03:32:07 +01:00 |
|
ThePendulum
|
d724f96728
|
Added new actors module boilerplate. Added tag posters.
|
2020-03-24 03:48:24 +01:00 |
|
ThePendulum
|
0f09fd53eb
|
Refactoring deep scrape. Added tag posters.
|
2020-03-16 04:10:52 +01:00 |
|
ThePendulum
|
370605554b
|
Added profile scraper with scenes to BAM Visions. Passing 'includes' object instead of withReleases boolean to Gamma.
|
2020-03-12 02:19:45 +01:00 |
|
ThePendulum
|
0d0acb6f3c
|
Fixed release sites for profile scraping.
|
2020-03-11 03:01:37 +01:00 |
|
ThePendulum
|
d97b1ab894
|
Split up profile scrape runner. Fixed wrong search document date key. Added search update CLI.
|
2020-03-10 23:46:55 +01:00 |
|
ThePendulum
|
db01599569
|
Added profile scraper with releases to Hush. Added qtexts to q to return text nodes individually. Including network in profile site.
|
2020-03-06 02:49:55 +01:00 |
|
ThePendulum
|
6d1f30f703
|
Passing matching site to profile scrapers. Allowing scrapers to pass avatar metadata. Added scraper and copyright properties to media. Auto-adding copyright from site or scraper to avatars. Separated Porn Pros from Whale Member.
|
2020-02-24 03:12:58 +01:00 |
|
ThePendulum
|
0d719d88ea
|
Removed Boob Pedia as gender source, unreliable.
|
2020-02-23 22:26:14 +01:00 |
|
ThePendulum
|
8359f78e2e
|
Fixed RK scraper returning dick size as bust size.
|
2020-02-23 22:01:12 +01:00 |
|
ThePendulum
|
0ede7e0f82
|
Added various Porn Pros archive sites.
|
2020-02-23 05:00:08 +01:00 |
|
ThePendulum
|
915eb75719
|
Refactored Vixen scraper, using API endpoint and added actor profile and releases scraper. Release scraper will return base release when present and 'deep' argument is false.
|
2020-02-22 23:25:10 +01:00 |
|
ThePendulum
|
97f5e49187
|
Refactored media module. Returning 320p and 720p videos from MindGeek as teasers instead of trailers.
|
2020-02-19 04:41:53 +01:00 |
|
ThePendulum
|
40bf476ea6
|
Fixed Porn Pros scraper. Added various Score site logos.
|
2020-02-18 16:00:36 +01:00 |
|
ThePendulum
|
2f70de8e11
|
Added preflight method to scrapers. Added Assylum.
|
2020-02-12 01:54:54 +01:00 |
|
ThePendulum
|
dd6a1d9bfd
|
Added Vivid network. Added ASMR Fantasy to Adult Time. Storing deep URL in database. Added href to header links.
|
2020-02-11 04:58:18 +01:00 |
|
ThePendulum
|
139f0ce7cb
|
Allowing release scrapers to return actor details. Added True Amateurs.
|
2020-02-09 23:25:54 +01:00 |
|
ThePendulum
|
0f513266a0
|
Added Black for Wife to JayRock. Switched parameters field to JSON type.
|
2020-02-09 19:41:39 +01:00 |
|
ThePendulum
|
9d9eda29be
|
Added scene count to actor inspect. Preferring network slug over data brand for scene URLs in MindGeek scraper, since milehighmedia.com's brand is milehigh, resulting in milehigh.com.
|
2020-02-09 03:09:06 +01:00 |
|
ThePendulum
|
1546e0836c
|
Split Girlsway from Adult Time. Added Fantasy Massage. Using Gamma scraper for Pure Taboo. Added photo path parameter to Gamma scraper.
|
2020-02-08 02:49:39 +01:00 |
|
ThePendulum
|
6e1de52a40
|
Added Fame Digital. Added actor release scraping to DDF Network. Improved q and Gamma scraper.
|
2020-02-06 23:15:28 +01:00 |
|
ThePendulum
|
d4801bb240
|
Returning window.document instead of element as document from q. Fixed actor collisions when scrapers return same scene multiple times. Scraping all Score actor release pages. Fixed 21Sextury and PureTaboo photo scraping.
|
2020-02-05 23:57:55 +01:00 |
|
ThePendulum
|
38bab672d4
|
Better handling of empty profiles. Modified Score scraper for Big Tit Terry Nova. Improved Naughty America and various other logos.
|
2020-02-05 01:41:30 +01:00 |
|
ThePendulum
|
f921bb4ae9
|
Generating and using URL slugs for releases, improver slugify module. Added 'extract' parameter to MindGeek scraper to get scenes not associate with a channel (see Digital Playground). Added various high res logos.
|
2020-02-04 03:12:09 +01:00 |
|
ThePendulum
|
ef602a3a15
|
Added basic filename copy. Added HTTP helper to q. Fetching all actor release pages from Naughty America. Added various high res network logos.
|
2020-02-04 00:18:53 +01:00 |
|
ThePendulum
|
5bae5b6e5f
|
Adapted Score scraper for 18eighteen, 40 Something Mag and 50 Plus Milfs. Updated Score network logo and favicon.
|
2020-02-03 02:57:53 +01:00 |
|
ThePendulum
|
a97c6defca
|
Added teaser support. Added Score network with scraper for Scoreland. Improved q. Added assets.
|
2020-02-02 05:14:58 +01:00 |
|
ThePendulum
|
cde9aba0cb
|
Redundant actor sources can now be bundled in configuration. Fixed Men network actor path.
|
2020-02-01 04:14:08 +01:00 |
|
ThePendulum
|
09ea3125df
|
Fixed release merge order.
|
2020-02-01 03:30:11 +01:00 |
|
ThePendulum
|
94bf207397
|
Added Wicked network. Merged Evil Angel, XEmpire and Wicked into generic Gamma scraper.
|
2020-02-01 01:15:40 +01:00 |
|
ThePendulum
|
ffdf0690e7
|
Added option to fetch all of an actor's releases (for supporter scrapers), and a utility to extract posters.
|
2020-01-31 01:55:55 +01:00 |
|
ThePendulum
|
345103d759
|
Fixed ;.
|
2020-01-27 01:54:42 +01:00 |
|
ThePendulum
|
eca65f6b4d
|
Inspecting performance.
|
2020-01-27 00:41:04 +00:00 |
|
ThePendulum
|
ab82329171
|
Improved q so missing date element returns null.
|
2020-01-25 01:46:58 +01:00 |
|
ThePendulum
|
c93116dee2
|
Added actor expand button to profile.
|
2020-01-24 23:36:06 +01:00 |
|
ThePendulum
|
6ef5c82c6a
|
Added URL helper to q. Getting social links from Boobpedia.
|
2020-01-23 23:32:51 +01:00 |
|
ThePendulum
|
9db0e97512
|
Improved actor profile flow. Added images.
|
2020-01-23 03:52:12 +01:00 |
|
ThePendulum
|
b92b9f3e18
|
Fixed actor avatar duplicates. Added new Jules Jordan logo.
|
2020-01-22 23:17:39 +01:00 |
|
ThePendulum
|
f8175f6054
|
Added generic Gamma photo and actor scraper for XEmpire, 21Sextury, Blowpass and Evil Angel.
|
2020-01-22 22:25:58 +01:00 |
|
ThePendulum
|
8f72e61928
|
Added Jay Rock network. Fixed site logo not showing up without URL.
|
2020-01-11 05:31:04 +01:00 |
|
ThePendulum
|
4b36de2f55
|
Fixed Evil Angel upcoming and actor association issues. Moving from console.log to logger.
|
2020-01-10 02:43:04 +01:00 |
|
ThePendulum
|
0a19f2e624
|
Added Bang! deep scrape. Improved network page layout. Added Bang Bros logos.
|
2020-01-07 04:23:28 +01:00 |
|
ThePendulum
|
70e27a6cd9
|
Moved networks to GraphQL.
|
2020-01-03 00:59:02 +01:00 |
|
ThePendulum
|
5a6bf2b42f
|
Further refactoring. Fixed actor pages and more.
|
2019-12-31 03:12:52 +01:00 |
|
ThePendulum
|
1c43884102
|
Refactoring client to reflect database changes.
|
2019-12-19 04:42:50 +01:00 |
|
ThePendulum
|
77307d2d13
|
Refactored media module to generalize avatar and poster storage into photo storage.
|
2019-12-13 03:28:52 +01:00 |