ThePendulum
|
d97b1ab894
|
Split up profile scrape runner. Fixed wrong search document date key. Added search update CLI.
|
2020-03-10 23:46:55 +01:00 |
ThePendulum
|
db01599569
|
Added profile scraper with releases to Hush. Added qtexts to q to return text nodes individually. Including network in profile site.
|
2020-03-06 02:49:55 +01:00 |
ThePendulum
|
6d1f30f703
|
Passing matching site to profile scrapers. Allowing scrapers to pass avatar metadata. Added scraper and copyright properties to media. Auto-adding copyright from site or scraper to avatars. Separated Porn Pros from Whale Member.
|
2020-02-24 03:12:58 +01:00 |
ThePendulum
|
0d719d88ea
|
Removed Boob Pedia as gender source, unreliable.
|
2020-02-23 22:26:14 +01:00 |
ThePendulum
|
8359f78e2e
|
Fixed RK scraper returning dick size as bust size.
|
2020-02-23 22:01:12 +01:00 |
ThePendulum
|
0ede7e0f82
|
Added various Porn Pros archive sites.
|
2020-02-23 05:00:08 +01:00 |
ThePendulum
|
915eb75719
|
Refactored Vixen scraper, using API endpoint and added actor profile and releases scraper. Release scraper will return base release when present and 'deep' argument is false.
|
2020-02-22 23:25:10 +01:00 |
ThePendulum
|
97f5e49187
|
Refactored media module. Returning 320p and 720p videos from MindGeek as teasers instead of trailers.
|
2020-02-19 04:41:53 +01:00 |
ThePendulum
|
40bf476ea6
|
Fixed Porn Pros scraper. Added various Score site logos.
|
2020-02-18 16:00:36 +01:00 |
ThePendulum
|
2f70de8e11
|
Added preflight method to scrapers. Added Assylum.
|
2020-02-12 01:54:54 +01:00 |
ThePendulum
|
dd6a1d9bfd
|
Added Vivid network. Added ASMR Fantasy to Adult Time. Storing deep URL in database. Added href to header links.
|
2020-02-11 04:58:18 +01:00 |
ThePendulum
|
139f0ce7cb
|
Allowing release scrapers to return actor details. Added True Amateurs.
|
2020-02-09 23:25:54 +01:00 |
ThePendulum
|
0f513266a0
|
Added Black for Wife to JayRock. Switched parameters field to JSON type.
|
2020-02-09 19:41:39 +01:00 |
ThePendulum
|
9d9eda29be
|
Added scene count to actor inspect. Preferring network slug over data brand for scene URLs in MindGeek scraper, since milehighmedia.com's brand is milehigh, resulting in milehigh.com.
|
2020-02-09 03:09:06 +01:00 |
ThePendulum
|
1546e0836c
|
Split Girlsway from Adult Time. Added Fantasy Massage. Using Gamma scraper for Pure Taboo. Added photo path parameter to Gamma scraper.
|
2020-02-08 02:49:39 +01:00 |
ThePendulum
|
6e1de52a40
|
Added Fame Digital. Added actor release scraping to DDF Network. Improved q and Gamma scraper.
|
2020-02-06 23:15:28 +01:00 |
ThePendulum
|
d4801bb240
|
Returning window.document instead of element as document from q. Fixed actor collisions when scrapers return same scene multiple times. Scraping all Score actor release pages. Fixed 21Sextury and PureTaboo photo scraping.
|
2020-02-05 23:57:55 +01:00 |
ThePendulum
|
38bab672d4
|
Better handling of empty profiles. Modified Score scraper for Big Tit Terry Nova. Improved Naughty America and various other logos.
|
2020-02-05 01:41:30 +01:00 |
ThePendulum
|
f921bb4ae9
|
Generating and using URL slugs for releases, improver slugify module. Added 'extract' parameter to MindGeek scraper to get scenes not associate with a channel (see Digital Playground). Added various high res logos.
|
2020-02-04 03:12:09 +01:00 |
ThePendulum
|
ef602a3a15
|
Added basic filename copy. Added HTTP helper to q. Fetching all actor release pages from Naughty America. Added various high res network logos.
|
2020-02-04 00:18:53 +01:00 |
ThePendulum
|
5bae5b6e5f
|
Adapted Score scraper for 18eighteen, 40 Something Mag and 50 Plus Milfs. Updated Score network logo and favicon.
|
2020-02-03 02:57:53 +01:00 |
ThePendulum
|
a97c6defca
|
Added teaser support. Added Score network with scraper for Scoreland. Improved q. Added assets.
|
2020-02-02 05:14:58 +01:00 |
ThePendulum
|
cde9aba0cb
|
Redundant actor sources can now be bundled in configuration. Fixed Men network actor path.
|
2020-02-01 04:14:08 +01:00 |
ThePendulum
|
09ea3125df
|
Fixed release merge order.
|
2020-02-01 03:30:11 +01:00 |
ThePendulum
|
94bf207397
|
Added Wicked network. Merged Evil Angel, XEmpire and Wicked into generic Gamma scraper.
|
2020-02-01 01:15:40 +01:00 |
ThePendulum
|
ffdf0690e7
|
Added option to fetch all of an actor's releases (for supporter scrapers), and a utility to extract posters.
|
2020-01-31 01:55:55 +01:00 |
ThePendulum
|
345103d759
|
Fixed ;.
|
2020-01-27 01:54:42 +01:00 |
ThePendulum
|
eca65f6b4d
|
Inspecting performance.
|
2020-01-27 00:41:04 +00:00 |
ThePendulum
|
ab82329171
|
Improved q so missing date element returns null.
|
2020-01-25 01:46:58 +01:00 |
ThePendulum
|
c93116dee2
|
Added actor expand button to profile.
|
2020-01-24 23:36:06 +01:00 |
ThePendulum
|
6ef5c82c6a
|
Added URL helper to q. Getting social links from Boobpedia.
|
2020-01-23 23:32:51 +01:00 |
ThePendulum
|
9db0e97512
|
Improved actor profile flow. Added images.
|
2020-01-23 03:52:12 +01:00 |
ThePendulum
|
b92b9f3e18
|
Fixed actor avatar duplicates. Added new Jules Jordan logo.
|
2020-01-22 23:17:39 +01:00 |
ThePendulum
|
f8175f6054
|
Added generic Gamma photo and actor scraper for XEmpire, 21Sextury, Blowpass and Evil Angel.
|
2020-01-22 22:25:58 +01:00 |
ThePendulum
|
8f72e61928
|
Added Jay Rock network. Fixed site logo not showing up without URL.
|
2020-01-11 05:31:04 +01:00 |
ThePendulum
|
4b36de2f55
|
Fixed Evil Angel upcoming and actor association issues. Moving from console.log to logger.
|
2020-01-10 02:43:04 +01:00 |
ThePendulum
|
0a19f2e624
|
Added Bang! deep scrape. Improved network page layout. Added Bang Bros logos.
|
2020-01-07 04:23:28 +01:00 |
ThePendulum
|
70e27a6cd9
|
Moved networks to GraphQL.
|
2020-01-03 00:59:02 +01:00 |
ThePendulum
|
5a6bf2b42f
|
Further refactoring. Fixed actor pages and more.
|
2019-12-31 03:12:52 +01:00 |
ThePendulum
|
1c43884102
|
Refactoring client to reflect database changes.
|
2019-12-19 04:42:50 +01:00 |
ThePendulum
|
77307d2d13
|
Refactored media module to generalize avatar and poster storage into photo storage.
|
2019-12-13 03:28:52 +01:00 |
ThePendulum
|
18f37e3fbd
|
Moved all tag photos to public asset directory.
|
2019-12-11 02:25:25 +01:00 |
ThePendulum
|
b9bac6d8f9
|
Added Kelly Madison profile scraper.
|
2019-12-10 22:35:00 +01:00 |
ThePendulum
|
b6123b9418
|
Added source maps. Fixed DDFNetwork avatar and improved photo fetch error handling.
|
2019-12-10 00:30:55 +01:00 |
ThePendulum
|
04a89efa58
|
Refactored 21sextury scraper.
|
2019-12-09 05:00:49 +01:00 |
ThePendulum
|
55e3130062
|
Move tag posters and photos to media database.
|
2019-12-04 21:58:08 +01:00 |
ThePendulum
|
cf81aa99e0
|
Added rudimentary tags page. Improved social match behavior.
|
2019-12-01 05:32:47 +01:00 |
ThePendulum
|
bead69de49
|
Added basic actor and network overview. Added DDF Network actor scraper. Various bug fixes and layout improvements.
|
2019-11-30 05:55:32 +01:00 |
ThePendulum
|
0dbe853f39
|
Resolving actor birth and residence place before storage. Layout improvements.
|
2019-11-29 05:46:06 +01:00 |
ThePendulum
|
4be508b388
|
Drastic actor page redesign. Storing one avatar per actor, other profile photos as 'photo' role; no longer assuming first photo is avatar.
|
2019-11-28 05:36:22 +01:00 |
ThePendulum
|
884ef248e4
|
Fixed actor birthdate and social links scraping.
|
2019-11-27 05:12:51 +01:00 |
ThePendulum
|
d113123778
|
Fixed countries seed file. Updated MOFOS scraper. Improved Reality Kings scraper. Limiting photos for XEmpire scraper.
|
2019-11-27 04:58:38 +01:00 |
ThePendulum
|
de36ed97e4
|
Added profile scraping in try/catch block. Re-added boobs enhanced info to actor page.
|
2019-11-21 11:43:07 +01:00 |
ThePendulum
|
31a8f1cac1
|
Improved profile scrapers. Sorting avatars on actor page by index.
|
2019-11-21 04:24:55 +01:00 |
ThePendulum
|
9224b441e2
|
Added Brazzers and Jules Jordan as profile sources. Changed profile structure for proper bust-waist-hip properties and improved stability.
|
2019-11-21 04:05:32 +01:00 |
ThePendulum
|
9fcc40dd17
|
Added avatars. Added PornHub and LegalPorno actor profile scrapers.
|
2019-11-20 04:53:36 +01:00 |
ThePendulum
|
3ec7b15886
|
Improved scraping and association behavior.
|
2019-11-19 04:36:15 +01:00 |
ThePendulum
|
e8130c3634
|
Scraping actor profiles from FreeOnes.
|
2019-11-17 03:56:45 +01:00 |
ThePendulum
|
f9f9cc7977
|
Added tag filter to releases query, enabled on homepage.
|
2019-11-13 03:14:24 +01:00 |
ThePendulum
|
50816d7b28
|
Generating thumbnails. Added site overview page.
|
2019-11-11 03:20:00 +01:00 |
ThePendulum
|
a9b91ff76c
|
Added actors page. Added site logos with overview on network page.
|
2019-11-10 04:20:22 +01:00 |