DebaucheryLibrarian
|
52218c30f8
|
Not fetching mobile Gamma page when photos are not expected.
|
2022-01-29 16:38:36 +01:00 |
|
DebaucheryLibrarian
|
5c5a11fdca
|
Added Bang Bros members page scraper (not for full scenes).
|
2022-01-29 01:21:41 +01:00 |
|
DebaucheryLibrarian
|
90bc2f3724
|
Changed release media association existence check, added log for details.
|
2022-01-28 04:05:29 +01:00 |
|
DebaucheryLibrarian
|
67d0a9e0e0
|
Fixed scene entity tag association.
|
2022-01-26 01:47:34 +01:00 |
|
DebaucheryLibrarian
|
452f725332
|
Switched poster URL preference in Gamma scraper to prevent cropped image on XEmpire.
|
2022-01-25 15:34:15 +01:00 |
|
DebaucheryLibrarian
|
7ceec1c739
|
Added indexes to scene tag and movie scene tables improve performance. Removed scene count from channel overview, too expensive.
|
2022-01-24 00:15:11 +01:00 |
|
DebaucheryLibrarian
|
cd8f690ac6
|
Preferring network over channel in deep URL channel matching.
|
2022-01-23 02:46:42 +01:00 |
|
DebaucheryLibrarian
|
c557f0f1f0
|
Improved Gamma image sources to prevent cropped images.
|
2022-01-22 23:20:08 +01:00 |
|
DebaucheryLibrarian
|
20da2d1cf6
|
Reusing batch ID for movies to preserve new-flag.
|
2022-01-20 00:54:10 +01:00 |
|
DebaucheryLibrarian
|
372db86927
|
Disabled MindGeek session bundling to analyze Too Many Requests errors.
|
2022-01-16 22:24:47 +01:00 |
|
DebaucheryLibrarian
|
57d46f5842
|
Fixed latest query in Gamma scraper.
|
2022-01-16 17:17:45 +01:00 |
|
DebaucheryLibrarian
|
bbd788699e
|
Fixed GraphQL query for scenes REST API. Added entry ID to scene search document.
|
2022-01-12 17:50:23 +01:00 |
|
DebaucheryLibrarian
|
506971b44b
|
Chunked duplicate check to prevent postgres stack depth errors.
|
2022-01-10 02:17:17 +01:00 |
|
DebaucheryLibrarian
|
baebdbc0bb
|
Adding comment listing sister sites for non-exclusive Gamma API scenes.
|
2022-01-07 01:07:41 +01:00 |
|
DebaucheryLibrarian
|
6760c11881
|
Disabled why-is-node-running to assess OOM.
|
2021-12-31 01:45:03 +01:00 |
|
DebaucheryLibrarian
|
3b958a02ef
|
Added memory profiler configuration options.
|
2021-12-27 22:36:01 +01:00 |
|
DebaucheryLibrarian
|
299f257a01
|
Logging memory usage on media fetch.
|
2021-12-27 17:29:23 +01:00 |
|
DebaucheryLibrarian
|
3bfe1e8fdb
|
Storing scenes before fetching movies.
|
2021-12-20 03:29:14 +01:00 |
|
DebaucheryLibrarian
|
7d992f4129
|
Added triggers to memory dump.
|
2021-12-20 02:28:59 +01:00 |
|
DebaucheryLibrarian
|
280032937f
|
Added centralized movie page fetcher. Added memory heap dump.
|
2021-12-20 02:22:10 +01:00 |
|
DebaucheryLibrarian
|
dc187a9a3a
|
Added execute method to qu, removed runScripts from Gamma's fetchMovie to observe effect on memory usage.
|
2021-12-19 23:03:44 +01:00 |
|
DebaucheryLibrarian
|
1c0c30be11
|
Improved and re-enabled why-is-node-running logger.
|
2021-12-18 23:44:51 +01:00 |
|
DebaucheryLibrarian
|
8e4be06675
|
Closing JSDOM window after deep scrapes in an attempt to save memory.
|
2021-12-18 23:22:35 +01:00 |
|
DebaucheryLibrarian
|
65e2b72c6a
|
Fixed Gamma movie scraper failing when data object is not available.
|
2021-12-13 01:20:02 +01:00 |
|
DebaucheryLibrarian
|
5b5688438c
|
Fixed Gamma movie scene query. Added tag photos.
|
2021-12-11 22:46:55 +01:00 |
|
DebaucheryLibrarian
|
ec4e7bc12a
|
Updated Jules Jordan scraper for Sperm Swallowers and The Ass Factory.
|
2021-12-05 23:59:17 +01:00 |
|
DebaucheryLibrarian
|
26d15c0a6f
|
Updated Jules Jordan scraper for Manuel Ferrara and Girl Girl.
|
2021-12-05 23:43:23 +01:00 |
|
DebaucheryLibrarian
|
e88554666c
|
Reduced media concurrency to assess effect on memory. Moved qu context removal to deep scrape runner. Updated movie graphql queries.
|
2021-12-05 02:54:55 +01:00 |
|
DebaucheryLibrarian
|
abd063a578
|
Removed window map from http module to prevent memory pile-up with update scraping.
|
2021-12-04 00:32:28 +01:00 |
|
DebaucheryLibrarian
|
1918dd4ad5
|
Removing query methods from XEmpire release.
|
2021-12-02 00:45:22 +01:00 |
|
DebaucheryLibrarian
|
61daf5f037
|
Added debug log for jsdom window closing.
|
2021-12-01 23:44:25 +01:00 |
|
DebaucheryLibrarian
|
60c151ff6a
|
Reduced deep scrape concurrency to 1.
|
2021-12-01 23:39:09 +01:00 |
|
DebaucheryLibrarian
|
e41f9fa937
|
Added waitImmediate to deep scrape, reduced concurrency.
|
2021-12-01 23:30:10 +01:00 |
|
DebaucheryLibrarian
|
e29cbc9fea
|
Closing JSDOM window after deep scrape in an attempt to save memory. Reduced deep scrape concurrency to 5.
|
2021-12-01 17:26:13 +01:00 |
|
DebaucheryLibrarian
|
b93a5715cb
|
Updated Jules Jordan scraper for new update page layout.
|
2021-12-01 00:00:24 +01:00 |
|
DebaucheryLibrarian
|
87094a9498
|
Replaced cheerio with qu in Gamma scraper.
|
2021-11-29 02:49:07 +01:00 |
|
DebaucheryLibrarian
|
f04eb72891
|
Added upcoming scraper to PurgatoryX.
|
2021-11-28 01:20:39 +01:00 |
|
DebaucheryLibrarian
|
9d7183ac69
|
Added PurgatoryX scraper.
|
2021-11-27 23:55:16 +01:00 |
|
DebaucheryLibrarian
|
20d0d860d3
|
Fixed MindGeek scraper trying to acquire session from mindgeek.com
|
2021-11-22 02:51:52 +01:00 |
|
DebaucheryLibrarian
|
6b4aa64d74
|
Improved MindGeek scraper session check to prevent crash when network session isn't available yet.
|
2021-11-22 02:44:03 +01:00 |
|
DebaucheryLibrarian
|
e81864ebde
|
Removed verbose http queued output.
|
2021-11-21 00:47:32 +01:00 |
|
DebaucheryLibrarian
|
0305a22a24
|
Removed stray console log from media module.
|
2021-11-21 00:43:35 +01:00 |
|
DebaucheryLibrarian
|
2be3ea9bbb
|
Explicitly adding headers to http module result.
|
2021-11-21 00:41:12 +01:00 |
|
DebaucheryLibrarian
|
98c103c625
|
Fixed uuid import. Changed fs rmdir to rm.
|
2021-11-21 00:31:09 +01:00 |
|
DebaucheryLibrarian
|
f0b7678444
|
Fixed upsert failing on empty insert array due breaking Knex API change.
|
2021-11-21 00:19:10 +01:00 |
|
DebaucheryLibrarian
|
26539b74a5
|
Updated dependencies. Added periodic memory logger.
|
2021-11-20 23:59:48 +01:00 |
|
DebaucheryLibrarian
|
ccb99e278c
|
Added periodic memory logger.
|
2021-11-20 23:59:15 +01:00 |
|
DebaucheryLibrarian
|
29b8c5e38e
|
Including unextracted scenes in date determination.
|
2021-10-28 02:10:30 +02:00 |
|
DebaucheryLibrarian
|
0864154a0e
|
Added unextracted property to keep paginating when extracting scenes.
|
2021-10-28 01:59:53 +02:00 |
|
DebaucheryLibrarian
|
a22c4d5679
|
Added beforeNetwork hook, used by MindGeek. Added Filthy Kings to Gamma.
|
2021-10-27 17:19:23 +02:00 |
|
DebaucheryLibrarian
|
100a35b4e8
|
Added before scene fetch method to prevent e.g. unnecessary session requests, moved scraper assignment to entity lookup. Removed channel URL hostname matching..
|
2021-10-26 23:42:32 +02:00 |
|
DebaucheryLibrarian
|
6c5d4389fe
|
Not parsing HTML with jsdom when using http module directly to save memory. Added loading ellipsis to release grid pages.
|
2021-10-25 02:06:24 +02:00 |
|
DebaucheryLibrarian
|
0e4fd12d70
|
Added more loggers to http module.
|
2021-10-20 01:46:56 +02:00 |
|
DebaucheryLibrarian
|
972b15e72d
|
Added memory profiling.
|
2021-10-17 23:56:49 +02:00 |
|
DebaucheryLibrarian
|
49f891ba44
|
Ignoring 1-second scene duration from MindGeek API.
|
2021-10-17 19:59:05 +02:00 |
|
DebaucheryLibrarian
|
167df35d37
|
Fixed tags module not dealing with empty releases or tags, added origin tag column to chapter tag table.
|
2021-10-17 00:28:13 +02:00 |
|
DebaucheryLibrarian
|
b6ad2903f3
|
Storing original tags.
|
2021-10-10 00:04:21 +02:00 |
|
DebaucheryLibrarian
|
dbff3e9539
|
Added Brad Montana. Added teaser link to trailer video.
|
2021-09-28 20:45:22 +02:00 |
|
DebaucheryLibrarian
|
522584711b
|
Added Teen Mega World scraper.
|
2021-09-17 03:30:49 +02:00 |
|
DebaucheryLibrarian
|
a316da3083
|
Retrieving Spizoo trailers.
|
2021-09-14 00:42:51 +02:00 |
|
DebaucheryLibrarian
|
b164c5dad7
|
Added Spizoo.
|
2021-09-13 01:29:39 +02:00 |
|
DebaucheryLibrarian
|
d542889827
|
Added sections and pagination to stash page.
|
2021-09-12 00:05:45 +02:00 |
|
DebaucheryLibrarian
|
7bd858f96b
|
Generalized Adult Empire subsite scraper, added West Coast Productions.
|
2021-08-30 01:13:32 +02:00 |
|
DebaucheryLibrarian
|
69a7e8f13d
|
Fixed PornDoe scraper.
|
2021-08-26 01:14:54 +02:00 |
|
DebaucheryLibrarian
|
23537e0243
|
Removed Gamma console logs.
|
2021-08-24 02:56:59 +02:00 |
|
DebaucheryLibrarian
|
245f69a122
|
Fixed movie bindings.
|
2021-08-24 02:54:40 +02:00 |
|
DebaucheryLibrarian
|
bb384029ac
|
Disabled eager searching except for entities. Updating movie search document on store.
|
2021-08-23 01:54:22 +02:00 |
|
DebaucheryLibrarian
|
6a8c9d89cb
|
Using paginated full text search for movies, combined actor search and fetch to allow combining search with filters.
|
2021-08-22 22:25:20 +02:00 |
|
DebaucheryLibrarian
|
f00e37490c
|
Finished Cum Louder scraper, updated Vixen scraper. Added tag posters.
|
2021-08-17 19:25:10 +02:00 |
|
DebaucheryLibrarian
|
b08cb46ae5
|
Removed stray console log.
|
2021-08-15 13:21:02 +02:00 |
|
DebaucheryLibrarian
|
aacfd1b29d
|
Updated object-merge-advanced API use.
|
2021-08-15 13:16:48 +02:00 |
|
DebaucheryLibrarian
|
a848d6991b
|
Added Diabolic and Cum Louder, added content type expect option to media sources to fix Vixen thumbnails.
|
2021-08-09 10:31:12 +02:00 |
|
DebaucheryLibrarian
|
6847ef690c
|
Added Arch Angel, updated BAM Visions scraper to accomodate Arch Angel (different network, same unidentified CMS).
|
2021-07-06 00:01:44 +02:00 |
|
DebaucheryLibrarian
|
23b41fc4f3
|
Fixed Bang scraper. Added Kink affiliate, tag photos.
|
2021-07-05 00:06:18 +02:00 |
|
DebaucheryLibrarian
|
eb7009832a
|
Added rudimentary affiliate banner setup. Separated login and signup disable. Added various tag photos.
|
2021-06-28 00:05:24 +02:00 |
|
DebaucheryLibrarian
|
d1480da076
|
Added effective date column. Changed warning page theme.
|
2021-06-19 18:09:58 +02:00 |
|
DebaucheryLibrarian
|
ab1329dd67
|
Updating entity ID for rescraped scenes with network entry IDs enabled.
|
2021-06-13 16:49:27 +02:00 |
|
DebaucheryLibrarian
|
e9a0700742
|
Improved upcoming update query.
|
2021-06-06 01:09:32 +02:00 |
|
DebaucheryLibrarian
|
3f473589ad
|
Using bulk insert utility for alert notifications to prevent duplicate errors (fixed).
|
2021-06-04 03:22:40 +02:00 |
|
DebaucheryLibrarian
|
bed329cd8c
|
Using bulk insert utility for alert notifications to prevent duplicate errors.
|
2021-06-04 03:10:41 +02:00 |
|
DebaucheryLibrarian
|
c979173422
|
Rescraping upcoming scenes. Fixed language and scene deep scraping for Dorcel scraper.
|
2021-06-02 03:27:32 +02:00 |
|
DebaucheryLibrarian
|
846b860c06
|
Hiding scene photos and trailers from guests.
|
2021-05-15 02:51:52 +02:00 |
|
DebaucheryLibrarian
|
3f55b90ab8
|
Adding alerted scene to stashes.
|
2021-04-29 01:45:01 +02:00 |
|
DebaucheryLibrarian
|
8bf9fff7dc
|
Triggering notifications for children of alert entities. Showing icons in alert entity search to distinguish networks and channels.
|
2021-04-26 00:48:31 +02:00 |
|
DebaucheryLibrarian
|
eed563e06f
|
Updating video player when switching scene page.
|
2021-04-25 04:20:38 +02:00 |
|
DebaucheryLibrarian
|
fc1c2fc2f3
|
Added notification clear, improved notification styling.
|
2021-04-25 03:08:50 +02:00 |
|
DebaucheryLibrarian
|
f8a3bf6a64
|
Updated scene URLs in Vixen scraper.
|
2021-04-22 19:49:11 +02:00 |
|
DebaucheryLibrarian
|
c5e74c33b7
|
Improved alert notifications.
|
2021-04-22 19:44:23 +02:00 |
|
DebaucheryLibrarian
|
95f3b1c03a
|
Added rudimentary notifications for set alerts.
|
2021-04-17 01:10:45 +02:00 |
|
DebaucheryLibrarian
|
7f25846d55
|
List alerts in profile
|
2021-04-05 00:48:03 +02:00 |
|
DebaucheryLibrarian
|
d36e52d5d1
|
Added row level security to alert tables. Added alerts to user query.
|
2021-04-04 22:52:54 +02:00 |
|
DebaucheryLibrarian
|
da0cbced15
|
Added alert dialog. Fixed image rotation EXIT data being discarded.
|
2021-04-04 21:52:19 +02:00 |
|
DebaucheryLibrarian
|
010da8954b
|
Fixed MYLF scraper failing when channel is missing, fixed profile measurement matching. Added MYLF Selects channel.
|
2021-03-29 22:47:43 +02:00 |
|
DebaucheryLibrarian
|
c386a9098f
|
Generalized Team Skeet scraper, added MYLF network and various Team Skeet partner channels.
|
2021-03-29 22:22:56 +02:00 |
|
DebaucheryLibrarian
|
3961f83ef6
|
Fixed animated poster being overwritten as jpeg.
|
2021-03-26 01:47:40 +01:00 |
|
DebaucheryLibrarian
|
193af9bab5
|
Fixed session options in http module.
|
2021-03-23 15:25:21 +01:00 |
|
DebaucheryLibrarian
|
c70f500acc
|
Fixed stashed check breaking on empty stashes in PostGraphile plugins.
|
2021-03-21 04:34:04 +01:00 |
|
DebaucheryLibrarian
|
9ff70e5578
|
Separated full heart button into component.
|
2021-03-21 03:46:59 +01:00 |
|
DebaucheryLibrarian
|
348aa91832
|
Added stash menu to release page, returning stashes from stash API to avoid reloading or local interpolation.
|
2021-03-21 03:23:58 +01:00 |
|
DebaucheryLibrarian
|
eee47111a6
|
Added delete stash icons and dialog.
|
2021-03-20 23:03:13 +01:00 |
|
DebaucheryLibrarian
|
07643870cd
|
Updating stash button locally on actor and scene page.
|
2021-03-20 18:12:06 +01:00 |
|
DebaucheryLibrarian
|
e88cf4e3f4
|
Separated user page stash component.
|
2021-03-20 02:49:17 +01:00 |
|
DebaucheryLibrarian
|
4bc6ff846d
|
Added public visibility toggle to user page stashes.
|
2021-03-20 02:03:30 +01:00 |
|
DebaucheryLibrarian
|
e301e2184c
|
Fixed undefined user ID in postgres function. Fixed and improved mobile alignment for new and stash icons on scene tile.
|
2021-03-20 00:12:12 +01:00 |
|
DebaucheryLibrarian
|
731a2792c5
|
Added favorite stash heart to scene tiles.
|
2021-03-19 03:27:48 +01:00 |
|
DebaucheryLibrarian
|
862a29bb6e
|
Using thumbnail size instead of original photo size in image tags.
|
2021-03-18 04:36:04 +01:00 |
|
DebaucheryLibrarian
|
5a2e93e900
|
Added various tag photos and descriptions.
|
2021-03-17 05:11:17 +01:00 |
|
DebaucheryLibrarian
|
336b91c872
|
Refactored http timeout handling.
|
2021-03-17 02:09:34 +01:00 |
|
DebaucheryLibrarian
|
0d7a03f3e5
|
Allowing auth to be disabled in config.
|
2021-03-16 04:12:05 +01:00 |
|
DebaucheryLibrarian
|
1703e9a541
|
Moved http timeout cancelation before pipeline to prevent large files from getting canceled.
|
2021-03-16 03:59:36 +01:00 |
|
DebaucheryLibrarian
|
1fb7d384fb
|
Merge branch 'master' into experimental
|
2021-03-15 04:16:36 +01:00 |
|
DebaucheryLibrarian
|
7c7b38e869
|
Inserting user ID to PostGraphile if available.
|
2021-03-15 04:16:32 +01:00 |
|
DebaucheryLibrarian
|
a0be8f0aa3
|
Accounting for missing options in http utility timeout function.
|
2021-03-15 04:13:09 +01:00 |
|
DebaucheryLibrarian
|
cb447da7d0
|
Added harder timeouts to http utility. Split owner and query database users.
|
2021-03-15 04:11:14 +01:00 |
|
DebaucheryLibrarian
|
77b40817f2
|
Added favorites button to actor page.
|
2021-03-15 03:30:47 +01:00 |
|
DebaucheryLibrarian
|
e371e9725a
|
Added stashes with experimental row security policies. Added tag photos.
|
2021-03-14 04:54:53 +01:00 |
|
DebaucheryLibrarian
|
816529b0ca
|
Added user sign up and login.
|
2021-03-13 04:26:24 +01:00 |
|
DebaucheryLibrarian
|
00c06778ef
|
Only scraping profile source matching actor entity, changed avatar entropy cut-off from 6 to 5.5.
|
2021-03-11 04:16:59 +01:00 |
|
DebaucheryLibrarian
|
a71752b18b
|
Associating directors separately from actors. Added tag photos.
|
2021-03-08 01:06:57 +01:00 |
|
DebaucheryLibrarian
|
de460f53b1
|
Changed album close behavior so album can be closed when visiting URL directly.
|
2021-03-07 16:54:20 +01:00 |
|
DebaucheryLibrarian
|
a275d0c855
|
Smaller tag logo on small displays. Centering tag tile lazy image to prevent load jumps. Including SASS breakpoint variable file automatically.
|
2021-03-07 16:39:54 +01:00 |
|
DebaucheryLibrarian
|
44bb9b33d9
|
Added intermittent process report to debug freezes. Removed original images.
|
2021-03-07 02:09:37 +01:00 |
|
DebaucheryLibrarian
|
17e6f5a5da
|
Storing directors.
|
2021-03-07 00:01:02 +01:00 |
|
DebaucheryLibrarian
|
254e933740
|
Added permanent filter for invalid actor associations.
|
2021-03-04 00:31:31 +01:00 |
|
DebaucheryLibrarian
|
780993eb63
|
Added debug log for actor associations.
|
2021-03-03 13:56:50 +01:00 |
|
DebaucheryLibrarian
|
c2ec4c15e3
|
Added basic filter for actor boob size.
|
2021-03-01 02:41:53 +01:00 |
|
DebaucheryLibrarian
|
eca24a7c65
|
Added WP boob filter to actors page.
|
2021-02-28 03:38:54 +01:00 |
|
DebaucheryLibrarian
|
8eebcae85d
|
Using direct parent as release actor entity instead of highest parent.
|
2021-02-27 21:59:33 +01:00 |
|
DebaucheryLibrarian
|
c2a008afbe
|
Added mimetype check to teasers and trailers. Added chapters to MindGeek scraper, fixed scene ID extraction getting stuck on numbers in domain name. Ordering chapters by timestamp.
|
2021-02-27 18:05:06 +01:00 |
|
DebaucheryLibrarian
|
a45c5f8f37
|
Added tags to chapters in API.
|
2021-02-27 17:19:07 +01:00 |
|
DebaucheryLibrarian
|
e55bc1ef33
|
Re-added trailer to scene API query.
|
2021-02-27 04:05:38 +01:00 |
|
DebaucheryLibrarian
|
e60153ad01
|
Curating chapter media.
|
2021-02-27 03:57:37 +01:00 |
|
DebaucheryLibrarian
|
2deed3a7eb
|
Added internal GraphQL client, using GraphQL for scenes API.
|
2021-02-27 03:52:27 +01:00 |
|
DebaucheryLibrarian
|
bb20659934
|
Refactored clips into chapters.
|
2021-02-27 00:37:22 +01:00 |
|
DebaucheryLibrarian
|
0eba0461c9
|
Added error handler to web server.
|
2021-02-26 19:39:48 +01:00 |
|
DebaucheryLibrarian
|
f018735052
|
Added relevance filter to search REST API.
|
2021-02-26 17:29:02 +01:00 |
|
DebaucheryLibrarian
|
4ca6c37cc8
|
Added relevance to REST release search API, sorting by relevance rank. Improved search result table column naming.
|
2021-02-26 17:22:54 +01:00 |
|
DebaucheryLibrarian
|
20129eca5d
|
Fixed Bang scraper.
|
2021-02-26 02:52:39 +01:00 |
|
DebaucheryLibrarian
|
b4129891dc
|
Improved query curation in release search function.
|
2021-02-25 15:58:54 +01:00 |
|
DebaucheryLibrarian
|
7818328378
|
Refactored PG search function to allow superflous words in search query.
|
2021-02-25 02:52:45 +01:00 |
|
DebaucheryLibrarian
|
fb2217a733
|
Preventing actor entry ID from being inserted without entity ID.
|
2021-02-24 02:43:34 +01:00 |
|
DebaucheryLibrarian
|
ff862dbff9
|
Removed debug log.
|
2021-02-23 04:10:03 +01:00 |
|
DebaucheryLibrarian
|
fae288633c
|
Catching actor association errors so it does not inhibit media association.
|
2021-02-23 04:09:33 +01:00 |
|
DebaucheryLibrarian
|
f44cb8bf4c
|
Merge branch 'master' into experimental
|
2021-02-23 03:36:56 +01:00 |
|
DebaucheryLibrarian
|
c32a5d2930
|
Added debug log for actor entries.
|
2021-02-23 03:36:48 +01:00 |
|
DebaucheryLibrarian
|
2b5aac7633
|
Fixed S3 display support for movies.
|
2021-02-23 01:30:38 +01:00 |
|
DebaucheryLibrarian
|
c1829c64c2
|
Not using media hash subdirs for S3 uploads. Updated video player for S3.
|
2021-02-23 00:54:19 +01:00 |
|
DebaucheryLibrarian
|
37e39dc1ec
|
Added S3 support for media files. Fixed MindGeek scraper for new poster data structure.
|
2021-02-22 02:33:39 +01:00 |
|
DebaucheryLibrarian
|
9a65d8c0eb
|
Merge branch 'master' into wasabi
|
2021-02-21 23:00:00 +01:00 |
|
DebaucheryLibrarian
|
b79e75349c
|
Fixed indentation.
|
2021-02-21 22:58:46 +01:00 |
|
DebaucheryLibrarian
|
8a739893ea
|
Improved duplicate handling. Added tag photos.
|
2021-02-21 22:17:25 +01:00 |
|
DebaucheryLibrarian
|
a39750d808
|
Fixed Nubiles deep scrape date.
|
2021-02-20 01:16:09 +01:00 |
|
DebaucheryLibrarian
|
f310fec869
|
Added S3 experiment.
|
2021-02-20 01:12:44 +01:00 |
|
DebaucheryLibrarian
|
39e2abd80a
|
Removed legacy comment.
|
2021-02-19 00:45:27 +01:00 |
|
DebaucheryLibrarian
|
5e2909c531
|
Fixed actor unique index preventing multiple actors with the same slug on a different network. Changed scene delete query to be able to handle more scene IDs.
|
2021-02-18 04:44:04 +01:00 |
|
DebaucheryLibrarian
|
c51cd080fa
|
Improved actor mapping in release associations. Storing alias ID in actor release association.
|
2021-02-17 00:40:20 +01:00 |
|
DebaucheryLibrarian
|
3469da674a
|
Fixed PornCZ video query.
|
2021-02-16 19:53:32 +01:00 |
|
DebaucheryLibrarian
|
67055bf920
|
Improved actor entity and entry ID storage.
|
2021-02-16 03:37:52 +01:00 |
|
DebaucheryLibrarian
|
8a7baa02c1
|
Improved date query for upcoming scenes in ElevatedX scraper.
|
2021-02-14 14:31:33 +01:00 |
|
DebaucheryLibrarian
|
372b5da704
|
Moved all of ExploitedX and Nebraska Coeds into generic ElevatedX scraper.
|
2021-02-14 01:53:03 +01:00 |
|
DebaucheryLibrarian
|
f79505f3f6
|
Added generic ElevatedX scraper. Changed FCUK to ExploitedX network. Testing ElevatedX scraper with ExploitedX network.
|
2021-02-13 04:49:00 +01:00 |
|
DebaucheryLibrarian
|
a14227b588
|
Improved animated image handling.
|
2021-02-11 01:46:11 +01:00 |
|
DebaucheryLibrarian
|
42a2fd8800
|
Changed Dorcel trailer to teaser.
|
2021-02-10 23:49:37 +01:00 |
|
DebaucheryLibrarian
|
9aca5baa2b
|
Added teaser support to Dorcel scraper.
|
2021-02-10 23:46:15 +01:00 |
|
DebaucheryLibrarian
|
7ff222ce25
|
Passing recursive parameters to all scraper methods. Using throttle parameters in MindGeek scraper, fixed missing slug breaking scene and actor URLs.
|
2021-02-10 03:23:48 +01:00 |
|
DebaucheryLibrarian
|
a6c7c60290
|
Improved movie tile actor overflow. Improved deep movie error feedback.
|
2021-02-10 03:00:17 +01:00 |
|
DebaucheryLibrarian
|
a04c7dda37
|
Added log to give insight about media insert failures.
|
2021-02-08 04:29:12 +01:00 |
|
DebaucheryLibrarian
|
dcad0cbe8f
|
Fixed scenes without movies spawning empty movie objects and triggering 'missing entry ID' warning.
|
2021-02-08 03:35:24 +01:00 |
|
DebaucheryLibrarian
|
73b28866ac
|
Scene tile uses first photo if poster is unavailable.
|
2021-02-08 02:10:56 +01:00 |
|
DebaucheryLibrarian
|
80b8fe3654
|
Added actor flush, renamed inconsistent actor flush to actor delete.
|
2021-02-05 04:23:13 +01:00 |
|
DebaucheryLibrarian
|
dbfbd1f04d
|
Fixed movie flush confirmation.
|
2021-02-05 04:17:47 +01:00 |
|
DebaucheryLibrarian
|
b94a3e05bc
|
Added flush movie argument to index file.
|
2021-02-05 04:16:59 +01:00 |
|
DebaucheryLibrarian
|
80fa953f60
|
Added movie flush.
|
2021-02-05 04:14:13 +01:00 |
|
DebaucheryLibrarian
|
a95a159978
|
Fixed movie scene column.
|
2021-02-05 04:06:53 +01:00 |
|
DebaucheryLibrarian
|
7b482e6903
|
Deleting movie scene associations before deleting scenes.
|
2021-02-05 04:05:44 +01:00 |
|
DebaucheryLibrarian
|
688863d16e
|
Catching media storage errors to prevent full crash.
|
2021-02-05 03:37:04 +01:00 |
|
DebaucheryLibrarian
|
3e813ca251
|
Prevent writing to media hasher when hasher stream has closed.
|
2021-02-05 03:13:10 +01:00 |
|
DebaucheryLibrarian
|
15cc970ee2
|
Added tags to release channels. Labeling DDF Network VR trailers as VR.
|
2021-02-05 01:54:06 +01:00 |
|
DebaucheryLibrarian
|
5e12a1e1b1
|
Fixed not using media limit argument.
|
2021-02-04 22:58:18 +01:00 |
|
DebaucheryLibrarian
|
f217b161b4
|
Scraping scene photos from Bang API.
|
2021-02-04 22:55:19 +01:00 |
|
DebaucheryLibrarian
|
98cae9270a
|
Added video.js player with VR support for trailers.
|
2021-02-04 03:06:19 +01:00 |
|
DebaucheryLibrarian
|
315bf0fc89
|
Fixed missing date limit default argument.
|
2021-02-04 01:18:46 +01:00 |
|
DebaucheryLibrarian
|
ff123b99b7
|
Added WankzVR update, scene and profile scraper.
|
2021-02-04 01:13:02 +01:00 |
|
DebaucheryLibrarian
|
0b99e72924
|
Added Kink VR to Kink network using BaDoink scraper.
|
2021-02-03 21:29:56 +01:00 |
|
DebaucheryLibrarian
|
79b51eca67
|
Added BaDoink profile scraper. Improved convert wrapper.
|
2021-02-03 21:03:35 +01:00 |
|
DebaucheryLibrarian
|
0c2e45141d
|
Added BaDoink latest and scene scraper.
|
2021-02-03 02:59:39 +01:00 |
|
DebaucheryLibrarian
|
824fb9ef37
|
Changed profile network argument to context.
|
2021-02-03 00:50:00 +01:00 |
|
DebaucheryLibrarian
|
6d93083581
|
Removed superfluous MindGeek scrapers.
|
2021-02-03 00:46:59 +01:00 |
|
DebaucheryLibrarian
|
4db9a34a34
|
Removed superfluous Gamma scrapers.
|
2021-02-02 22:36:47 +01:00 |
|
DebaucheryLibrarian
|
3bbc5a5e87
|
Hard merging covers to preserve order.
|
2021-02-02 03:10:58 +01:00 |
|
DebaucheryLibrarian
|
c1124abde0
|
Improved scene poster selector in Woodman scraper.
|
2021-02-02 02:18:12 +01:00 |
|
DebaucheryLibrarian
|
63f43013c3
|
Removed superfluous grandparent from entity query.
|
2021-02-02 02:11:16 +01:00 |
|
DebaucheryLibrarian
|
e4e0eb23dd
|
Removed unnecessary depth calculation from entity query.
|
2021-02-02 01:59:51 +01:00 |
|
DebaucheryLibrarian
|
6364912aa8
|
Added children to deep release entity, removed database dependency from Perfect Gonzo scraper.
|
2021-02-02 01:51:22 +01:00 |
|
DebaucheryLibrarian
|
d5cdfb36a9
|
Selecting included networks with infinite parent depth to facilitate scraper resolve.
|
2021-02-02 01:31:12 +01:00 |
|
DebaucheryLibrarian
|
4b5cd50122
|
Fixed slug lookup in Perfect Gonzo scraper.
|
2021-02-01 20:49:08 +01:00 |
|
DebaucheryLibrarian
|
aade7490f8
|
Querying infinite parent depth for deep release entities.
|
2021-02-01 01:45:30 +01:00 |
|
DebaucheryLibrarian
|
97c088cfb4
|
Added Anal Only and upcoming scraping to Mike Adriano. Fixed profile expand arrow color.
|
2021-01-30 17:43:33 +01:00 |
|
DebaucheryLibrarian
|
bfb5006e95
|
Added actor scene URL parameter to Gamma scraper to phase out release URL function.
|
2021-01-30 01:12:42 +01:00 |
|
DebaucheryLibrarian
|
9535ab7953
|
Regarding layout parameters from parent and grandparent entities. Removed Evil Angel and Fantasy Massage scraper wrappers.
|
2021-01-30 00:01:40 +01:00 |
|
DebaucheryLibrarian
|
6938e88fbf
|
Fixed some Gamma scene scrapers.
|
2021-01-29 04:26:45 +01:00 |
|
DebaucheryLibrarian
|
b7aaeada45
|
Improved movie scraping.
|
2021-01-29 02:38:05 +01:00 |
|
DebaucheryLibrarian
|
4d89256a4c
|
Merging improvements.
|
2021-01-27 00:21:58 +01:00 |
|
DebaucheryLibrarian
|
b506a00e7d
|
Improved scene merging. Improved Porn World/DDF scraper for poster and title redundancy. Fixed SFW poster showing in NSFW mode.
|
2021-01-25 23:53:56 +01:00 |
|
DebaucheryLibrarian
|
b80eca35d8
|
Fixed Gamma scraper breaking when scene has no movie. Improved missing thumbnail presentation on mobile scene tiles.
|
2021-01-25 23:24:51 +01:00 |
|
DebaucheryLibrarian
|
dc98fcad5a
|
Scraping Gamma movies. Changed movie detail bar position, and scene detail bar mobile spacing.
|
2021-01-25 23:01:07 +01:00 |
|
DebaucheryLibrarian
|
486dbc5613
|
Improved Woodman scraper, added profiles.
|
2021-01-25 00:10:57 +01:00 |
|
DebaucheryLibrarian
|
e9cbf5dab2
|
Added Woodman Casting X and WUNF update and scene scraper. Fixed actor and fallback media arrays being merged in deep scraper.
|
2021-01-24 23:31:28 +01:00 |
|
DebaucheryLibrarian
|
297f79f6e2
|
Restored sorting trailers by quality.
|
2021-01-24 20:43:34 +01:00 |
|
DebaucheryLibrarian
|
4151412156
|
Fixed Vixen trailer scraping. Using album instead of expand for actor photos.
|
2021-01-24 17:16:55 +01:00 |
|
DebaucheryLibrarian
|
985b523031
|
Scraping movie links from Gamma scene page. Removed expand option from scene page media to make way for album button.
|
2021-01-22 22:55:20 +01:00 |
|
DebaucheryLibrarian
|
bd9b795516
|
Fixed avatars without entropy being discarded.
|
2021-01-22 15:40:49 +01:00 |
|
DebaucheryLibrarian
|
b16cc26024
|
Added Zero Tolerance channel to network.
|
2021-01-22 00:26:06 +01:00 |
|
DebaucheryLibrarian
|
a95e409366
|
Fixed Kink deep scrape photos. Fixed favicon ratio in compact scene tile. Hiding scroll buttons on small screens.
|
2021-01-19 15:58:27 +01:00 |
|
DebaucheryLibrarian
|
48f247a919
|
Changed scene media grid layout.
|
2021-01-17 02:07:02 +01:00 |
|
DebaucheryLibrarian
|
251bb9476d
|
Added Gaywire, modified Bang Bros scraper to accomodate.
|
2021-01-17 01:43:55 +01:00 |
|
DebaucheryLibrarian
|
e3ef0a0d69
|
Added Top Web Models profile scraper.
|
2021-01-16 04:10:43 +01:00 |
|
DebaucheryLibrarian
|
b9e4764516
|
Fixed Pascals Sub Sluts interpreting metric as imperial height, filtering unlikely in interpolation. Splitting double actor entries in Top Web Models.
|
2021-01-15 16:14:48 +01:00 |
|
DebaucheryLibrarian
|
b8df8e6507
|
Added Top Web Models update and scene scraper.
|
2021-01-15 04:04:32 +01:00 |
|
DebaucheryLibrarian
|
451ffdc48b
|
Added Top Web Models directory.
|
2021-01-14 02:10:35 +01:00 |
|
DebaucheryLibrarian
|
12c3f0d7b9
|
Added Top Web Models framework.
|
2021-01-14 01:37:50 +01:00 |
|
DebaucheryLibrarian
|
39d149c728
|
Added default deep scrape fetch method. Added Karups scene and profile scraper. Added schoolgirl tag photo.
|
2021-01-13 21:29:05 +01:00 |
|
DebaucheryLibrarian
|
2bae6f693e
|
Removed stray console log.
|
2021-01-13 16:08:53 +01:00 |
|
DebaucheryLibrarian
|
ae0efccb04
|
Skipping Babel, updated node version. Improved deep scrape array merge.
|
2021-01-13 16:08:19 +01:00 |
|
DebaucheryLibrarian
|
cdd4220cb9
|
Fixed release actor crash when no actors are present.
|
2021-01-13 15:43:53 +01:00 |
|
DebaucheryLibrarian
|
f95c80f73f
|
Using poster photo for Pinky XXX.
|
2021-01-13 01:10:29 +01:00 |
|
DebaucheryLibrarian
|
52356f0f31
|
Added Pinky XXX, changed ethnicity tags.
|
2021-01-13 00:52:05 +01:00 |
|
DebaucheryLibrarian
|
ad73c11cb4
|
Using date and title for Nubiles entry ID.
|
2021-01-11 23:31:33 +01:00 |
|
DebaucheryLibrarian
|
db4e74fb99
|
Fixed Nubiles base poster query, handling trailing commas in qu source set. Added profile scene scraper to Dogfart. Added tag photo.
|
2021-01-11 16:20:01 +01:00 |
|
DebaucheryLibrarian
|
e38922f372
|
Removed redundant sitename from MindGeek session error.
|
2021-01-05 16:35:49 +01:00 |
|
DebaucheryLibrarian
|
e1d6c9e489
|
Added site name to MindGeek session error.
|
2021-01-05 16:34:32 +01:00 |
|
DebaucheryLibrarian
|
9ca2ec6dd0
|
Fixed parent entity relations in seed file. Fixed MindGeek scraper session URL determination.
|
2021-01-05 16:27:20 +01:00 |
|
DebaucheryLibrarian
|
7bbb2f3557
|
Added tag filter dialog.
|
2021-01-03 22:53:51 +01:00 |
|
DebaucheryLibrarian
|
8739ec08cf
|
Fixed qu init selector. Fixed Aziani scene page scope.
|
2021-01-02 03:20:39 +01:00 |
|
DebaucheryLibrarian
|
236d4fcde7
|
Fixed scene media lazy image. Fixed Perv City actor scope.
|
2021-01-01 04:28:10 +01:00 |
|
DebaucheryLibrarian
|
ba3b87471e
|
Added scene flush. Added temporary media insert log for integer out of range error.
|
2020-12-30 04:17:09 +01:00 |
|
DebaucheryLibrarian
|
f0a90db912
|
Only allow actor flush by name for non-entity specific actors.
|
2020-12-30 03:39:40 +01:00 |
|
DebaucheryLibrarian
|
8aabcd6443
|
Added actor flush.
|
2020-12-30 03:19:09 +01:00 |
|
DebaucheryLibrarian
|
af67d733ad
|
Added profile flush.
|
2020-12-30 02:23:43 +01:00 |
|
DebaucheryLibrarian
|
770e5b75a5
|
Added profile interpolate command line argument.
|
2020-12-30 00:16:05 +01:00 |
|
DebaucheryLibrarian
|
a8f68f4993
|
Fixed boolean handling in actor profile curation.
|
2020-12-29 23:44:38 +01:00 |
|
DebaucheryLibrarian
|
361e8f1bd3
|
Fixed Kelly Madison title regex.
|
2020-12-29 18:53:55 +01:00 |
|
DebaucheryLibrarian
|
0f052a0631
|
Fixed actor boolean logic, addressing missing boob, tattoo and piercing info. Removed scroll background, fixed actor photo load event and padding.
|
2020-12-29 04:20:33 +01:00 |
|
DebaucheryLibrarian
|
bc944c2373
|
Restored Mike Adriano scraper.
|
2020-12-29 02:05:22 +01:00 |
|
DebaucheryLibrarian
|
8dd10f7e77
|
Adjusting tooltip arrow position, added open and close events. Fixed search tooltip layout.
|
2020-12-29 00:42:02 +01:00 |
|
DebaucheryLibrarian
|
6baa6b0802
|
Fixed fallback create dates in scene tiles. Fixed Mike Adriano entryIds and trailers for Nympho.
|
2020-12-28 01:29:34 +01:00 |
|
DebaucheryLibrarian
|
77ec2d3747
|
Using advanced merge library to maximize scraped data.
|
2020-12-27 23:43:08 +01:00 |
|
DebaucheryLibrarian
|
9c926a1d81
|
Fixed Mike Adriano dates for scene pages.
|
2020-12-27 23:36:15 +01:00 |
|
DebaucheryLibrarian
|
ded414577f
|
Fixed default actor avatar allocation. Fixed lazy loading in actor photos component.
|
2020-12-27 22:45:38 +01:00 |
|
DebaucheryLibrarian
|
27e5583849
|
Using generic session ID variable for to determine consent warning, rather than dedicated property.
|
2020-12-20 19:49:57 +01:00 |