DebaucheryLibrarian
|
3d80e9d77b
|
Added movie URL file support. Fixed Gamma movie API scraper movie URL.
|
2022-02-03 00:04:48 +01:00 |
|
DebaucheryLibrarian
|
3b958a02ef
|
Added memory profiler configuration options.
|
2021-12-27 22:36:01 +01:00 |
|
DebaucheryLibrarian
|
26539b74a5
|
Updated dependencies. Added periodic memory logger.
|
2021-11-20 23:59:48 +01:00 |
|
DebaucheryLibrarian
|
0e4fd12d70
|
Added more loggers to http module.
|
2021-10-20 01:46:56 +02:00 |
|
DebaucheryLibrarian
|
80b8fe3654
|
Added actor flush, renamed inconsistent actor flush to actor delete.
|
2021-02-05 04:23:13 +01:00 |
|
DebaucheryLibrarian
|
80fa953f60
|
Added movie flush.
|
2021-02-05 04:14:13 +01:00 |
|
DebaucheryLibrarian
|
f217b161b4
|
Scraping scene photos from Bang API.
|
2021-02-04 22:55:19 +01:00 |
|
DebaucheryLibrarian
|
315bf0fc89
|
Fixed missing date limit default argument.
|
2021-02-04 01:18:46 +01:00 |
|
DebaucheryLibrarian
|
ba3b87471e
|
Added scene flush. Added temporary media insert log for integer out of range error.
|
2020-12-30 04:17:09 +01:00 |
|
DebaucheryLibrarian
|
8aabcd6443
|
Added actor flush.
|
2020-12-30 03:19:09 +01:00 |
|
DebaucheryLibrarian
|
af67d733ad
|
Added profile flush.
|
2020-12-30 02:23:43 +01:00 |
|
DebaucheryLibrarian
|
770e5b75a5
|
Added profile interpolate command line argument.
|
2020-12-30 00:16:05 +01:00 |
|
DebaucheryLibrarian
|
be1821b9eb
|
Changed --inspect to --report to avoid conflict with Node's own debug tools.
|
2020-12-02 21:26:55 +01:00 |
|
DebaucheryLibrarian
|
71c884fe48
|
Improved Little Caprice Dreams scraper.
|
2020-11-28 00:46:30 +01:00 |
|
DebaucheryLibrarian
|
1b407254a7
|
Increased hard limit in release API.
|
2020-11-26 04:01:01 +01:00 |
|
DebaucheryLibrarian
|
3d427f7e1d
|
Allowing HTTP rate limits to be set by configuration or argument.
|
2020-11-22 23:50:24 +01:00 |
|
DebaucheryLibrarian
|
c37d4ad01f
|
Filtering invalid actors from releases before storing.
|
2020-10-29 16:06:20 +01:00 |
|
DebaucheryLibrarian
|
0bd7fca876
|
Added orphaned media flush and batch release flush.
|
2020-10-25 00:52:40 +02:00 |
|
DebaucheryLibrarian
|
d795266114
|
Removed no-date-limit as argument due yargs conflict.
|
2020-10-20 00:08:14 +02:00 |
|
DebaucheryLibrarian
|
2f8fca0327
|
Added missing-date as config and argument alias.
|
2020-10-20 00:05:23 +02:00 |
|
DebaucheryLibrarian
|
4a900cbbeb
|
Renamed nullDateLimit to noDateLimit in config.
|
2020-10-20 00:03:22 +02:00 |
|
DebaucheryLibrarian
|
5bdbb5ec62
|
Renamed null-date-limit to no-date-limit, added old as alias.
|
2020-10-20 00:01:29 +02:00 |
|
DebaucheryLibrarian
|
593ce27312
|
Added rudimentary scene and entity scene remove.
|
2020-10-19 02:02:21 +02:00 |
|
DebaucheryLibrarian
|
5f5c48ea05
|
Fixed pagination behavior for upcoming scenes.
|
2020-08-22 01:57:23 +02:00 |
|
DebaucheryLibrarian
|
4ec89e2cc8
|
Added upcoming, profile and detailed scene actor scraping to InTheCrack. Fixed clip upsert.
|
2020-08-20 23:35:18 +02:00 |
|
DebaucheryLibrarian
|
e896d52968
|
Added separate task queue for video streams to prevent ffmpeg overstressing the CPU. Fixed entity parent in scene REST API.
|
2020-08-17 15:53:20 +02:00 |
|
DebaucheryLibrarian
|
b3f784686f
|
Improved entity provision behavior.
|
2020-08-14 00:32:59 +02:00 |
|
DebaucheryLibrarian
|
59e2124407
|
Removed type property from scenes API.
|
2020-08-13 16:10:58 +02:00 |
|
DebaucheryLibrarian
|
d14034d38b
|
Defauling --actors-update to 1900-01-01
|
2020-08-12 21:00:50 +02:00 |
|
DebaucheryLibrarian
|
7413d7db25
|
Improved and documented actor profile scraping.
|
2020-08-12 20:51:08 +02:00 |
|
DebaucheryLibrarian
|
767437d9aa
|
Added movie tile. Fixed actor header. Larger breakpoint for nav menu.
|
2020-08-01 15:11:07 +02:00 |
|
DebaucheryLibrarian
|
f59e809713
|
Added experimental movie page scraping with Elegant Angel.
|
2020-07-17 04:33:05 +02:00 |
|
DebaucheryLibrarian
|
17b3ba1272
|
Added partial 'fcuk' (Exploited College Girls) scraper. Added file parameter for actor names and scene URLs.
|
2020-07-15 03:24:47 +02:00 |
 ThePendulum
|
1f444e58ce
|
Allowing image sources to specify queue method. Using 5s queue for Whale Member to avoid CDN time-outs.
|
2020-07-01 04:47:05 +02:00 |
|
ThePendulum
|
98c19b560f
|
Updated mindgeek scraper for entities. Various fixes.
|
2020-06-28 22:29:18 +02:00 |
|
ThePendulum
|
af56378ee2
|
Refactored various modules for entities. Updated and refactored Kink scraper.
|
2020-06-27 02:57:30 +02:00 |
|
ThePendulum
|
79465d9634
|
Added Teen Core Club. Changed network to entity in GraphQL query.
|
2020-06-08 03:41:12 +02:00 |
|
ThePendulum
|
09d849eb9d
|
Adding networks and sites as entities,
|
2020-06-04 01:03:02 +02:00 |
|
ThePendulum
|
885aa4f627
|
Passing context object with site or network instead of scraper slug and 'site or network' to all profile scrapers.
|
2020-05-18 03:22:03 +02:00 |
|
ThePendulum
|
f42ca7bd52
|
Added Bang! actor scraper. Fixed date interpolation. Showing date and age of death on profile (only if actor has already died).
|
2020-05-17 04:59:09 +02:00 |
|
ThePendulum
|
985ab9d2dc
|
Added profile interpolation.
|
2020-05-17 03:00:44 +02:00 |
|
ThePendulum
|
11eb66f834
|
Switched to tabs. Adding missing actor entries when scraping actors, with batch ID.
|
2020-05-14 04:26:05 +02:00 |
|
ThePendulum
|
d724f96728
|
Added new actors module boilerplate. Added tag posters.
|
2020-03-24 03:48:24 +01:00 |
|
ThePendulum
|
fdb2b132f6
|
Improved release storage module. Added new tags module. Added movie scraping.
|
2020-03-22 03:50:24 +01:00 |
|
ThePendulum
|
d97b1ab894
|
Split up profile scrape runner. Fixed wrong search document date key. Added search update CLI.
|
2020-03-10 23:46:55 +01:00 |
|
ThePendulum
|
638757b6e4
|
Added rudimentary movie relations.
|
2020-03-09 05:06:37 +01:00 |
|
ThePendulum
|
97cf5b2b6b
|
Added seed file for test data.
|
2020-02-27 00:38:11 +01:00 |
|
ThePendulum
|
3c30e9107a
|
Using dedicated releases search table for ts vector documents.
|
2020-02-26 22:33:15 +01:00 |
|
ThePendulum
|
349a5a506e
|
Queueing and batching media HTTP requests for improved reliability.
|
2020-02-22 03:22:30 +01:00 |
|
ThePendulum
|
dd6a1d9bfd
|
Added Vivid network. Added ASMR Fantasy to Adult Time. Storing deep URL in database. Added href to header links.
|
2020-02-11 04:58:18 +01:00 |