 DebaucheryLibrarian
|
e896d52968
|
Added separate task queue for video streams to prevent ffmpeg overstressing the CPU. Fixed entity parent in scene REST API.
|
2020-08-17 15:53:20 +02:00 |
|
|
DebaucheryLibrarian
|
b3f784686f
|
Improved entity provision behavior.
|
2020-08-14 00:32:59 +02:00 |
|
|
DebaucheryLibrarian
|
59e2124407
|
Removed type property from scenes API.
|
2020-08-13 16:10:58 +02:00 |
|
|
DebaucheryLibrarian
|
d14034d38b
|
Defauling --actors-update to 1900-01-01
|
2020-08-12 21:00:50 +02:00 |
|
|
DebaucheryLibrarian
|
7413d7db25
|
Improved and documented actor profile scraping.
|
2020-08-12 20:51:08 +02:00 |
|
|
DebaucheryLibrarian
|
767437d9aa
|
Added movie tile. Fixed actor header. Larger breakpoint for nav menu.
|
2020-08-01 15:11:07 +02:00 |
|
|
DebaucheryLibrarian
|
f59e809713
|
Added experimental movie page scraping with Elegant Angel.
|
2020-07-17 04:33:05 +02:00 |
|
|
DebaucheryLibrarian
|
17b3ba1272
|
Added partial 'fcuk' (Exploited College Girls) scraper. Added file parameter for actor names and scene URLs.
|
2020-07-15 03:24:47 +02:00 |
|
 pendulum
|
1f444e58ce
|
Allowing image sources to specify queue method. Using 5s queue for Whale Member to avoid CDN time-outs.
|
2020-07-01 04:47:05 +02:00 |
|
|
pendulum
|
98c19b560f
|
Updated mindgeek scraper for entities. Various fixes.
|
2020-06-28 22:29:18 +02:00 |
|
|
pendulum
|
af56378ee2
|
Refactored various modules for entities. Updated and refactored Kink scraper.
|
2020-06-27 02:57:30 +02:00 |
|
|
pendulum
|
79465d9634
|
Added Teen Core Club. Changed network to entity in GraphQL query.
|
2020-06-08 03:41:12 +02:00 |
|
|
pendulum
|
09d849eb9d
|
Adding networks and sites as entities,
|
2020-06-04 01:03:02 +02:00 |
|
|
pendulum
|
885aa4f627
|
Passing context object with site or network instead of scraper slug and 'site or network' to all profile scrapers.
|
2020-05-18 03:22:03 +02:00 |
|
|
pendulum
|
f42ca7bd52
|
Added Bang! actor scraper. Fixed date interpolation. Showing date and age of death on profile (only if actor has already died).
|
2020-05-17 04:59:09 +02:00 |
|
|
pendulum
|
985ab9d2dc
|
Added profile interpolation.
|
2020-05-17 03:00:44 +02:00 |
|
|
pendulum
|
11eb66f834
|
Switched to tabs. Adding missing actor entries when scraping actors, with batch ID.
|
2020-05-14 04:26:05 +02:00 |
|
|
pendulum
|
d724f96728
|
Added new actors module boilerplate. Added tag posters.
|
2020-03-24 03:48:24 +01:00 |
|
|
pendulum
|
fdb2b132f6
|
Improved release storage module. Added new tags module. Added movie scraping.
|
2020-03-22 03:50:24 +01:00 |
|
|
pendulum
|
d97b1ab894
|
Split up profile scrape runner. Fixed wrong search document date key. Added search update CLI.
|
2020-03-10 23:46:55 +01:00 |
|
|
pendulum
|
638757b6e4
|
Added rudimentary movie relations.
|
2020-03-09 05:06:37 +01:00 |
|
|
pendulum
|
97cf5b2b6b
|
Added seed file for test data.
|
2020-02-27 00:38:11 +01:00 |
|
|
pendulum
|
3c30e9107a
|
Using dedicated releases search table for ts vector documents.
|
2020-02-26 22:33:15 +01:00 |
|
|
pendulum
|
349a5a506e
|
Queueing and batching media HTTP requests for improved reliability.
|
2020-02-22 03:22:30 +01:00 |
|
|
pendulum
|
dd6a1d9bfd
|
Added Vivid network. Added ASMR Fantasy to Adult Time. Storing deep URL in database. Added href to header links.
|
2020-02-11 04:58:18 +01:00 |
|
|
pendulum
|
6e1de52a40
|
Added Fame Digital. Added actor release scraping to DDF Network. Improved q and Gamma scraper.
|
2020-02-06 23:15:28 +01:00 |
|
|
pendulum
|
f921bb4ae9
|
Generating and using URL slugs for releases, improver slugify module. Added 'extract' parameter to MindGeek scraper to get scenes not associate with a channel (see Digital Playground). Added various high res logos.
|
2020-02-04 03:12:09 +01:00 |
|
|
pendulum
|
94bf207397
|
Added Wicked network. Merged Evil Angel, XEmpire and Wicked into generic Gamma scraper.
|
2020-02-01 01:15:40 +01:00 |
|
|
pendulum
|
504bcd02e3
|
Added Naughty America profile and actor releases scraper.
|
2020-01-31 19:25:42 +01:00 |
|
|
pendulum
|
ffdf0690e7
|
Added option to fetch all of an actor's releases (for supporter scrapers), and a utility to extract posters.
|
2020-01-31 01:55:55 +01:00 |
|
|
pendulum
|
863df38b29
|
Simplified tag media seed file. Renamed tags. Media refactor experiment.
|
2020-01-08 23:33:24 +01:00 |
|
|
pendulum
|
77307d2d13
|
Refactored media module to generalize avatar and poster storage into photo storage.
|
2019-12-13 03:28:52 +01:00 |
|
|
pendulum
|
04a89efa58
|
Refactored 21sextury scraper.
|
2019-12-09 05:00:49 +01:00 |
|
|
pendulum
|
98b9c885ec
|
Added support for Reality Kings sites 'Look At Her Now' and 'Tranny Surprise'.
|
2019-12-07 00:42:47 +01:00 |
|
|
pendulum
|
bead69de49
|
Added basic actor and network overview. Added DDF Network actor scraper. Various bug fixes and layout improvements.
|
2019-11-30 05:55:32 +01:00 |
|
|
pendulum
|
4be508b388
|
Drastic actor page redesign. Storing one avatar per actor, other profile photos as 'photo' role; no longer assuming first photo is avatar.
|
2019-11-28 05:36:22 +01:00 |
|
|
pendulum
|
e8130c3634
|
Scraping actor profiles from FreeOnes.
|
2019-11-17 03:56:45 +01:00 |
|
|
pendulum
|
2857387441
|
Added bash CLI shorthand. Properly setting parameters in site results. Removed obsolete URL restriction from Reality Kings scraper.
|
2019-11-16 23:37:33 +01:00 |
|
|
pendulum
|
b489c8fc33
|
Major refactor, cleand up site scrape module, fixed and cleaned up release scrape module. Removed old CLI code
|
2019-11-16 03:33:36 +01:00 |
|
|
pendulum
|
5745cd33d8
|
Added Dogfart scraper. Added 'date added' property to release page.
|
2019-11-04 05:47:37 +01:00 |
|
|
pendulum
|
926c227b85
|
Refactored database to separate IDs from slugs
|
2019-09-08 03:53:09 +02:00 |
|
|
pendulum
|
3df5a821b6
|
Saving results to database. Showing webpage.
|
2019-05-06 02:01:57 +02:00 |
|
|
pendulum
|
82419be402
|
Changed scene fetch title source for BlowPass scraper.
|
2019-04-10 04:44:36 +02:00 |
|
|
pendulum
|
2b818e379a
|
Scrapers can now iterate through pages. Filtering unique releases before saving to database. Improved scrapers and rendering.
|
2019-04-05 03:45:40 +02:00 |
|
|
pendulum
|
b3beeef3e4
|
Added Private scraper. Added Vixen scraper to repository.
|
2019-04-04 04:00:28 +02:00 |
|
|
pendulum
|
e85a0f45f9
|
Improved copy & quit options.
|
2019-03-24 03:08:51 +01:00 |
|
|
pendulum
|
4fcabb4aae
|
Added tags and duration to scraping. Added LegalPorno scraper.
|
2019-03-24 01:29:22 +01:00 |
|
|
pendulum
|
e8d4b76403
|
Improved module structure. Added individual scene scrapers for Jules Jordan and XEmpire.
|
2019-03-23 22:48:39 +01:00 |
|
|
pendulum
|
1a170bfbd5
|
Added Jules Jordan scraper. Added render argument to stop going into ncurses mode during dev.
|
2019-03-18 04:46:53 +01:00 |
|