DebaucheryLibrarian and Claude Opus 5.5
189e0ad227
Process users one at a time through the whole pipeline, added --queue [file] and --wait. Fixed self posts never being saved.
...
Users now go through profile, posts, content info and downloads one by one (preparing the next
user while the current one downloads), saving each index as soon as that user is done. The queue
is re-read between users, users are removed once archived, and a lock file lets a second
--queue invocation hand its users to the running process.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com >
2026-11-06 01:10:14 +01:00
DebaucheryLibrarian and Claude Opus 5.5
6905fb9b4a
Track suspended/deleted accounts and prune them from the users file after a grace period, also as standalone --cleanup. Only fetch social links when the profile description is saved, raised reddit throttle to 15/min.
...
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com >
2026-11-06 00:05:11 +01:00
DebaucheryLibrarian and Claude Opus 5.5
309a99755c
Reduced reddit requests: stop paging at --after(-indexed) cutoff, reuse listing media for videos, SOCKS5 support for reddit/fetch requests, routed defunct gfycat links to RedGifs.
...
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com >
2026-11-05 22:33:28 +01:00
DebaucheryLibrarian
de50d609f3
Added support for RedGifs and Reddit albums. Improved command line logger. Added rate limiters for reddit and host URLs.
2024-09-11 05:16:58 +02:00
DebaucheryLibrarian
6e3bfdd175
Added support for various tube and social media sites via youtube-dl.
2024-09-11 05:16:58 +02:00
DebaucheryLibrarian
9140b58c70
Removed post.user variable.
2024-09-11 05:16:58 +02:00
DebaucheryLibrarian
f47b6cbeb8
Fixed typos in README.
2024-09-11 05:16:58 +02:00
DebaucheryLibrarian
8d72683ebc
Renamed from reddit-post-dump to ripunzel.
2024-09-11 05:16:57 +02:00
DebaucheryLibrarian
e00f895b05
Removed obsolete 'boolean' mention from README.
2024-09-11 05:16:57 +02:00
DebaucheryLibrarian
c2c5dc8d8a
Fixed header in README.
2024-09-11 05:16:57 +02:00
DebaucheryLibrarian
4e827fb9a8
Improved README formatting.
2024-09-11 05:16:57 +02:00
DebaucheryLibrarian
5c7dca19e5
Added dynamic dividers to patterns. Fixed PornHub module. Updated README.
2024-09-11 05:16:57 +02:00
DebaucheryLibrarian
443f0fc028
Completed Erome module. Added content URL list fetching.
2024-09-11 05:16:57 +02:00
DebaucheryLibrarian
8b85ec219d
Removed debug log. Updated README to mention imgur API key requirement.
2024-09-11 05:16:57 +02:00
DebaucheryLibrarian
84836bc8c0
Refactored post retrieval so limit is applied per-user and ignores directly requested posts, and to start utilizing async/await.
2024-09-11 05:16:55 +02:00
DebaucheryLibrarian
e6e989811c
Mentioning API registration requirement in README.
2024-09-11 05:16:55 +02:00
DebaucheryLibrarian
e01979a757
Added include and exclude source arguments. Improved stream fetch failure handling and improved logging details.
2024-09-11 05:16:55 +02:00
DebaucheryLibrarian
e3aac41bdf
Moved archive feature from ideas to features in README.
2024-09-11 05:16:55 +02:00
DebaucheryLibrarian
3aed403700
Removed obsolete information from README.
2024-09-11 05:16:55 +02:00
DebaucheryLibrarian
7bab50adb0
Fixed lost variable item in README.
2024-09-11 05:16:54 +02:00
DebaucheryLibrarian
7f00e5b6b2
Added support for reddit preview fallback.
2024-09-11 05:16:54 +02:00
DebaucheryLibrarian
6131d0a76c
Added npm script for running application.
2024-09-11 05:16:54 +02:00
DebaucheryLibrarian
de64cc6d13
Added support for fetching individual posts. Improved use of yargs, --help now available. Refactored main app flow.
2024-09-11 05:16:54 +02:00
DebaucheryLibrarian
c250a02edf
Fixed avatar property.
2024-09-11 05:16:54 +02:00
DebaucheryLibrarian
767ae082fa
Added ignore argument.
2024-09-11 05:16:54 +02:00
DebaucheryLibrarian
766e4b5554
Rephrased reddit videos in README.
2024-09-11 05:16:54 +02:00
DebaucheryLibrarian
88a40cc5c7
Elaborated reddit videos in README.
2024-09-11 05:16:54 +02:00
DebaucheryLibrarian
d0b5231c98
Removed asterisk from reddit videos README section and decreased header size.
2024-09-11 05:16:54 +02:00
DebaucheryLibrarian
e650d31db1
Explained reddit video muxing in README.
2024-09-11 05:16:54 +02:00
DebaucheryLibrarian
4c394ba434
Fixed README variable formatting typo.
2024-09-11 05:16:54 +02:00
DebaucheryLibrarian
7fc94c5b87
Added subreddit plan to README.
2024-09-11 05:16:54 +02:00
DebaucheryLibrarian
427e446281
Updated README with introduction, features and new variables.
2024-09-11 05:16:54 +02:00
DebaucheryLibrarian
e21ea23493
Added limit parameter set to Infinity to reddit user submissions API call, as default limit appears to be too low and posts go missing. Notifying when item gets extracted from album.
2024-09-11 05:16:53 +02:00
DebaucheryLibrarian
c3fc11d1ea
Added single item album extraction with configurable display variable, as well as a host/source name variable.
2024-09-11 05:16:53 +02:00
DebaucheryLibrarian
5eef495452
Leveled down other pattern configs in README.
2024-09-11 05:16:53 +02:00
DebaucheryLibrarian
1b365ef773
Leveled down README variables section.
2024-09-11 05:16:53 +02:00
DebaucheryLibrarian
67d573952b
Added multi-user support.
2024-09-11 05:16:53 +02:00
DebaucheryLibrarian
2ade724f67
Completed README install instructions.
2024-09-11 05:16:53 +02:00
DebaucheryLibrarian
66e066e87e
Rephrased README.
2024-09-11 05:16:53 +02:00
DebaucheryLibrarian
66f245b2e7
Elaborated README.
2024-09-11 05:16:53 +02:00
DebaucheryLibrarian
d4c42ff1ee
Elaborated README
2024-09-11 05:16:53 +02:00
DebaucheryLibrarian
09c132adc3
Decreased README setting headers.
2024-09-11 05:16:53 +02:00
DebaucheryLibrarian
836d3e991c
Added title limit setting and cleaned up README
2024-09-11 05:16:53 +02:00
DebaucheryLibrarian
591d0054b3
Added limit and sort parameters, post index variable and relevant usage documentation.
2024-09-11 05:16:53 +02:00
DebaucheryLibrarian
f5e8906823
Added support for i.redd.it and self posts. Moved pattern interpolation out of fetch module.
2024-09-11 05:16:53 +02:00
DebaucheryLibrarian
05cacf72b2
Added README.
2024-09-11 05:16:53 +02:00
