Commit Graph
10 Commits
Author SHA1 Message Date
DebaucheryLibrarianandClaude Opus 5.5 189e0ad227 Process users one at a time through the whole pipeline, added --queue [file] and --wait. Fixed self posts never being saved.
Users now go through profile, posts, content info and downloads one by one (preparing the next
user while the current one downloads), saving each index as soon as that user is done. The queue
is re-read between users, users are removed once archived, and a lock file lets a second
--queue invocation hand its users to the running process.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-11-06 01:10:14 +01:00
DebaucheryLibrarian bed4fe288f Added predata step. Using RedGifs temporary API key. 2024-09-11 05:16:58 +02:00
DebaucheryLibrarian 529f84d9c2 Fixed RedGIFs module content type. 2024-09-11 05:16:58 +02:00
DebaucheryLibrarian 91577a00b1 Added support for file with host IDs to ignore. 2024-09-11 05:16:56 +02:00
DebaucheryLibrarian 352b2a66d7 Allow usernames and post IDs to be read from file. 2024-09-11 05:16:56 +02:00
DebaucheryLibrarian 854d55618a Fixed profile description not saving when user has avatar. 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 9cde1ce31a Added default config to repository. 2024-09-11 05:16:53 +02:00
DebaucheryLibrarian e721c9fc8c Fetching posts in series to prevent directory creation race condition. Removed duplicate check for now (will check per post, not per image, in the future). 2024-09-11 05:16:53 +02:00
DebaucheryLibrarian bdae9893c4 Curating and fetching images from imgur. Crudely saving to disk. 2024-09-11 05:16:53 +02:00
DebaucheryLibrarian bb77f63123 First commit with project base. 2024-09-11 05:16:53 +02:00