12 Commits

Author	SHA1	Message	Date
DebaucheryLibrarian	a68493d0fa	Don't attempt to save index when there are no posts or profile details (complained about directory not existing)	2024-09-11 05:16:56 +02:00
DebaucheryLibrarian	e087e47069	No longer redownload profile image and description when indexed, unless --redownload-profile is specified.	2024-09-11 05:16:56 +02:00
DebaucheryLibrarian	fcb85f57c8	Added watch-mode. Waiting for profile detail write to finalize before new watch cycle and capture details in index file.	2024-09-11 05:16:56 +02:00
DebaucheryLibrarian	99c7d143f7	Fixed index file for single post fetching.	2024-09-11 05:16:56 +02:00
DebaucheryLibrarian	86002ef00b	Accounting for indexed posts.	2024-09-11 05:16:56 +02:00
DebaucheryLibrarian	029351f228	Using YAML rather than TSV for index files. Improves both readability and reindexability.	2024-09-11 05:16:56 +02:00
DebaucheryLibrarian	c49e1edca0	Reading index file and ignoring already indexed content.	2024-09-11 05:16:56 +02:00
DebaucheryLibrarian	952392e0d9	Building user posts object after fetching user to ensure user fetched posts and directly fetched posts are added to the same user key. Refactor to make better use of functions. Moved profile detail saving call to content fetch. No longer attempting and failing to save profile details for deleted users (directory would not exist).	2024-09-11 05:16:56 +02:00
DebaucheryLibrarian	bba0f8f1d7	Fetching and curating posts per user without merge.	2024-09-11 05:16:56 +02:00
DebaucheryLibrarian	84836bc8c0	Refactored post retrieval so limit is applied per-user and ignores directly requested posts, and to start utilizing async/await.	2024-09-11 05:16:55 +02:00
DebaucheryLibrarian	c2cf26dde6	Refactored post fetching. Cleaner code that will now fetch archived posts even if the user no longer exists on reddit. Expanded gfycat URL detection.	2024-09-11 05:16:55 +02:00
DebaucheryLibrarian	2ec097c053	Cleaned up entrypoint.	2024-09-11 05:16:54 +02:00