 DebaucheryLibrarian
|
45123bc630
|
Added hash comparison to duplicate avoidance.
|
2024-09-11 05:16:58 +02:00 |
|
DebaucheryLibrarian
|
b9a7e4b83a
|
Added support for fetching content directly from host. Improved pattern interpolation. Refactored content modules.
|
2024-09-11 05:16:57 +02:00 |
|
DebaucheryLibrarian
|
60973a0e70
|
Added post score to index and variables.
|
2024-09-11 05:16:57 +02:00 |
|
DebaucheryLibrarian
|
e48c00b529
|
Added option to index (specified) ignored posts. Saving index through save module, and it now notifies the user that an index has been written.
|
2024-09-11 05:16:57 +02:00 |
|
DebaucheryLibrarian
|
b05ae06b00
|
Improved missing gfycat handling. Added 'preview' marker to index.
|
2024-09-11 05:16:56 +02:00 |
|
DebaucheryLibrarian
|
a68493d0fa
|
Don't attempt to save index when there are no posts or profile details (complained about directory not existing)
|
2024-09-11 05:16:56 +02:00 |
|
DebaucheryLibrarian
|
18acb3a878
|
Added fetch concurrency.
|
2024-09-11 05:16:56 +02:00 |
|
DebaucheryLibrarian
|
fcb85f57c8
|
Added watch-mode. Waiting for profile detail write to finalize before new watch cycle and capture details in index file.
|
2024-09-11 05:16:56 +02:00 |
|
DebaucheryLibrarian
|
86002ef00b
|
Accounting for indexed posts.
|
2024-09-11 05:16:56 +02:00 |
|
DebaucheryLibrarian
|
029351f228
|
Using YAML rather than TSV for index files. Improves both readability and reindexability.
|
2024-09-11 05:16:56 +02:00 |
|
DebaucheryLibrarian
|
c49e1edca0
|
Reading index file and ignoring already indexed content.
|
2024-09-11 05:16:56 +02:00 |
|
DebaucheryLibrarian
|
952392e0d9
|
Building user posts object after fetching user to ensure user fetched posts and directly fetched posts are added to the same user key. Refactor to make better use of functions. Moved profile detail saving call to content fetch. No longer attempting and failing to save profile details for deleted users (directory would not exist).
|
2024-09-11 05:16:56 +02:00 |