 DebaucheryLibrarian
|
b9a7e4b83a
|
Added support for fetching content directly from host. Improved pattern interpolation. Refactored content modules.
|
2024-09-11 05:16:57 +02:00 |
|
DebaucheryLibrarian
|
60973a0e70
|
Added post score to index and variables.
|
2024-09-11 05:16:57 +02:00 |
|
DebaucheryLibrarian
|
a817a07250
|
Always returning null for profile details when no profile was found, not undefined. Prevents YAML index write from failing.
|
2024-09-11 05:16:57 +02:00 |
|
DebaucheryLibrarian
|
e48c00b529
|
Added option to index (specified) ignored posts. Saving index through save module, and it now notifies the user that an index has been written.
|
2024-09-11 05:16:57 +02:00 |
|
DebaucheryLibrarian
|
12e17c7c3c
|
Calculating filename component limit in bytes rather than characters, preventing 'filename too long' errors when e.g. emojis are used
|
2024-09-11 05:16:57 +02:00 |
|
DebaucheryLibrarian
|
dbc4c45601
|
No longer using imgur API for individual images. Only saving EXIF data to JPEGs. Always using global exiftool instance.
|
2024-09-11 05:16:56 +02:00 |
|
DebaucheryLibrarian
|
b05ae06b00
|
Improved missing gfycat handling. Added 'preview' marker to index.
|
2024-09-11 05:16:56 +02:00 |
|
DebaucheryLibrarian
|
a68493d0fa
|
Don't attempt to save index when there are no posts or profile details (complained about directory not existing)
|
2024-09-11 05:16:56 +02:00 |
|
DebaucheryLibrarian
|
18acb3a878
|
Added fetch concurrency.
|
2024-09-11 05:16:56 +02:00 |
|
DebaucheryLibrarian
|
438ba05260
|
Fixed profile image checking for indexed description instead of image.
|
2024-09-11 05:16:56 +02:00 |
|
DebaucheryLibrarian
|
e087e47069
|
No longer redownload profile image and description when indexed, unless --redownload-profile is specified.
|
2024-09-11 05:16:56 +02:00 |
|
DebaucheryLibrarian
|
fcb85f57c8
|
Added watch-mode. Waiting for profile detail write to finalize before new watch cycle and capture details in index file.
|
2024-09-11 05:16:56 +02:00 |
|
DebaucheryLibrarian
|
dcf7fdd274
|
Fixed extension getting cut off at filename limit. Cleaned up save module.
|
2024-09-11 05:16:56 +02:00 |
|
DebaucheryLibrarian
|
99c7d143f7
|
Fixed index file for single post fetching.
|
2024-09-11 05:16:56 +02:00 |
|
DebaucheryLibrarian
|
86002ef00b
|
Accounting for indexed posts.
|
2024-09-11 05:16:56 +02:00 |
|
DebaucheryLibrarian
|
029351f228
|
Using YAML rather than TSV for index files. Improves both readability and reindexability.
|
2024-09-11 05:16:56 +02:00 |
|
DebaucheryLibrarian
|
c49e1edca0
|
Reading index file and ignoring already indexed content.
|
2024-09-11 05:16:56 +02:00 |
|
DebaucheryLibrarian
|
952392e0d9
|
Building user posts object after fetching user to ensure user fetched posts and directly fetched posts are added to the same user key. Refactor to make better use of functions. Moved profile detail saving call to content fetch. No longer attempting and failing to save profile details for deleted users (directory would not exist).
|
2024-09-11 05:16:56 +02:00 |
|
DebaucheryLibrarian
|
be7bc1b10d
|
Added filepath component length limit with truncator. Fixed double extension dot when copying original extension. Moved API keys to local config.
|
2024-09-11 05:16:55 +02:00 |
|
DebaucheryLibrarian
|
c2cf26dde6
|
Refactored post fetching. Cleaner code that will now fetch archived posts even if the user no longer exists on reddit. Expanded gfycat URL detection.
|
2024-09-11 05:16:55 +02:00 |
|
DebaucheryLibrarian
|
e01979a757
|
Added include and exclude source arguments. Improved stream fetch failure handling and improved logging details.
|
2024-09-11 05:16:55 +02:00 |
|
DebaucheryLibrarian
|
854d55618a
|
Fixed profile description not saving when user has avatar.
|
2024-09-11 05:16:54 +02:00 |
|
DebaucheryLibrarian
|
c250a02edf
|
Fixed avatar property.
|
2024-09-11 05:16:54 +02:00 |
|
DebaucheryLibrarian
|
8a57a9a8f9
|
Added reddit avatar URL detection and avoid option.
|
2024-09-11 05:16:54 +02:00 |
|
DebaucheryLibrarian
|
4ac2dab56f
|
Fixed double dir path component extraction in save module (causing profile info save to fail).
|
2024-09-11 05:16:54 +02:00 |
|
DebaucheryLibrarian
|
370214e1a2
|
Adapted primary save function to handle single streams and non-item saves (e.g. profiles).
|
2024-09-11 05:16:54 +02:00 |
|
DebaucheryLibrarian
|
536c427140
|
Added support for muxing streams, specifically for reddit-hosted videos (now also supported).
|
2024-09-11 05:16:54 +02:00 |
|
DebaucheryLibrarian
|
e3899362d7
|
Tracking meta source file for EXIF data.
|
2024-09-11 05:16:54 +02:00 |
|
DebaucheryLibrarian
|
94e1575c30
|
Dealing with users without profile.
|
2024-09-11 05:16:53 +02:00 |
|
DebaucheryLibrarian
|
2b9801999b
|
Moved source into dedicated directory.
|
2024-09-11 05:16:53 +02:00 |