Commit Graph

150 Commits

Author SHA1 Message Date
99c7d143f7 Fixed index file for single post fetching. 2024-09-11 05:16:56 +02:00
cdd5ed36bf Added redownload option to ignore index file. 2024-09-11 05:16:56 +02:00
24a165cf48 Added date and indexed oldest/latest limit arguments. 2024-09-11 05:16:56 +02:00
86002ef00b Accounting for indexed posts. 2024-09-11 05:16:56 +02:00
029351f228 Using YAML rather than TSV for index files. Improves both readability and reindexability. 2024-09-11 05:16:56 +02:00
f41b788183 Extracting indexed posts from fetched posts to allow for index rewrite flexibility. 2024-09-11 05:16:56 +02:00
c49e1edca0 Reading index file and ignoring already indexed content. 2024-09-11 05:16:56 +02:00
952392e0d9 Building user posts object after fetching user to ensure user fetched posts and directly fetched posts are added to the same user key. Refactor to make better use of functions. Moved profile detail saving call to content fetch. No longer attempting and failing to save profile details for deleted users (directory would not exist). 2024-09-11 05:16:56 +02:00
5eb2eb651a Saving index per user as TSV. Refactoring. 2024-09-11 05:16:56 +02:00
6696438da0 Refactored info content fetching and saving to handle users object and utilize async/await. 2024-09-11 05:16:56 +02:00
bba0f8f1d7 Fetching and curating posts per user without merge. 2024-09-11 05:16:56 +02:00
3c64ffcd45 1.11.2 2024-09-11 05:16:56 +02:00
20a9c01444 Remove double slashes from URLs before matching. 2024-09-11 05:16:55 +02:00
a56a5c9a10 1.11.1 2024-09-11 05:16:55 +02:00
c39f2eda8c Improved handling of unavailable/deleted vidble videos 2024-09-11 05:16:55 +02:00
a8ba7dc9f8 1.11.0 2024-09-11 05:16:55 +02:00
4e0fe3e6bc Added vidble direct video (/watch?v=) support. 2024-09-11 05:16:55 +02:00
761f722147 1.10.1 2024-09-11 05:16:55 +02:00
2ecc2d8098 Added -size-restricted URL pattern for gfycat. Fixed missing getUser argument. 2024-09-11 05:16:55 +02:00
b71d0f7daa 1.10.0 2024-09-11 05:16:55 +02:00
84836bc8c0 Refactored post retrieval so limit is applied per-user and ignores directly requested posts, and to start utilizing async/await. 2024-09-11 05:16:55 +02:00
2627ec6207 1.9.4 2024-09-11 05:16:55 +02:00
e6e989811c Mentioning API registration requirement in README. 2024-09-11 05:16:55 +02:00
a596234657 1.9.3 2024-09-11 05:16:55 +02:00
be7bc1b10d Added filepath component length limit with truncator. Fixed double extension dot when copying original extension. Moved API keys to local config. 2024-09-11 05:16:55 +02:00
80564cff19 1.9.2 2024-09-11 05:16:55 +02:00
c2cf26dde6 Refactored post fetching. Cleaner code that will now fetch archived posts even if the user no longer exists on reddit. Expanded gfycat URL detection. 2024-09-11 05:16:55 +02:00
e0ca4a0822 Added new eroshare method source files. 2024-09-11 05:16:55 +02:00
e1b3b1ce5f 1.9.1 2024-09-11 05:16:55 +02:00
583b567b20 Added support for /i/ eroshare items. 2024-09-11 05:16:55 +02:00
c99bb66b24 1.9.0 2024-09-11 05:16:55 +02:00
d113015eb2 Removed jpeg to jpg replace. 2024-09-11 05:16:55 +02:00
5165e8612d Added vidble image support. 2024-09-11 05:16:55 +02:00
2c58947548 Fixed jpeg jpg substitution. 2024-09-11 05:16:55 +02:00
b2f9d9f51e 1.8.2 2024-09-11 05:16:55 +02:00
89ab431a2f Added support for Vidble (image) albums. Replaced extensions.json and reverseLookup with mime-types lib. 2024-09-11 05:16:55 +02:00
af068df639 1.8.1 2024-09-11 05:16:55 +02:00
5264020084 Fixed missing return causing no saves. 2024-09-11 05:16:55 +02:00
f00821dbc9 1.8.0 2024-09-11 05:16:55 +02:00
e01979a757 Added include and exclude source arguments. Improved stream fetch failure handling and improved logging details. 2024-09-11 05:16:55 +02:00
0a2fac5f1f 1.7.4 2024-09-11 05:16:55 +02:00
60eeca09d8 Added support for m.imgur.com links. Changed curate ignore log message details. 2024-09-11 05:16:55 +02:00
7cf0836cd4 1.7.3 2024-09-11 05:16:55 +02:00
e3aac41bdf Moved archive feature from ideas to features in README. 2024-09-11 05:16:55 +02:00
e65bfaef59 1.7.2 2024-09-11 05:16:55 +02:00
3aed403700 Removed obsolete information from README. 2024-09-11 05:16:55 +02:00
5958869793 1.7.1 2024-09-11 05:16:55 +02:00
7bab50adb0 Fixed lost variable item in README. 2024-09-11 05:16:54 +02:00
d9b5eb3b5d 1.7.0 2024-09-11 05:16:54 +02:00
2ec097c053 Cleaned up entrypoint. 2024-09-11 05:16:54 +02:00