Commit Graph

153 Commits

Author SHA1 Message Date
ThePendulum 1b1323dc3d No longer redownload profile image and description when indexed, unless --redownload-profile is specified. 2018-07-01 03:26:26 +02:00
ThePendulum e7eef86b23 Added watch-mode. Waiting for profile detail write to finalize before new watch cycle and capture details in index file. 2018-07-01 03:06:57 +02:00
ThePendulum f9f9c8a0bd Fixed extension getting cut off at filename limit. Cleaned up save module. 2018-07-01 01:49:59 +02:00
ThePendulum c639503667 Fixed index file for single post fetching. 2018-07-01 01:07:32 +02:00
ThePendulum 240146e554 Added redownload option to ignore index file. 2018-07-01 00:22:17 +02:00
ThePendulum 84f7757712 Added date and indexed oldest/latest limit arguments. 2018-07-01 00:07:12 +02:00
ThePendulum a859ac573c Accounting for indexed posts. 2018-06-30 21:47:43 +02:00
ThePendulum 74e36a6826 Using YAML rather than TSV for index files. Improves both readability and reindexability. 2018-06-30 03:33:30 +02:00
ThePendulum 1c4ec06f68 Extracting indexed posts from fetched posts to allow for index rewrite flexibility. 2018-06-20 02:06:59 +02:00
ThePendulum 33ef3d2c19 Reading index file and ignoring already indexed content. 2018-06-17 03:39:12 +02:00
ThePendulum 7cf1a99915 Building user posts object after fetching user to ensure user fetched posts and directly fetched posts are added to the same user key. Refactor to make better use of functions. Moved profile detail saving call to content fetch. No longer attempting and failing to save profile details for deleted users (directory would not exist). 2018-06-17 01:11:10 +02:00
ThePendulum 3b5d886da3 Saving index per user as TSV. Refactoring. 2018-06-15 01:06:31 +02:00
ThePendulum 7446dc9efb Refactored info content fetching and saving to handle users object and utilize async/await. 2018-06-13 01:51:45 +02:00
ThePendulum aef4dd02c7 Fetching and curating posts per user without merge. 2018-06-10 02:48:49 +02:00
ThePendulum d56fff5082 1.11.2 2018-06-10 01:34:30 +02:00
ThePendulum f579bb2077 Remove double slashes from URLs before matching. 2018-06-10 01:34:28 +02:00
ThePendulum 44f32b3347 1.11.1 2018-06-07 14:55:21 +02:00
ThePendulum 3a724d1b37 Improved handling of unavailable/deleted vidble videos 2018-06-07 14:55:16 +02:00
ThePendulum ec6182e747 1.11.0 2018-06-07 14:40:17 +02:00
ThePendulum 504de6247f Added vidble direct video (/watch?v=) support. 2018-06-07 14:40:15 +02:00
ThePendulum 402b38a00e 1.10.1 2018-05-28 22:26:01 +02:00
ThePendulum 89542bd064 Added -size-restricted URL pattern for gfycat. Fixed missing getUser argument. 2018-05-28 22:25:58 +02:00
ThePendulum b27eb1df03 1.10.0 2018-05-28 01:42:49 +02:00
ThePendulum e056acfbd3 Refactored post retrieval so limit is applied per-user and ignores directly requested posts, and to start utilizing async/await. 2018-05-28 01:42:46 +02:00
ThePendulum 010470ca8c 1.9.4 2018-05-23 17:07:00 +02:00
ThePendulum 71ea86f7fc Mentioning API registration requirement in README. 2018-05-23 17:06:55 +02:00
ThePendulum 053c89ab88 1.9.3 2018-05-23 17:03:15 +02:00
ThePendulum 569213e291 Added filepath component length limit with truncator. Fixed double extension dot when copying original extension. Moved API keys to local config. 2018-05-23 17:03:12 +02:00
ThePendulum 6f306322c6 1.9.2 2018-05-22 22:55:53 +02:00
ThePendulum edf77e259b Refactored post fetching. Cleaner code that will now fetch archived posts even if the user no longer exists on reddit. Expanded gfycat URL detection. 2018-05-22 22:55:50 +02:00
ThePendulum 67378d4c7a Added new eroshare method source files. 2018-05-15 15:36:15 +02:00
ThePendulum 9bdc45439b 1.9.1 2018-05-14 00:38:53 +02:00
ThePendulum 6f21d41cd0 Added support for /i/ eroshare items. 2018-05-14 00:38:49 +02:00
ThePendulum 9dc067c84f 1.9.0 2018-05-12 23:37:47 +02:00
ThePendulum b9a9fb16cf Removed jpeg to jpg replace. 2018-05-12 23:37:24 +02:00
ThePendulum 8abda731dd Added vidble image support. 2018-05-12 23:36:20 +02:00
ThePendulum 9d6882a7c5 Fixed jpeg jpg substitution. 2018-05-12 16:29:41 +02:00
ThePendulum 6a4cb138fa 1.8.2 2018-05-11 01:46:12 +02:00
ThePendulum adbbc79b16 Added support for Vidble (image) albums. Replaced extensions.json and reverseLookup with mime-types lib. 2018-05-11 01:46:08 +02:00
ThePendulum 9a3d20aac3 1.8.1 2018-05-05 22:39:25 +02:00
ThePendulum cdff8354a7 Fixed missing return causing no saves. 2018-05-05 22:39:21 +02:00
ThePendulum 06e01fa680 1.8.0 2018-05-05 17:08:50 +02:00
ThePendulum 068ffbdbd8 Added include and exclude source arguments. Improved stream fetch failure handling and improved logging details. 2018-05-05 17:08:40 +02:00
ThePendulum 77e12d3c0f 1.7.4 2018-05-05 03:18:08 +02:00
ThePendulum 3794fc3776 Added support for m.imgur.com links. Changed curate ignore log message details. 2018-05-05 03:18:05 +02:00
ThePendulum 9dd9c823e8 1.7.3 2018-05-05 02:36:01 +02:00
ThePendulum 33146d55fe Moved archive feature from ideas to features in README. 2018-05-05 02:35:58 +02:00
ThePendulum 0bbd3924fe 1.7.2 2018-05-05 02:31:17 +02:00
ThePendulum af8b6cb545 Removed obsolete information from README. 2018-05-05 02:31:13 +02:00
ThePendulum 143945da69 1.7.1 2018-05-05 02:29:24 +02:00