Commit Graph

169 Commits

Author SHA1 Message Date
2cc15eecd0 No longer relying on imgur API for albums. Removed config for imgur API. Fixed ?#0 URLs not being detected for imgur. 2018-07-05 02:54:29 +02:00
f5382ddc37 No longer using imgur API for individual images. Only saving EXIF data to JPEGs. Always using global exiftool instance. 2018-07-05 02:00:45 +02:00
5dce74588b Improved missing gfycat handling. Added 'preview' marker to index. 2018-07-02 23:15:06 +02:00
dfee2c2ae2 1.14.1 2018-07-02 19:55:24 +02:00
310931e4f8 Don't attempt to save index when there are no posts or profile details (complained about directory not existing) 2018-07-02 19:55:21 +02:00
7fd3f1c01b 1.14.0 2018-07-02 03:45:23 +02:00
c1f26440fd Added fetch concurrency. 2018-07-02 03:45:20 +02:00
d1acde5952 1.13.1 2018-07-02 02:33:40 +02:00
b4356e8e11 Added support for file with host IDs to ignore. 2018-07-02 02:33:34 +02:00
9730a9dc87 1.13.0 2018-07-02 00:25:57 +02:00
7335db1593 Allow usernames and post IDs to be read from file. 2018-07-02 00:25:48 +02:00
5b023adf30 Switched from setTimeout to crontab for watch-mode. 2018-07-01 23:16:03 +02:00
23f9ac660a 1.12.1 2018-07-01 03:38:32 +02:00
9ded9a131e Added timestamp to watch mode status log. 2018-07-01 03:38:29 +02:00
5edf5cd71b 1.12.0 2018-07-01 03:33:00 +02:00
cb6fd0c7f6 Fixed profile image checking for indexed description instead of image. 2018-07-01 03:32:53 +02:00
1b1323dc3d No longer redownload profile image and description when indexed, unless --redownload-profile is specified. 2018-07-01 03:26:26 +02:00
e7eef86b23 Added watch-mode. Waiting for profile detail write to finalize before new watch cycle and capture details in index file. 2018-07-01 03:06:57 +02:00
f9f9c8a0bd Fixed extension getting cut off at filename limit. Cleaned up save module. 2018-07-01 01:49:59 +02:00
c639503667 Fixed index file for single post fetching. 2018-07-01 01:07:32 +02:00
240146e554 Added redownload option to ignore index file. 2018-07-01 00:22:17 +02:00
84f7757712 Added date and indexed oldest/latest limit arguments. 2018-07-01 00:07:12 +02:00
a859ac573c Accounting for indexed posts. 2018-06-30 21:47:43 +02:00
74e36a6826 Using YAML rather than TSV for index files. Improves both readability and reindexability. 2018-06-30 03:33:30 +02:00
1c4ec06f68 Extracting indexed posts from fetched posts to allow for index rewrite flexibility. 2018-06-20 02:06:59 +02:00
33ef3d2c19 Reading index file and ignoring already indexed content. 2018-06-17 03:39:12 +02:00
7cf1a99915 Building user posts object after fetching user to ensure user fetched posts and directly fetched posts are added to the same user key. Refactor to make better use of functions. Moved profile detail saving call to content fetch. No longer attempting and failing to save profile details for deleted users (directory would not exist). 2018-06-17 01:11:10 +02:00
3b5d886da3 Saving index per user as TSV. Refactoring. 2018-06-15 01:06:31 +02:00
7446dc9efb Refactored info content fetching and saving to handle users object and utilize async/await. 2018-06-13 01:51:45 +02:00
aef4dd02c7 Fetching and curating posts per user without merge. 2018-06-10 02:48:49 +02:00
d56fff5082 1.11.2 2018-06-10 01:34:30 +02:00
f579bb2077 Remove double slashes from URLs before matching. 2018-06-10 01:34:28 +02:00
44f32b3347 1.11.1 2018-06-07 14:55:21 +02:00
3a724d1b37 Improved handling of unavailable/deleted vidble videos 2018-06-07 14:55:16 +02:00
ec6182e747 1.11.0 2018-06-07 14:40:17 +02:00
504de6247f Added vidble direct video (/watch?v=) support. 2018-06-07 14:40:15 +02:00
402b38a00e 1.10.1 2018-05-28 22:26:01 +02:00
89542bd064 Added -size-restricted URL pattern for gfycat. Fixed missing getUser argument. 2018-05-28 22:25:58 +02:00
b27eb1df03 1.10.0 2018-05-28 01:42:49 +02:00
e056acfbd3 Refactored post retrieval so limit is applied per-user and ignores directly requested posts, and to start utilizing async/await. 2018-05-28 01:42:46 +02:00
010470ca8c 1.9.4 2018-05-23 17:07:00 +02:00
71ea86f7fc Mentioning API registration requirement in README. 2018-05-23 17:06:55 +02:00
053c89ab88 1.9.3 2018-05-23 17:03:15 +02:00
569213e291 Added filepath component length limit with truncator. Fixed double extension dot when copying original extension. Moved API keys to local config. 2018-05-23 17:03:12 +02:00
6f306322c6 1.9.2 2018-05-22 22:55:53 +02:00
edf77e259b Refactored post fetching. Cleaner code that will now fetch archived posts even if the user no longer exists on reddit. Expanded gfycat URL detection. 2018-05-22 22:55:50 +02:00
67378d4c7a Added new eroshare method source files. 2018-05-15 15:36:15 +02:00
9bdc45439b 1.9.1 2018-05-14 00:38:53 +02:00
6f21d41cd0 Added support for /i/ eroshare items. 2018-05-14 00:38:49 +02:00
9dc067c84f 1.9.0 2018-05-12 23:37:47 +02:00