Commit Graph
100 Commits
Author SHA1 Message Date
pendulum 160ee9711d Accounting for actualid_d.jpg imgur pattern. Added debug argument to print full stack trace on error. 2018-07-05 23:27:11 +02:00
pendulum 2cc15eecd0 No longer relying on imgur API for albums. Removed config for imgur API. Fixed ?#0 URLs not being detected for imgur. 2018-07-05 02:54:29 +02:00
pendulum f5382ddc37 No longer using imgur API for individual images. Only saving EXIF data to JPEGs. Always using global exiftool instance. 2018-07-05 02:00:45 +02:00
pendulum 5dce74588b Improved missing gfycat handling. Added 'preview' marker to index. 2018-07-02 23:15:06 +02:00
pendulum dfee2c2ae2 1.14.1 2018-07-02 19:55:24 +02:00
pendulum 310931e4f8 Don't attempt to save index when there are no posts or profile details (complained about directory not existing) 2018-07-02 19:55:21 +02:00
pendulum 7fd3f1c01b 1.14.0 2018-07-02 03:45:23 +02:00
pendulum c1f26440fd Added fetch concurrency. 2018-07-02 03:45:20 +02:00
pendulum d1acde5952 1.13.1 2018-07-02 02:33:40 +02:00
pendulum b4356e8e11 Added support for file with host IDs to ignore. 2018-07-02 02:33:34 +02:00
pendulum 9730a9dc87 1.13.0 2018-07-02 00:25:57 +02:00
pendulum 7335db1593 Allow usernames and post IDs to be read from file. 2018-07-02 00:25:48 +02:00
pendulum 5b023adf30 Switched from setTimeout to crontab for watch-mode. 2018-07-01 23:16:03 +02:00
pendulum 23f9ac660a 1.12.1 2018-07-01 03:38:32 +02:00
pendulum 9ded9a131e Added timestamp to watch mode status log. 2018-07-01 03:38:29 +02:00
pendulum 5edf5cd71b 1.12.0 2018-07-01 03:33:00 +02:00
pendulum cb6fd0c7f6 Fixed profile image checking for indexed description instead of image. 2018-07-01 03:32:53 +02:00
pendulum 1b1323dc3d No longer redownload profile image and description when indexed, unless --redownload-profile is specified. 2018-07-01 03:26:26 +02:00
pendulum e7eef86b23 Added watch-mode. Waiting for profile detail write to finalize before new watch cycle and capture details in index file. 2018-07-01 03:06:57 +02:00
pendulum f9f9c8a0bd Fixed extension getting cut off at filename limit. Cleaned up save module. 2018-07-01 01:49:59 +02:00
pendulum c639503667 Fixed index file for single post fetching. 2018-07-01 01:07:32 +02:00
pendulum 240146e554 Added redownload option to ignore index file. 2018-07-01 00:22:17 +02:00
pendulum 84f7757712 Added date and indexed oldest/latest limit arguments. 2018-07-01 00:07:12 +02:00
pendulum a859ac573c Accounting for indexed posts. 2018-06-30 21:47:43 +02:00
pendulum 74e36a6826 Using YAML rather than TSV for index files. Improves both readability and reindexability. 2018-06-30 03:33:30 +02:00
pendulum 1c4ec06f68 Extracting indexed posts from fetched posts to allow for index rewrite flexibility. 2018-06-20 02:06:59 +02:00
pendulum 33ef3d2c19 Reading index file and ignoring already indexed content. 2018-06-17 03:39:12 +02:00
pendulum 7cf1a99915 Building user posts object after fetching user to ensure user fetched posts and directly fetched posts are added to the same user key. Refactor to make better use of functions. Moved profile detail saving call to content fetch. No longer attempting and failing to save profile details for deleted users (directory would not exist). 2018-06-17 01:11:10 +02:00
pendulum 3b5d886da3 Saving index per user as TSV. Refactoring. 2018-06-15 01:06:31 +02:00
pendulum 7446dc9efb Refactored info content fetching and saving to handle users object and utilize async/await. 2018-06-13 01:51:45 +02:00
pendulum aef4dd02c7 Fetching and curating posts per user without merge. 2018-06-10 02:48:49 +02:00
pendulum d56fff5082 1.11.2 2018-06-10 01:34:30 +02:00
pendulum f579bb2077 Remove double slashes from URLs before matching. 2018-06-10 01:34:28 +02:00
pendulum 44f32b3347 1.11.1 2018-06-07 14:55:21 +02:00
pendulum 3a724d1b37 Improved handling of unavailable/deleted vidble videos 2018-06-07 14:55:16 +02:00
pendulum ec6182e747 1.11.0 2018-06-07 14:40:17 +02:00
pendulum 504de6247f Added vidble direct video (/watch?v=) support. 2018-06-07 14:40:15 +02:00
pendulum 402b38a00e 1.10.1 2018-05-28 22:26:01 +02:00
pendulum 89542bd064 Added -size-restricted URL pattern for gfycat. Fixed missing getUser argument. 2018-05-28 22:25:58 +02:00
pendulum b27eb1df03 1.10.0 2018-05-28 01:42:49 +02:00
pendulum e056acfbd3 Refactored post retrieval so limit is applied per-user and ignores directly requested posts, and to start utilizing async/await. 2018-05-28 01:42:46 +02:00
pendulum 010470ca8c 1.9.4 2018-05-23 17:07:00 +02:00
pendulum 71ea86f7fc Mentioning API registration requirement in README. 2018-05-23 17:06:55 +02:00
pendulum 053c89ab88 1.9.3 2018-05-23 17:03:15 +02:00
pendulum 569213e291 Added filepath component length limit with truncator. Fixed double extension dot when copying original extension. Moved API keys to local config. 2018-05-23 17:03:12 +02:00
pendulum 6f306322c6 1.9.2 2018-05-22 22:55:53 +02:00
pendulum edf77e259b Refactored post fetching. Cleaner code that will now fetch archived posts even if the user no longer exists on reddit. Expanded gfycat URL detection. 2018-05-22 22:55:50 +02:00
pendulum 67378d4c7a Added new eroshare method source files. 2018-05-15 15:36:15 +02:00
pendulum 9bdc45439b 1.9.1 2018-05-14 00:38:53 +02:00
pendulum 6f21d41cd0 Added support for /i/ eroshare items. 2018-05-14 00:38:49 +02:00
pendulum 9dc067c84f 1.9.0 2018-05-12 23:37:47 +02:00
pendulum b9a9fb16cf Removed jpeg to jpg replace. 2018-05-12 23:37:24 +02:00
pendulum 8abda731dd Added vidble image support. 2018-05-12 23:36:20 +02:00
pendulum 9d6882a7c5 Fixed jpeg jpg substitution. 2018-05-12 16:29:41 +02:00
pendulum 6a4cb138fa 1.8.2 2018-05-11 01:46:12 +02:00
pendulum adbbc79b16 Added support for Vidble (image) albums. Replaced extensions.json and reverseLookup with mime-types lib. 2018-05-11 01:46:08 +02:00
pendulum 9a3d20aac3 1.8.1 2018-05-05 22:39:25 +02:00
pendulum cdff8354a7 Fixed missing return causing no saves. 2018-05-05 22:39:21 +02:00
pendulum 06e01fa680 1.8.0 2018-05-05 17:08:50 +02:00
pendulum 068ffbdbd8 Added include and exclude source arguments. Improved stream fetch failure handling and improved logging details. 2018-05-05 17:08:40 +02:00
pendulum 77e12d3c0f 1.7.4 2018-05-05 03:18:08 +02:00
pendulum 3794fc3776 Added support for m.imgur.com links. Changed curate ignore log message details. 2018-05-05 03:18:05 +02:00
pendulum 9dd9c823e8 1.7.3 2018-05-05 02:36:01 +02:00
pendulum 33146d55fe Moved archive feature from ideas to features in README. 2018-05-05 02:35:58 +02:00
pendulum 0bbd3924fe 1.7.2 2018-05-05 02:31:17 +02:00
pendulum af8b6cb545 Removed obsolete information from README. 2018-05-05 02:31:13 +02:00
pendulum 143945da69 1.7.1 2018-05-05 02:29:24 +02:00
pendulum 3d64be7738 Fixed lost variable item in README. 2018-05-05 02:29:21 +02:00
pendulum e1e31880bb 1.7.0 2018-05-05 02:27:57 +02:00
pendulum 804d01d7cf Cleaned up entrypoint. 2018-05-05 02:27:15 +02:00
pendulum 9d32450864 Added support for reddit preview fallback. 2018-05-05 02:14:48 +02:00
pendulum dd3be88122 Added preview property. Removed debugging intercepts. Logging post permalink on failed info fetch. 2018-05-05 01:22:23 +02:00
pendulum ca3bdd717d Added archive support, and the IP archive. 2018-05-05 00:51:58 +02:00
pendulum 1b3a334c24 1.6.4 2018-05-01 02:57:01 +02:00
pendulum 5b27099028 Added support for redd.it PNG. 2018-05-01 02:56:56 +02:00
pendulum acc7032c4c 1.6.3 2018-05-01 02:46:17 +02:00
pendulum 93781b596f Allow posts from [deleted] users to be fetched. 2018-05-01 02:46:13 +02:00
pendulum 7d31143ed3 1.6.2 2018-04-30 14:17:50 +02:00
pendulum 632dc96bc1 Fixed profile description not saving when user has avatar. 2018-04-30 14:17:44 +02:00
pendulum 9c388f04c7 1.6.1 2018-04-29 04:13:05 +02:00
pendulum 4754e2445d Added npm script for running application. 2018-04-29 04:13:01 +02:00
pendulum ab816204d0 1.6.0 2018-04-29 02:02:50 +02:00
pendulum 05b5bee7ea Added support for fetching individual posts. Improved use of yargs, --help now available. Refactored main app flow. 2018-04-29 02:02:34 +02:00
pendulum 45182c07db Checking result status rather than ok for imgur methods. 2018-04-28 17:07:16 +02:00
pendulum d9845bc596 1.5.2 2018-04-28 02:10:58 +02:00
pendulum ce6b63562a Fixed obsolete eroshare extract single album item property. Throwing error when imgur album and image info fetch fails. Main catch method console log colored red. 2018-04-28 02:10:55 +02:00
pendulum 394840e1c1 1.5.1 2018-04-28 00:27:35 +02:00
pendulum 9e9cca8834 Fixed avatar property. 2018-04-28 00:27:29 +02:00
pendulum 95a10d91a0 1.5.0 2018-04-28 00:03:51 +02:00
pendulum 33bc13ebfb Added ignore argument. 2018-04-28 00:03:31 +02:00
pendulum 905a12ee9f 1.4.0 2018-04-27 23:14:57 +02:00
pendulum ccfdc16ca8 Added reddit avatar URL detection and avoid option. 2018-04-27 23:14:48 +02:00
pendulum d550b88d57 1.3.6 2018-04-27 00:42:14 +02:00
pendulum 88425aee5b Fixed double dir path component extraction in save module (causing profile info save to fail). 2018-04-27 00:42:11 +02:00
pendulum 11d702d322 Rephrased reddit videos in README. 2018-04-26 16:24:08 +02:00
pendulum 543ce8f1fe Elaborated reddit videos in README. 2018-04-26 16:22:20 +02:00
pendulum 95efa6daed Removed asterisk from reddit videos README section and decreased header size. 2018-04-26 16:20:03 +02:00
pendulum 30aeee5117 1.3.5 2018-04-26 16:19:15 +02:00
pendulum f4a6a559f7 Explained reddit video muxing in README. 2018-04-26 16:19:10 +02:00
pendulum fe4d158d78 1.3.4 2018-04-26 04:56:20 +02:00