Commit Graph

194 Commits

Author SHA1 Message Date
ThePendulum cd0fde24f0 1.16.1 2018-12-26 15:47:48 +01:00
ThePendulum 727a25e61b Fixed gfycat fetching. 2018-12-26 15:47:45 +01:00
ThePendulum 8ed5812d44 1.16.0 2018-07-08 18:48:18 +02:00
ThePendulum 73504a6d32 Added post score to index and variables. 2018-07-08 18:48:14 +02:00
ThePendulum dc96f8d4e8 1.15.0 2018-07-08 01:08:26 +02:00
ThePendulum 1b29d8fb96 Added basic PornHub support. 2018-07-08 01:08:20 +02:00
ThePendulum 346a946244 1.14.9 2018-07-08 00:18:56 +02:00
ThePendulum aa1c612306 Added after/before-index alias for after/before-indexed 2018-07-08 00:18:51 +02:00
ThePendulum e7af52bc01 1.14.8 2018-07-07 23:46:22 +02:00
ThePendulum 3abc6bb389 Always returning null for profile details when no profile was found, not undefined. Prevents YAML index write from failing. 2018-07-07 23:45:43 +02:00
ThePendulum e029fddad3 1.14.7 2018-07-07 04:12:20 +02:00
ThePendulum 3a86f61835 Defaulting to jpeg if reddit image extension is not present. 2018-07-07 04:12:16 +02:00
ThePendulum 9ec9569ab2 1.14.6 2018-07-07 04:07:10 +02:00
ThePendulum f025aaa370 Added optional URL query to all external hosts in link dissection. 2018-07-07 04:07:07 +02:00
ThePendulum 3c9675ea85 Removed duplicate post link from imgur logs 2018-07-07 04:03:42 +02:00
ThePendulum b18d235828 1.14.5 2018-07-07 02:17:44 +02:00
ThePendulum d9ce4dd056 Added option to index (specified) ignored posts. Saving index through save module, and it now notifies the user that an index has been written. 2018-07-07 02:17:41 +02:00
ThePendulum fd4fe8a0c5 1.14.4 2018-07-07 00:58:20 +02:00
ThePendulum 783e2d8765 Added byte truncate script to repo. Fixed yargs not enforcing choices. 2018-07-07 00:58:15 +02:00
ThePendulum ea97568c02 1.14.3 2018-07-07 00:37:20 +02:00
ThePendulum 6c15d2e88b Calculating filename component limit in bytes rather than characters, preventing 'filename too long' errors when e.g. emojis are used 2018-07-07 00:37:10 +02:00
ThePendulum 263525c320 1.14.2 2018-07-06 23:06:04 +02:00
ThePendulum 4e19c25b0d Reintroduced imgur API as a fallback method. 2018-07-06 23:05:58 +02:00
ThePendulum a0e01c8837 Allowing for -mobile gfycat links, simplified URL patterns 2018-07-06 00:39:43 +02:00
ThePendulum 160ee9711d Accounting for actualid_d.jpg imgur pattern. Added debug argument to print full stack trace on error. 2018-07-05 23:27:11 +02:00
ThePendulum 2cc15eecd0 No longer relying on imgur API for albums. Removed config for imgur API. Fixed ?#0 URLs not being detected for imgur. 2018-07-05 02:54:29 +02:00
ThePendulum f5382ddc37 No longer using imgur API for individual images. Only saving EXIF data to JPEGs. Always using global exiftool instance. 2018-07-05 02:00:45 +02:00
ThePendulum 5dce74588b Improved missing gfycat handling. Added 'preview' marker to index. 2018-07-02 23:15:06 +02:00
ThePendulum dfee2c2ae2 1.14.1 2018-07-02 19:55:24 +02:00
ThePendulum 310931e4f8 Don't attempt to save index when there are no posts or profile details (complained about directory not existing) 2018-07-02 19:55:21 +02:00
ThePendulum 7fd3f1c01b 1.14.0 2018-07-02 03:45:23 +02:00
ThePendulum c1f26440fd Added fetch concurrency. 2018-07-02 03:45:20 +02:00
ThePendulum d1acde5952 1.13.1 2018-07-02 02:33:40 +02:00
ThePendulum b4356e8e11 Added support for file with host IDs to ignore. 2018-07-02 02:33:34 +02:00
ThePendulum 9730a9dc87 1.13.0 2018-07-02 00:25:57 +02:00
ThePendulum 7335db1593 Allow usernames and post IDs to be read from file. 2018-07-02 00:25:48 +02:00
ThePendulum 5b023adf30 Switched from setTimeout to crontab for watch-mode. 2018-07-01 23:16:03 +02:00
ThePendulum 23f9ac660a 1.12.1 2018-07-01 03:38:32 +02:00
ThePendulum 9ded9a131e Added timestamp to watch mode status log. 2018-07-01 03:38:29 +02:00
ThePendulum 5edf5cd71b 1.12.0 2018-07-01 03:33:00 +02:00
ThePendulum cb6fd0c7f6 Fixed profile image checking for indexed description instead of image. 2018-07-01 03:32:53 +02:00
ThePendulum 1b1323dc3d No longer redownload profile image and description when indexed, unless --redownload-profile is specified. 2018-07-01 03:26:26 +02:00
ThePendulum e7eef86b23 Added watch-mode. Waiting for profile detail write to finalize before new watch cycle and capture details in index file. 2018-07-01 03:06:57 +02:00
ThePendulum f9f9c8a0bd Fixed extension getting cut off at filename limit. Cleaned up save module. 2018-07-01 01:49:59 +02:00
ThePendulum c639503667 Fixed index file for single post fetching. 2018-07-01 01:07:32 +02:00
ThePendulum 240146e554 Added redownload option to ignore index file. 2018-07-01 00:22:17 +02:00
ThePendulum 84f7757712 Added date and indexed oldest/latest limit arguments. 2018-07-01 00:07:12 +02:00
ThePendulum a859ac573c Accounting for indexed posts. 2018-06-30 21:47:43 +02:00
ThePendulum 74e36a6826 Using YAML rather than TSV for index files. Improves both readability and reindexability. 2018-06-30 03:33:30 +02:00
ThePendulum 1c4ec06f68 Extracting indexed posts from fetched posts to allow for index rewrite flexibility. 2018-06-20 02:06:59 +02:00