Commit Graph

195 Commits

Author SHA1 Message Date
Niels Simenon db6317e560 Removed HTML scraper from imgur module, no longer support due to login restriction. Preserving 'preview' property in index file. 2019-10-31 05:22:07 +01:00
ThePendulum cd0fde24f0 1.16.1 2018-12-26 15:47:48 +01:00
ThePendulum 727a25e61b Fixed gfycat fetching. 2018-12-26 15:47:45 +01:00
ThePendulum 8ed5812d44 1.16.0 2018-07-08 18:48:18 +02:00
ThePendulum 73504a6d32 Added post score to index and variables. 2018-07-08 18:48:14 +02:00
ThePendulum dc96f8d4e8 1.15.0 2018-07-08 01:08:26 +02:00
ThePendulum 1b29d8fb96 Added basic PornHub support. 2018-07-08 01:08:20 +02:00
ThePendulum 346a946244 1.14.9 2018-07-08 00:18:56 +02:00
ThePendulum aa1c612306 Added after/before-index alias for after/before-indexed 2018-07-08 00:18:51 +02:00
ThePendulum e7af52bc01 1.14.8 2018-07-07 23:46:22 +02:00
ThePendulum 3abc6bb389 Always returning null for profile details when no profile was found, not undefined. Prevents YAML index write from failing. 2018-07-07 23:45:43 +02:00
ThePendulum e029fddad3 1.14.7 2018-07-07 04:12:20 +02:00
ThePendulum 3a86f61835 Defaulting to jpeg if reddit image extension is not present. 2018-07-07 04:12:16 +02:00
ThePendulum 9ec9569ab2 1.14.6 2018-07-07 04:07:10 +02:00
ThePendulum f025aaa370 Added optional URL query to all external hosts in link dissection. 2018-07-07 04:07:07 +02:00
ThePendulum 3c9675ea85 Removed duplicate post link from imgur logs 2018-07-07 04:03:42 +02:00
ThePendulum b18d235828 1.14.5 2018-07-07 02:17:44 +02:00
ThePendulum d9ce4dd056 Added option to index (specified) ignored posts. Saving index through save module, and it now notifies the user that an index has been written. 2018-07-07 02:17:41 +02:00
ThePendulum fd4fe8a0c5 1.14.4 2018-07-07 00:58:20 +02:00
ThePendulum 783e2d8765 Added byte truncate script to repo. Fixed yargs not enforcing choices. 2018-07-07 00:58:15 +02:00
ThePendulum ea97568c02 1.14.3 2018-07-07 00:37:20 +02:00
ThePendulum 6c15d2e88b Calculating filename component limit in bytes rather than characters, preventing 'filename too long' errors when e.g. emojis are used 2018-07-07 00:37:10 +02:00
ThePendulum 263525c320 1.14.2 2018-07-06 23:06:04 +02:00
ThePendulum 4e19c25b0d Reintroduced imgur API as a fallback method. 2018-07-06 23:05:58 +02:00
ThePendulum a0e01c8837 Allowing for -mobile gfycat links, simplified URL patterns 2018-07-06 00:39:43 +02:00
ThePendulum 160ee9711d Accounting for actualid_d.jpg imgur pattern. Added debug argument to print full stack trace on error. 2018-07-05 23:27:11 +02:00
ThePendulum 2cc15eecd0 No longer relying on imgur API for albums. Removed config for imgur API. Fixed ?#0 URLs not being detected for imgur. 2018-07-05 02:54:29 +02:00
ThePendulum f5382ddc37 No longer using imgur API for individual images. Only saving EXIF data to JPEGs. Always using global exiftool instance. 2018-07-05 02:00:45 +02:00
ThePendulum 5dce74588b Improved missing gfycat handling. Added 'preview' marker to index. 2018-07-02 23:15:06 +02:00
ThePendulum dfee2c2ae2 1.14.1 2018-07-02 19:55:24 +02:00
ThePendulum 310931e4f8 Don't attempt to save index when there are no posts or profile details (complained about directory not existing) 2018-07-02 19:55:21 +02:00
ThePendulum 7fd3f1c01b 1.14.0 2018-07-02 03:45:23 +02:00
ThePendulum c1f26440fd Added fetch concurrency. 2018-07-02 03:45:20 +02:00
ThePendulum d1acde5952 1.13.1 2018-07-02 02:33:40 +02:00
ThePendulum b4356e8e11 Added support for file with host IDs to ignore. 2018-07-02 02:33:34 +02:00
ThePendulum 9730a9dc87 1.13.0 2018-07-02 00:25:57 +02:00
ThePendulum 7335db1593 Allow usernames and post IDs to be read from file. 2018-07-02 00:25:48 +02:00
ThePendulum 5b023adf30 Switched from setTimeout to crontab for watch-mode. 2018-07-01 23:16:03 +02:00
ThePendulum 23f9ac660a 1.12.1 2018-07-01 03:38:32 +02:00
ThePendulum 9ded9a131e Added timestamp to watch mode status log. 2018-07-01 03:38:29 +02:00
ThePendulum 5edf5cd71b 1.12.0 2018-07-01 03:33:00 +02:00
ThePendulum cb6fd0c7f6 Fixed profile image checking for indexed description instead of image. 2018-07-01 03:32:53 +02:00
ThePendulum 1b1323dc3d No longer redownload profile image and description when indexed, unless --redownload-profile is specified. 2018-07-01 03:26:26 +02:00
ThePendulum e7eef86b23 Added watch-mode. Waiting for profile detail write to finalize before new watch cycle and capture details in index file. 2018-07-01 03:06:57 +02:00
ThePendulum f9f9c8a0bd Fixed extension getting cut off at filename limit. Cleaned up save module. 2018-07-01 01:49:59 +02:00
ThePendulum c639503667 Fixed index file for single post fetching. 2018-07-01 01:07:32 +02:00
ThePendulum 240146e554 Added redownload option to ignore index file. 2018-07-01 00:22:17 +02:00
ThePendulum 84f7757712 Added date and indexed oldest/latest limit arguments. 2018-07-01 00:07:12 +02:00
ThePendulum a859ac573c Accounting for indexed posts. 2018-06-30 21:47:43 +02:00
ThePendulum 74e36a6826 Using YAML rather than TSV for index files. Improves both readability and reindexability. 2018-06-30 03:33:30 +02:00