Commit Graph

22 Commits

Author SHA1 Message Date
ThePendulum 66e5bfa50a Added support for RedGifs and Reddit albums. Improved command line logger. Added rate limiters for reddit and host URLs. 2021-12-17 02:04:25 +01:00
ThePendulum e1cc615a99 Added support for various tube and social media sites via youtube-dl. 2019-11-12 03:38:26 +01:00
ThePendulum a7135f48a6 Added dynamic dividers to patterns. Fixed PornHub module. Updated README. 2019-11-02 02:19:23 +01:00
ThePendulum 401a4e2153 Completed Erome module. Added content URL list fetching. 2019-11-01 05:55:55 +01:00
ThePendulum eee3ba0abc Added support for fetching content directly from host. Improved pattern interpolation. Refactored content modules. 2019-11-01 04:22:36 +01:00
ThePendulum aa1c612306 Added after/before-index alias for after/before-indexed 2018-07-08 00:18:51 +02:00
ThePendulum d9ce4dd056 Added option to index (specified) ignored posts. Saving index through save module, and it now notifies the user that an index has been written. 2018-07-07 02:17:41 +02:00
ThePendulum 783e2d8765 Added byte truncate script to repo. Fixed yargs not enforcing choices. 2018-07-07 00:58:15 +02:00
ThePendulum b4356e8e11 Added support for file with host IDs to ignore. 2018-07-02 02:33:34 +02:00
ThePendulum 7335db1593 Allow usernames and post IDs to be read from file. 2018-07-02 00:25:48 +02:00
ThePendulum 1b1323dc3d No longer redownload profile image and description when indexed, unless --redownload-profile is specified. 2018-07-01 03:26:26 +02:00
ThePendulum e7eef86b23 Added watch-mode. Waiting for profile detail write to finalize before new watch cycle and capture details in index file. 2018-07-01 03:06:57 +02:00
ThePendulum 240146e554 Added redownload option to ignore index file. 2018-07-01 00:22:17 +02:00
ThePendulum 84f7757712 Added date and indexed oldest/latest limit arguments. 2018-07-01 00:07:12 +02:00
ThePendulum 74e36a6826 Using YAML rather than TSV for index files. Improves both readability and reindexability. 2018-06-30 03:33:30 +02:00
ThePendulum 7cf1a99915 Building user posts object after fetching user to ensure user fetched posts and directly fetched posts are added to the same user key. Refactor to make better use of functions. Moved profile detail saving call to content fetch. No longer attempting and failing to save profile details for deleted users (directory would not exist). 2018-06-17 01:11:10 +02:00
ThePendulum e056acfbd3 Refactored post retrieval so limit is applied per-user and ignores directly requested posts, and to start utilizing async/await. 2018-05-28 01:42:46 +02:00
ThePendulum edf77e259b Refactored post fetching. Cleaner code that will now fetch archived posts even if the user no longer exists on reddit. Expanded gfycat URL detection. 2018-05-22 22:55:50 +02:00
ThePendulum 068ffbdbd8 Added include and exclude source arguments. Improved stream fetch failure handling and improved logging details. 2018-05-05 17:08:40 +02:00
ThePendulum ca3bdd717d Added archive support, and the IP archive. 2018-05-05 00:51:58 +02:00
ThePendulum 4754e2445d Added npm script for running application. 2018-04-29 04:13:01 +02:00
ThePendulum 05b5bee7ea Added support for fetching individual posts. Improved use of yargs, --help now available. Refactored main app flow. 2018-04-29 02:02:34 +02:00