 ThePendulum
|
8a978cb803
|
Storing pHash. Fixed RedGIFs user agent.
|
2023-03-12 22:39:00 +01:00 |
|
ThePendulum
|
8704fb738b
|
Using Imgur API rate limit feedback to prevent exceeding it.
|
2023-03-04 01:38:49 +01:00 |
|
ThePendulum
|
c69ac9876a
|
Added predata step. Using RedGifs temporary API key.
|
2023-02-27 02:37:08 +01:00 |
|
ThePendulum
|
66e5bfa50a
|
Added support for RedGifs and Reddit albums. Improved command line logger. Added rate limiters for reddit and host URLs.
|
2021-12-17 02:04:25 +01:00 |
|
ThePendulum
|
e1cc615a99
|
Added support for various tube and social media sites via youtube-dl.
|
2019-11-12 03:38:26 +01:00 |
|
ThePendulum
|
e175ce38c8
|
Fetching and storing comments for self posts.
|
2019-11-05 01:58:00 +01:00 |
|
ThePendulum
|
a7135f48a6
|
Added dynamic dividers to patterns. Fixed PornHub module. Updated README.
|
2019-11-02 02:19:23 +01:00 |
|
ThePendulum
|
401a4e2153
|
Completed Erome module. Added content URL list fetching.
|
2019-11-01 05:55:55 +01:00 |
|
ThePendulum
|
eee3ba0abc
|
Added support for fetching content directly from host. Improved pattern interpolation. Refactored content modules.
|
2019-11-01 04:22:36 +01:00 |
Niels Simenon
|
db6317e560
|
Removed HTML scraper from imgur module, no longer support due to login restriction. Preserving 'preview' property in index file.
|
2019-10-31 05:22:07 +01:00 |
|
ThePendulum
|
a0e01c8837
|
Allowing for -mobile gfycat links, simplified URL patterns
|
2018-07-06 00:39:43 +02:00 |
|
ThePendulum
|
160ee9711d
|
Accounting for actualid_d.jpg imgur pattern. Added debug argument to print full stack trace on error.
|
2018-07-05 23:27:11 +02:00 |
|
ThePendulum
|
c1f26440fd
|
Added fetch concurrency.
|
2018-07-02 03:45:20 +02:00 |
|
ThePendulum
|
b4356e8e11
|
Added support for file with host IDs to ignore.
|
2018-07-02 02:33:34 +02:00 |
|
ThePendulum
|
7335db1593
|
Allow usernames and post IDs to be read from file.
|
2018-07-02 00:25:48 +02:00 |
|
ThePendulum
|
5b023adf30
|
Switched from setTimeout to crontab for watch-mode.
|
2018-07-01 23:16:03 +02:00 |
|
ThePendulum
|
9ded9a131e
|
Added timestamp to watch mode status log.
|
2018-07-01 03:38:29 +02:00 |
|
ThePendulum
|
1b1323dc3d
|
No longer redownload profile image and description when indexed, unless --redownload-profile is specified.
|
2018-07-01 03:26:26 +02:00 |
|
ThePendulum
|
e7eef86b23
|
Added watch-mode. Waiting for profile detail write to finalize before new watch cycle and capture details in index file.
|
2018-07-01 03:06:57 +02:00 |
|
ThePendulum
|
c639503667
|
Fixed index file for single post fetching.
|
2018-07-01 01:07:32 +02:00 |
|
ThePendulum
|
33ef3d2c19
|
Reading index file and ignoring already indexed content.
|
2018-06-17 03:39:12 +02:00 |
|
ThePendulum
|
7cf1a99915
|
Building user posts object after fetching user to ensure user fetched posts and directly fetched posts are added to the same user key. Refactor to make better use of functions. Moved profile detail saving call to content fetch. No longer attempting and failing to save profile details for deleted users (directory would not exist).
|
2018-06-17 01:11:10 +02:00 |
|
ThePendulum
|
3b5d886da3
|
Saving index per user as TSV. Refactoring.
|
2018-06-15 01:06:31 +02:00 |
|
ThePendulum
|
7446dc9efb
|
Refactored info content fetching and saving to handle users object and utilize async/await.
|
2018-06-13 01:51:45 +02:00 |
|
ThePendulum
|
aef4dd02c7
|
Fetching and curating posts per user without merge.
|
2018-06-10 02:48:49 +02:00 |
|
ThePendulum
|
e056acfbd3
|
Refactored post retrieval so limit is applied per-user and ignores directly requested posts, and to start utilizing async/await.
|
2018-05-28 01:42:46 +02:00 |
|
ThePendulum
|
edf77e259b
|
Refactored post fetching. Cleaner code that will now fetch archived posts even if the user no longer exists on reddit. Expanded gfycat URL detection.
|
2018-05-22 22:55:50 +02:00 |
|
ThePendulum
|
068ffbdbd8
|
Added include and exclude source arguments. Improved stream fetch failure handling and improved logging details.
|
2018-05-05 17:08:40 +02:00 |
|
ThePendulum
|
804d01d7cf
|
Cleaned up entrypoint.
|
2018-05-05 02:27:15 +02:00 |
|
ThePendulum
|
dd3be88122
|
Added preview property. Removed debugging intercepts. Logging post permalink on failed info fetch.
|
2018-05-05 01:22:23 +02:00 |
|
ThePendulum
|
ca3bdd717d
|
Added archive support, and the IP archive.
|
2018-05-05 00:51:58 +02:00 |
|
ThePendulum
|
93781b596f
|
Allow posts from [deleted] users to be fetched.
|
2018-05-01 02:46:13 +02:00 |
|
ThePendulum
|
05b5bee7ea
|
Added support for fetching individual posts. Improved use of yargs, --help now available. Refactored main app flow.
|
2018-04-29 02:02:34 +02:00 |
|
ThePendulum
|
45182c07db
|
Checking result status rather than ok for imgur methods.
|
2018-04-28 17:07:16 +02:00 |
|
ThePendulum
|
ce6b63562a
|
Fixed obsolete eroshare extract single album item property. Throwing error when imgur album and image info fetch fails. Main catch method console log colored red.
|
2018-04-28 02:10:55 +02:00 |
|
ThePendulum
|
33bc13ebfb
|
Added ignore argument.
|
2018-04-28 00:03:31 +02:00 |
|
ThePendulum
|
e752667be7
|
Added support for muxing streams, specifically for reddit-hosted videos (now also supported).
|
2018-04-26 03:26:39 +02:00 |
|
ThePendulum
|
4551a1f5d2
|
Moved source into dedicated directory.
|
2018-04-23 02:36:07 +02:00 |