 ThePendulum
|
da8ffc0025
|
Fixed RedGIFs gallery support.
|
2023-06-05 04:11:34 +02:00 |
|
ThePendulum
|
8a978cb803
|
Storing pHash. Fixed RedGIFs user agent.
|
2023-03-12 22:39:00 +01:00 |
|
ThePendulum
|
8704fb738b
|
Using Imgur API rate limit feedback to prevent exceeding it.
|
2023-03-04 01:38:49 +01:00 |
|
ThePendulum
|
c69ac9876a
|
Added predata step. Using RedGifs temporary API key.
|
2023-02-27 02:37:08 +01:00 |
|
ThePendulum
|
66e5bfa50a
|
Added support for RedGifs and Reddit albums. Improved command line logger. Added rate limiters for reddit and host URLs.
|
2021-12-17 02:04:25 +01:00 |
|
ThePendulum
|
e1cc615a99
|
Added support for various tube and social media sites via youtube-dl.
|
2019-11-12 03:38:26 +01:00 |
|
ThePendulum
|
7de8f94caa
|
Added hash comparison to duplicate avoidance.
|
2019-11-05 04:52:17 +01:00 |
|
ThePendulum
|
e175ce38c8
|
Fetching and storing comments for self posts.
|
2019-11-05 01:58:00 +01:00 |
|
ThePendulum
|
eee3ba0abc
|
Added support for fetching content directly from host. Improved pattern interpolation. Refactored content modules.
|
2019-11-01 04:22:36 +01:00 |
|
ThePendulum
|
4d87d94762
|
Removed debug log. Updated README to mention imgur API key requirement.
|
2019-10-31 05:24:38 +01:00 |
Niels Simenon
|
db6317e560
|
Removed HTML scraper from imgur module, no longer support due to login restriction. Preserving 'preview' property in index file.
|
2019-10-31 05:22:07 +01:00 |
|
ThePendulum
|
aa1c612306
|
Added after/before-index alias for after/before-indexed
|
2018-07-08 00:18:51 +02:00 |
|
ThePendulum
|
d9ce4dd056
|
Added option to index (specified) ignored posts. Saving index through save module, and it now notifies the user that an index has been written.
|
2018-07-07 02:17:41 +02:00 |
|
ThePendulum
|
f5382ddc37
|
No longer using imgur API for individual images. Only saving EXIF data to JPEGs. Always using global exiftool instance.
|
2018-07-05 02:00:45 +02:00 |
|
ThePendulum
|
5dce74588b
|
Improved missing gfycat handling. Added 'preview' marker to index.
|
2018-07-02 23:15:06 +02:00 |
|
ThePendulum
|
c1f26440fd
|
Added fetch concurrency.
|
2018-07-02 03:45:20 +02:00 |
|
ThePendulum
|
1b1323dc3d
|
No longer redownload profile image and description when indexed, unless --redownload-profile is specified.
|
2018-07-01 03:26:26 +02:00 |
|
ThePendulum
|
e7eef86b23
|
Added watch-mode. Waiting for profile detail write to finalize before new watch cycle and capture details in index file.
|
2018-07-01 03:06:57 +02:00 |
|
ThePendulum
|
7cf1a99915
|
Building user posts object after fetching user to ensure user fetched posts and directly fetched posts are added to the same user key. Refactor to make better use of functions. Moved profile detail saving call to content fetch. No longer attempting and failing to save profile details for deleted users (directory would not exist).
|
2018-06-17 01:11:10 +02:00 |
|
ThePendulum
|
3b5d886da3
|
Saving index per user as TSV. Refactoring.
|
2018-06-15 01:06:31 +02:00 |
|
ThePendulum
|
7446dc9efb
|
Refactored info content fetching and saving to handle users object and utilize async/await.
|
2018-06-13 01:51:45 +02:00 |
|
ThePendulum
|
aef4dd02c7
|
Fetching and curating posts per user without merge.
|
2018-06-10 02:48:49 +02:00 |
|
ThePendulum
|
569213e291
|
Added filepath component length limit with truncator. Fixed double extension dot when copying original extension. Moved API keys to local config.
|
2018-05-23 17:03:12 +02:00 |
|
ThePendulum
|
cdff8354a7
|
Fixed missing return causing no saves.
|
2018-05-05 22:39:21 +02:00 |
|
ThePendulum
|
068ffbdbd8
|
Added include and exclude source arguments. Improved stream fetch failure handling and improved logging details.
|
2018-05-05 17:08:40 +02:00 |
|
ThePendulum
|
9d32450864
|
Added support for reddit preview fallback.
|
2018-05-05 02:14:48 +02:00 |
|
ThePendulum
|
dd3be88122
|
Added preview property. Removed debugging intercepts. Logging post permalink on failed info fetch.
|
2018-05-05 01:22:23 +02:00 |
|
ThePendulum
|
ca3bdd717d
|
Added archive support, and the IP archive.
|
2018-05-05 00:51:58 +02:00 |
|
ThePendulum
|
05b5bee7ea
|
Added support for fetching individual posts. Improved use of yargs, --help now available. Refactored main app flow.
|
2018-04-29 02:02:34 +02:00 |
|
ThePendulum
|
9e9ed9de07
|
Fixed text posts not passing streams correctly since previous change.
|
2018-04-26 04:53:56 +02:00 |
|
ThePendulum
|
0313b291da
|
Adapted primary save function to handle single streams and non-item saves (e.g. profiles).
|
2018-04-26 03:35:42 +02:00 |
|
ThePendulum
|
e752667be7
|
Added support for muxing streams, specifically for reddit-hosted videos (now also supported).
|
2018-04-26 03:26:39 +02:00 |
|
ThePendulum
|
f2052004df
|
Using metadata configuration rather than item description for EXIF save. Fixed dissect duplicate detection failing for empty host.
|
2018-04-26 00:34:08 +02:00 |
|
ThePendulum
|
0b9fba7af2
|
Ignoring empty interpolated metadata. Added URL query wildcard to imgur and reddit images. Using host ID rather than URL to improve duplicate detection.
|
2018-04-26 00:22:56 +02:00 |
|
ThePendulum
|
f4535e443b
|
Saving EXIF data for jpegs.
|
2018-04-24 22:25:36 +02:00 |
|
ThePendulum
|
4551a1f5d2
|
Moved source into dedicated directory.
|
2018-04-23 02:36:07 +02:00 |