Go to file

ThePendulum 9865d846e7 Added README.		2018-04-17 00:14:23 +02:00
methods	Added file save patterns, fetch retry and gfycat support.	2018-04-16 23:46:39 +02:00
.gitignore	Fetching posts in series to prevent directory creation race condition. Removed duplicate check for now (will check per post, not per image, in the future).	2018-04-15 04:51:02 +02:00
README.md	Added README.	2018-04-17 00:14:23 +02:00
app.js	Added file save patterns, fetch retry and gfycat support.	2018-04-16 23:46:39 +02:00
dissectLink.js	Added file save patterns, fetch retry and gfycat support.	2018-04-16 23:46:39 +02:00
fetchContent.js	Added README.	2018-04-17 00:14:23 +02:00
package-lock.json	0.3.0	2018-04-16 23:46:42 +02:00
package.json	0.3.0	2018-04-16 23:46:42 +02:00

README.md

reddit-post-dump

Installation

npm install

Usage

node app.js --user={username}

Configuration

The default configuration aims to be sensible, and the application may be used without any further tweaking. However, this application came to life because I was not satisfied by the organizatory facilities of similar applications, thus a multitude of options are at your disposal as described in this document.

Patterns

Path patterns dictate where and how a file will be saved. Various variables and options are available, and you may use subdirectories divided by /.

Variables

$postId: The ID of the reddit post
$postTitle: The title of the reddit post
$postUser: The user that submitted the post, almost always equivalent to the --user command line argument
$postDate: The submission date of the reddit post, formatted by the dateformat configuration described below
$albumId: The ID of the media host album
$albumTitle: The title of the media host album
$albumDescription: The description of the media host album
$albumDate: The submission date of the media host album, formatted by the dateformat configuration described below
$itemId: The ID of the individual image or video
$itemTitle: The title of the individual image or video
$itemDescription: The description of the individual image or video
$itemDate: The submission date of the individual image or video, formatted by the dateformat configuration described below
$itemIndex: The index of the individual image or video in an album, offset by the indexOffset configuration described below
$ext: The extension of the file. Must practically always be included.

Date format

Affects the representation of $postDate, $albumDate and $itemDate and defaults to YYYYMMDD. See this documentation for an overview of all available tokens.

Index offset

Arrays start at 0, but as to not tire myself out debating the matter, you may offset it my any numerical value you like. Affects the $itemIndex variable for album items.

Slash substitute

The patterns are Unix file paths, and a / therefore indicates a new directory. You may freely use directories in your paths, but titles or descriptions may contain a / that is not supposed to create a new directory. All instances of / in a variable value will be replaced with the configured slash substitute.