Commit Graph

Select branches

Hide Pull Requests

master

public-reddit-api

Mono Color

• 1496a48199 Improved timeout handling. public-reddit-api DebaucheryLibrarian 2026-09-14 20:08:55 +02:00
• 8b52d73a65 Separated and improved request throttling. DebaucheryLibrarian 2026-09-08 00:01:24 +02:00
• 3e8ed79ccc Addressed freezing indefinitely when requests are aborted. DebaucheryLibrarian 2026-09-02 17:27:26 +02:00
• ba922bb385 Fixed .false file extension. DebaucheryLibrarian 2026-08-17 23:31:29 +02:00
• 941cb280be Added proxy. DebaucheryLibrarian 2026-08-17 22:48:02 +02:00
• 5c7a0397c9 Bumped to Node 24 and upgraded dependencies. DebaucheryLibrarian 2026-08-09 02:03:54 +02:00
• 2e4ba27d98 Replaced Snoowrap with public API calls in response to Reddit revoking API keys. This was largely done using Claude Code, extensive manual review and major version bump needed if merged into main. DebaucheryLibrarian 2026-08-07 23:37:26 +02:00
• 51f0267133 1.27.6 master DebaucheryLibrarian 2025-11-28 01:16:03 +01:00
• 5923bb00bc Updated Node to v20 (blake2 incompatible with newer versions), replaced youtube-dl with youtube-dl-exec. DebaucheryLibrarian 2025-11-28 01:15:59 +01:00
• 508df69808 1.27.5 DebaucheryLibrarian 2024-09-11 05:16:59 +02:00
• e5b1e9ea25 Removed error response body from item fetch to minimize spamming image contents. DebaucheryLibrarian 2024-09-11 05:16:59 +02:00
• b4f8605464 1.27.4 DebaucheryLibrarian 2024-09-11 05:16:59 +02:00
• e642203d6c Fixed invalid URL breaking scrape, prefixing reddit URLs with origin. DebaucheryLibrarian 2024-09-11 05:16:59 +02:00
• b1e13e048c 1.27.3 DebaucheryLibrarian 2024-09-11 05:16:59 +02:00
• 96a041001b Stripping query for URL matching. DebaucheryLibrarian 2024-09-11 05:16:59 +02:00
• d402916d5e 1.27.2 DebaucheryLibrarian 2024-09-11 05:16:59 +02:00
• d1ac6d0068 Fixed RedGIFs gallery support. DebaucheryLibrarian 2024-09-11 05:16:59 +02:00
• cedecc273a 1.27.1 DebaucheryLibrarian 2024-09-11 05:16:59 +02:00
• afaa428fec Fixed YAML index file parser failing on duplicate keys. DebaucheryLibrarian 2024-09-11 05:16:58 +02:00
• aec5ce292d 1.27.0 DebaucheryLibrarian 2024-09-11 05:16:58 +02:00
• b7dc3f5fd1 Storing pHash. Fixed RedGIFs user agent. DebaucheryLibrarian 2024-09-11 05:16:58 +02:00
• 3931996e1b 1.26.0 DebaucheryLibrarian 2024-09-11 05:16:58 +02:00
• 7d633c31b4 Using Imgur API rate limit feedback to prevent exceeding it. DebaucheryLibrarian 2024-09-11 05:16:58 +02:00
• 7ec4143972 1.25.0 DebaucheryLibrarian 2024-09-11 05:16:58 +02:00
• bed4fe288f Added predata step. Using RedGifs temporary API key. DebaucheryLibrarian 2024-09-11 05:16:58 +02:00
• 4acbe16fb8 1.24.2 DebaucheryLibrarian 2024-09-11 05:16:58 +02:00
• 529f84d9c2 Fixed RedGIFs module content type. DebaucheryLibrarian 2024-09-11 05:16:58 +02:00
• 7eaaadaa2a 1.24.1 DebaucheryLibrarian 2024-09-11 05:16:58 +02:00
• 350a2dc1dc Fixed username in save message. DebaucheryLibrarian 2024-09-11 05:16:58 +02:00
• 7f79a44830 1.24.0 DebaucheryLibrarian 2024-09-11 05:16:58 +02:00
• de50d609f3 Added support for RedGifs and Reddit albums. Improved command line logger. Added rate limiters for reddit and host URLs. DebaucheryLibrarian 2024-09-11 05:16:58 +02:00
• bb06fe9763 Cleanup DebaucheryLibrarian 2024-09-11 05:16:58 +02:00
• 58a35fe998 1.23.0 DebaucheryLibrarian 2024-09-11 05:16:58 +02:00
• 6e3bfdd175 Added support for various tube and social media sites via youtube-dl. DebaucheryLibrarian 2024-09-11 05:16:58 +02:00
• 17c7acd6a2 1.22.0 DebaucheryLibrarian 2024-09-11 05:16:58 +02:00
• 45123bc630 Added hash comparison to duplicate avoidance. DebaucheryLibrarian 2024-09-11 05:16:58 +02:00
• 7c6c99c9d1 1.21.0 DebaucheryLibrarian 2024-09-11 05:16:58 +02:00
• 7de0c51c16 Fetching and storing comments for self posts. DebaucheryLibrarian 2024-09-11 05:16:58 +02:00
• 926ab1d25c 1.20.2 DebaucheryLibrarian 2024-09-11 05:16:58 +02:00
• 9140b58c70 Removed post.user variable. DebaucheryLibrarian 2024-09-11 05:16:58 +02:00
• e1a57a07a3 1.20.1 DebaucheryLibrarian 2024-09-11 05:16:58 +02:00
• f47b6cbeb8 Fixed typos in README. DebaucheryLibrarian 2024-09-11 05:16:58 +02:00
• bcd5759d0f 1.20.0 DebaucheryLibrarian 2024-09-11 05:16:57 +02:00
• 8d72683ebc Renamed from reddit-post-dump to ripunzel. DebaucheryLibrarian 2024-09-11 05:16:57 +02:00
• 66189694fa 1.19.3 DebaucheryLibrarian 2024-09-11 05:16:57 +02:00
• e00f895b05 Removed obsolete 'boolean' mention from README. DebaucheryLibrarian 2024-09-11 05:16:57 +02:00
• 54dd191d6c 1.19.2 DebaucheryLibrarian 2024-09-11 05:16:57 +02:00
• c2c5dc8d8a Fixed header in README. DebaucheryLibrarian 2024-09-11 05:16:57 +02:00
• 0c50bcab32 1.19.1 DebaucheryLibrarian 2024-09-11 05:16:57 +02:00
• 4e827fb9a8 Improved README formatting. DebaucheryLibrarian 2024-09-11 05:16:57 +02:00
• 50f1621a26 1.19.0 DebaucheryLibrarian 2024-09-11 05:16:57 +02:00
• 5c7dca19e5 Added dynamic dividers to patterns. Fixed PornHub module. Updated README. DebaucheryLibrarian 2024-09-11 05:16:57 +02:00
• c4d434ecdf 1.18.0 DebaucheryLibrarian 2024-09-11 05:16:57 +02:00
• 443f0fc028 Completed Erome module. Added content URL list fetching. DebaucheryLibrarian 2024-09-11 05:16:57 +02:00
• aecf79fa25 1.17.0 DebaucheryLibrarian 2024-09-11 05:16:57 +02:00
• b9a7e4b83a Added support for fetching content directly from host. Improved pattern interpolation. Refactored content modules. DebaucheryLibrarian 2024-09-11 05:16:57 +02:00
• 20cb522689 1.16.3 DebaucheryLibrarian 2024-09-11 05:16:57 +02:00
• 8b85ec219d Removed debug log. Updated README to mention imgur API key requirement. DebaucheryLibrarian 2024-09-11 05:16:57 +02:00
• da90b832a1 1.16.2 DebaucheryLibrarian 2024-09-11 05:16:57 +02:00
• 416a3254fb Removed HTML scraper from imgur module, no longer support due to login restriction. Preserving 'preview' property in index file. DebaucheryLibrarian 2024-09-11 05:16:57 +02:00
• d5d56b83bd 1.16.1 DebaucheryLibrarian 2024-09-11 05:16:57 +02:00
• c21ca0df0c Fixed gfycat fetching. DebaucheryLibrarian 2024-09-11 05:16:57 +02:00
• d7916af3d5 1.16.0 DebaucheryLibrarian 2024-09-11 05:16:57 +02:00
• 60973a0e70 Added post score to index and variables. DebaucheryLibrarian 2024-09-11 05:16:57 +02:00
• 12268fcb05 1.15.0 DebaucheryLibrarian 2024-09-11 05:16:57 +02:00
• 8d75cc170d Added basic PornHub support. DebaucheryLibrarian 2024-09-11 05:16:57 +02:00
• f47b99501a 1.14.9 DebaucheryLibrarian 2024-09-11 05:16:57 +02:00
• 9b0ef4da91 Added after/before-index alias for after/before-indexed DebaucheryLibrarian 2024-09-11 05:16:57 +02:00
• bdd79031ef 1.14.8 DebaucheryLibrarian 2024-09-11 05:16:57 +02:00
• a817a07250 Always returning null for profile details when no profile was found, not undefined. Prevents YAML index write from failing. DebaucheryLibrarian 2024-09-11 05:16:57 +02:00
• 7711979199 1.14.7 DebaucheryLibrarian 2024-09-11 05:16:57 +02:00
• 246ed1576f Defaulting to jpeg if reddit image extension is not present. DebaucheryLibrarian 2024-09-11 05:16:57 +02:00
• 34f7766496 1.14.6 DebaucheryLibrarian 2024-09-11 05:16:57 +02:00
• db9f6ed60c Added optional URL query to all external hosts in link dissection. DebaucheryLibrarian 2024-09-11 05:16:57 +02:00
• 82b7f38336 Removed duplicate post link from imgur logs DebaucheryLibrarian 2024-09-11 05:16:57 +02:00
• b388142d8b 1.14.5 DebaucheryLibrarian 2024-09-11 05:16:57 +02:00
• e48c00b529 Added option to index (specified) ignored posts. Saving index through save module, and it now notifies the user that an index has been written. DebaucheryLibrarian 2024-09-11 05:16:57 +02:00
• c1b164a5f9 1.14.4 DebaucheryLibrarian 2024-09-11 05:16:57 +02:00
• c30006f361 Added byte truncate script to repo. Fixed yargs not enforcing choices. DebaucheryLibrarian 2024-09-11 05:16:57 +02:00
• e44f617d9e 1.14.3 DebaucheryLibrarian 2024-09-11 05:16:57 +02:00
• 12e17c7c3c Calculating filename component limit in bytes rather than characters, preventing 'filename too long' errors when e.g. emojis are used DebaucheryLibrarian 2024-09-11 05:16:57 +02:00
• e5d439cbaf 1.14.2 DebaucheryLibrarian 2024-09-11 05:16:57 +02:00
• fab6d0aa1c Reintroduced imgur API as a fallback method. DebaucheryLibrarian 2024-09-11 05:16:57 +02:00
• 0377053d5a Allowing for -mobile gfycat links, simplified URL patterns DebaucheryLibrarian 2024-09-11 05:16:56 +02:00
• 91550406fe Accounting for actualid_d.jpg imgur pattern. Added debug argument to print full stack trace on error. DebaucheryLibrarian 2024-09-11 05:16:56 +02:00
• e950a9ac54 No longer relying on imgur API for albums. Removed config for imgur API. Fixed ?#0 URLs not being detected for imgur. DebaucheryLibrarian 2024-09-11 05:16:56 +02:00
• dbc4c45601 No longer using imgur API for individual images. Only saving EXIF data to JPEGs. Always using global exiftool instance. DebaucheryLibrarian 2024-09-11 05:16:56 +02:00
• b05ae06b00 Improved missing gfycat handling. Added 'preview' marker to index. DebaucheryLibrarian 2024-09-11 05:16:56 +02:00
• e48892126f 1.14.1 DebaucheryLibrarian 2024-09-11 05:16:56 +02:00
• a68493d0fa Don't attempt to save index when there are no posts or profile details (complained about directory not existing) DebaucheryLibrarian 2024-09-11 05:16:56 +02:00
• 44cdd37e49 1.14.0 DebaucheryLibrarian 2024-09-11 05:16:56 +02:00
• 18acb3a878 Added fetch concurrency. DebaucheryLibrarian 2024-09-11 05:16:56 +02:00
• e71b54e828 1.13.1 DebaucheryLibrarian 2024-09-11 05:16:56 +02:00
• 91577a00b1 Added support for file with host IDs to ignore. DebaucheryLibrarian 2024-09-11 05:16:56 +02:00
• b5da928c98 1.13.0 DebaucheryLibrarian 2024-09-11 05:16:56 +02:00
• 352b2a66d7 Allow usernames and post IDs to be read from file. DebaucheryLibrarian 2024-09-11 05:16:56 +02:00
• 00de0d43f5 Switched from setTimeout to crontab for watch-mode. DebaucheryLibrarian 2024-09-11 05:16:56 +02:00
• f989bc9f18 1.12.1 DebaucheryLibrarian 2024-09-11 05:16:56 +02:00
• c4afd398dc Added timestamp to watch mode status log. DebaucheryLibrarian 2024-09-11 05:16:56 +02:00
• c83421ca41 1.12.0 DebaucheryLibrarian 2024-09-11 05:16:56 +02:00