DebaucheryLibrarian/ripunzel
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity
146 Commits 2 Branches 0 Tags
029351f2280bdec3db230de448be929de7674b65
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
DebaucheryLibrarian 029351f228 Using YAML rather than TSV for index files. Improves both readability and reindexability. 2024-09-11 05:16:56 +02:00
DebaucheryLibrarian f41b788183 Extracting indexed posts from fetched posts to allow for index rewrite flexibility. 2024-09-11 05:16:56 +02:00
DebaucheryLibrarian c49e1edca0 Reading index file and ignoring already indexed content. 2024-09-11 05:16:56 +02:00
DebaucheryLibrarian 952392e0d9 Building user posts object after fetching user to ensure user fetched posts and directly fetched posts are added to the same user key. Refactor to make better use of functions. Moved profile detail saving call to content fetch. No longer attempting and failing to save profile details for deleted users (directory would not exist). 2024-09-11 05:16:56 +02:00
DebaucheryLibrarian 5eb2eb651a Saving index per user as TSV. Refactoring. 2024-09-11 05:16:56 +02:00
DebaucheryLibrarian 6696438da0 Refactored info content fetching and saving to handle users object and utilize async/await. 2024-09-11 05:16:56 +02:00
DebaucheryLibrarian bba0f8f1d7 Fetching and curating posts per user without merge. 2024-09-11 05:16:56 +02:00
DebaucheryLibrarian 3c64ffcd45 1.11.2 2024-09-11 05:16:56 +02:00
DebaucheryLibrarian 20a9c01444 Remove double slashes from URLs before matching. 2024-09-11 05:16:55 +02:00
DebaucheryLibrarian a56a5c9a10 1.11.1 2024-09-11 05:16:55 +02:00
DebaucheryLibrarian c39f2eda8c Improved handling of unavailable/deleted vidble videos 2024-09-11 05:16:55 +02:00
DebaucheryLibrarian a8ba7dc9f8 1.11.0 2024-09-11 05:16:55 +02:00
DebaucheryLibrarian 4e0fe3e6bc Added vidble direct video (/watch?v=) support. 2024-09-11 05:16:55 +02:00
DebaucheryLibrarian 761f722147 1.10.1 2024-09-11 05:16:55 +02:00
DebaucheryLibrarian 2ecc2d8098 Added -size-restricted URL pattern for gfycat. Fixed missing getUser argument. 2024-09-11 05:16:55 +02:00
DebaucheryLibrarian b71d0f7daa 1.10.0 2024-09-11 05:16:55 +02:00
DebaucheryLibrarian 84836bc8c0 Refactored post retrieval so limit is applied per-user and ignores directly requested posts, and to start utilizing async/await. 2024-09-11 05:16:55 +02:00
DebaucheryLibrarian 2627ec6207 1.9.4 2024-09-11 05:16:55 +02:00
DebaucheryLibrarian e6e989811c Mentioning API registration requirement in README. 2024-09-11 05:16:55 +02:00
DebaucheryLibrarian a596234657 1.9.3 2024-09-11 05:16:55 +02:00
DebaucheryLibrarian be7bc1b10d Added filepath component length limit with truncator. Fixed double extension dot when copying original extension. Moved API keys to local config. 2024-09-11 05:16:55 +02:00
DebaucheryLibrarian 80564cff19 1.9.2 2024-09-11 05:16:55 +02:00
DebaucheryLibrarian c2cf26dde6 Refactored post fetching. Cleaner code that will now fetch archived posts even if the user no longer exists on reddit. Expanded gfycat URL detection. 2024-09-11 05:16:55 +02:00
DebaucheryLibrarian e0ca4a0822 Added new eroshare method source files. 2024-09-11 05:16:55 +02:00
DebaucheryLibrarian e1b3b1ce5f 1.9.1 2024-09-11 05:16:55 +02:00
DebaucheryLibrarian 583b567b20 Added support for /i/ eroshare items. 2024-09-11 05:16:55 +02:00
DebaucheryLibrarian c99bb66b24 1.9.0 2024-09-11 05:16:55 +02:00
DebaucheryLibrarian d113015eb2 Removed jpeg to jpg replace. 2024-09-11 05:16:55 +02:00
DebaucheryLibrarian 5165e8612d Added vidble image support. 2024-09-11 05:16:55 +02:00
DebaucheryLibrarian 2c58947548 Fixed jpeg jpg substitution. 2024-09-11 05:16:55 +02:00
DebaucheryLibrarian b2f9d9f51e 1.8.2 2024-09-11 05:16:55 +02:00
DebaucheryLibrarian 89ab431a2f Added support for Vidble (image) albums. Replaced extensions.json and reverseLookup with mime-types lib. 2024-09-11 05:16:55 +02:00
DebaucheryLibrarian af068df639 1.8.1 2024-09-11 05:16:55 +02:00
DebaucheryLibrarian 5264020084 Fixed missing return causing no saves. 2024-09-11 05:16:55 +02:00
DebaucheryLibrarian f00821dbc9 1.8.0 2024-09-11 05:16:55 +02:00
DebaucheryLibrarian e01979a757 Added include and exclude source arguments. Improved stream fetch failure handling and improved logging details. 2024-09-11 05:16:55 +02:00
DebaucheryLibrarian 0a2fac5f1f 1.7.4 2024-09-11 05:16:55 +02:00
DebaucheryLibrarian 60eeca09d8 Added support for m.imgur.com links. Changed curate ignore log message details. 2024-09-11 05:16:55 +02:00
DebaucheryLibrarian 7cf0836cd4 1.7.3 2024-09-11 05:16:55 +02:00
DebaucheryLibrarian e3aac41bdf Moved archive feature from ideas to features in README. 2024-09-11 05:16:55 +02:00
DebaucheryLibrarian e65bfaef59 1.7.2 2024-09-11 05:16:55 +02:00
DebaucheryLibrarian 3aed403700 Removed obsolete information from README. 2024-09-11 05:16:55 +02:00
DebaucheryLibrarian 5958869793 1.7.1 2024-09-11 05:16:55 +02:00
DebaucheryLibrarian 7bab50adb0 Fixed lost variable item in README. 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian d9b5eb3b5d 1.7.0 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 2ec097c053 Cleaned up entrypoint. 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 7f00e5b6b2 Added support for reddit preview fallback. 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 1ae51b18f8 Added preview property. Removed debugging intercepts. Logging post permalink on failed info fetch. 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian f0e312f2b1 Added archive support, and the IP archive. 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 8c4353f8ed 1.6.4 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 2d050be1a5 Added support for redd.it PNG. 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 304566e5bd 1.6.3 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian f1db5728af Allow posts from [deleted] users to be fetched. 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 5d1930c9dc 1.6.2 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 854d55618a Fixed profile description not saving when user has avatar. 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 9f1248301b 1.6.1 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 6131d0a76c Added npm script for running application. 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 7fd77d5232 1.6.0 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian de64cc6d13 Added support for fetching individual posts. Improved use of yargs, --help now available. Refactored main app flow. 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 1581e780b8 Checking result status rather than ok for imgur methods. 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian a882f564f5 1.5.2 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 4af6aa85d3 Fixed obsolete eroshare extract single album item property. Throwing error when imgur album and image info fetch fails. Main catch method console log colored red. 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 1ae3f7b71f 1.5.1 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian c250a02edf Fixed avatar property. 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 1d1b2ab284 1.5.0 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 767ae082fa Added ignore argument. 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian cb1d2d6eca 1.4.0 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 8a57a9a8f9 Added reddit avatar URL detection and avoid option. 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 23bdad8776 1.3.6 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 4ac2dab56f Fixed double dir path component extraction in save module (causing profile info save to fail). 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 766e4b5554 Rephrased reddit videos in README. 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 88a40cc5c7 Elaborated reddit videos in README. 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian d0b5231c98 Removed asterisk from reddit videos README section and decreased header size. 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian b58f6ba218 1.3.5 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian e650d31db1 Explained reddit video muxing in README. 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 994e3e37d1 1.3.4 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 4c394ba434 Fixed README variable formatting typo. 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 7fa8479558 1.3.3 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 7fc94c5b87 Added subreddit plan to README. 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 50fcd3fb1f 1.3.2 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 58eaec5f58 Fixed text posts not passing streams correctly since previous change. 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 737031f2ed 1.3.1 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 427e446281 Updated README with introduction, features and new variables. 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 4b75de94bf 1.3.0 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 370214e1a2 Adapted primary save function to handle single streams and non-item saves (e.g. profiles). 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 536c427140 Added support for muxing streams, specifically for reddit-hosted videos (now also supported). 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 1546852f89 1.2.0 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 84cb64e84c Using metadata configuration rather than item description for EXIF save. Fixed dissect duplicate detection failing for empty host. 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 5c9f57f66c 1.1.1 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 5a3d2dd030 Ignoring empty interpolated metadata. Added URL query wildcard to imgur and reddit images. Using host ID rather than URL to improve duplicate detection. 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian ad78bac5de 1.1.0 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian e3899362d7 Tracking meta source file for EXIF data. 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 07d157604d Saving EXIF data for jpegs. 2024-09-11 05:16:53 +02:00
DebaucheryLibrarian 7e6828bd63 Added support for reddituploads.com. Changed default sorting to 'new'. 2024-09-11 05:16:53 +02:00
DebaucheryLibrarian 68435762d0 1.0.2 2024-09-11 05:16:53 +02:00
DebaucheryLibrarian 901029d9a1 Changed ignoreDuplicates to avoidDuplicates. 2024-09-11 05:16:53 +02:00
DebaucheryLibrarian 94e1575c30 Dealing with users without profile. 2024-09-11 05:16:53 +02:00
DebaucheryLibrarian c3355200dd 1.0.1 2024-09-11 05:16:53 +02:00
DebaucheryLibrarian cc5d665d34 Added subreddit variable. 2024-09-11 05:16:53 +02:00
DebaucheryLibrarian 5f393d8868 1.0.0 2024-09-11 05:16:53 +02:00