Commit Graph

95 Commits

Author SHA1 Message Date
DebaucheryLibrarian 6696438da0 Refactored info content fetching and saving to handle users object and utilize async/await. 2024-09-11 05:16:56 +02:00
DebaucheryLibrarian bba0f8f1d7 Fetching and curating posts per user without merge. 2024-09-11 05:16:56 +02:00
DebaucheryLibrarian 20a9c01444 Remove double slashes from URLs before matching. 2024-09-11 05:16:55 +02:00
DebaucheryLibrarian c39f2eda8c Improved handling of unavailable/deleted vidble videos 2024-09-11 05:16:55 +02:00
DebaucheryLibrarian 4e0fe3e6bc Added vidble direct video (/watch?v=) support. 2024-09-11 05:16:55 +02:00
DebaucheryLibrarian 2ecc2d8098 Added -size-restricted URL pattern for gfycat. Fixed missing getUser argument. 2024-09-11 05:16:55 +02:00
DebaucheryLibrarian 84836bc8c0 Refactored post retrieval so limit is applied per-user and ignores directly requested posts, and to start utilizing async/await. 2024-09-11 05:16:55 +02:00
DebaucheryLibrarian be7bc1b10d Added filepath component length limit with truncator. Fixed double extension dot when copying original extension. Moved API keys to local config. 2024-09-11 05:16:55 +02:00
DebaucheryLibrarian c2cf26dde6 Refactored post fetching. Cleaner code that will now fetch archived posts even if the user no longer exists on reddit. Expanded gfycat URL detection. 2024-09-11 05:16:55 +02:00
DebaucheryLibrarian e0ca4a0822 Added new eroshare method source files. 2024-09-11 05:16:55 +02:00
DebaucheryLibrarian 583b567b20 Added support for /i/ eroshare items. 2024-09-11 05:16:55 +02:00
DebaucheryLibrarian d113015eb2 Removed jpeg to jpg replace. 2024-09-11 05:16:55 +02:00
DebaucheryLibrarian 5165e8612d Added vidble image support. 2024-09-11 05:16:55 +02:00
DebaucheryLibrarian 2c58947548 Fixed jpeg jpg substitution. 2024-09-11 05:16:55 +02:00
DebaucheryLibrarian 89ab431a2f Added support for Vidble (image) albums. Replaced extensions.json and reverseLookup with mime-types lib. 2024-09-11 05:16:55 +02:00
DebaucheryLibrarian 5264020084 Fixed missing return causing no saves. 2024-09-11 05:16:55 +02:00
DebaucheryLibrarian e01979a757 Added include and exclude source arguments. Improved stream fetch failure handling and improved logging details. 2024-09-11 05:16:55 +02:00
DebaucheryLibrarian 60eeca09d8 Added support for m.imgur.com links. Changed curate ignore log message details. 2024-09-11 05:16:55 +02:00
DebaucheryLibrarian 2ec097c053 Cleaned up entrypoint. 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 7f00e5b6b2 Added support for reddit preview fallback. 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 1ae51b18f8 Added preview property. Removed debugging intercepts. Logging post permalink on failed info fetch. 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian f0e312f2b1 Added archive support, and the IP archive. 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 2d050be1a5 Added support for redd.it PNG. 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian f1db5728af Allow posts from [deleted] users to be fetched. 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 854d55618a Fixed profile description not saving when user has avatar. 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 6131d0a76c Added npm script for running application. 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian de64cc6d13 Added support for fetching individual posts. Improved use of yargs, --help now available. Refactored main app flow. 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 1581e780b8 Checking result status rather than ok for imgur methods. 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 4af6aa85d3 Fixed obsolete eroshare extract single album item property. Throwing error when imgur album and image info fetch fails. Main catch method console log colored red. 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian c250a02edf Fixed avatar property. 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 767ae082fa Added ignore argument. 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 8a57a9a8f9 Added reddit avatar URL detection and avoid option. 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 4ac2dab56f Fixed double dir path component extraction in save module (causing profile info save to fail). 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 58eaec5f58 Fixed text posts not passing streams correctly since previous change. 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 370214e1a2 Adapted primary save function to handle single streams and non-item saves (e.g. profiles). 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 536c427140 Added support for muxing streams, specifically for reddit-hosted videos (now also supported). 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 84cb64e84c Using metadata configuration rather than item description for EXIF save. Fixed dissect duplicate detection failing for empty host. 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 5a3d2dd030 Ignoring empty interpolated metadata. Added URL query wildcard to imgur and reddit images. Using host ID rather than URL to improve duplicate detection. 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian e3899362d7 Tracking meta source file for EXIF data. 2024-09-11 05:16:54 +02:00
DebaucheryLibrarian 07d157604d Saving EXIF data for jpegs. 2024-09-11 05:16:53 +02:00
DebaucheryLibrarian 7e6828bd63 Added support for reddituploads.com. Changed default sorting to 'new'. 2024-09-11 05:16:53 +02:00
DebaucheryLibrarian 901029d9a1 Changed ignoreDuplicates to avoidDuplicates. 2024-09-11 05:16:53 +02:00
DebaucheryLibrarian 94e1575c30 Dealing with users without profile. 2024-09-11 05:16:53 +02:00
DebaucheryLibrarian cc5d665d34 Added subreddit variable. 2024-09-11 05:16:53 +02:00
DebaucheryLibrarian 2b9801999b Moved source into dedicated directory. 2024-09-11 05:16:53 +02:00