 DebaucheryLibrarian
|
e642203d6c
|
Fixed invalid URL breaking scrape, prefixing reddit URLs with origin.
|
2024-09-11 05:16:59 +02:00 |
|
DebaucheryLibrarian
|
b7dc3f5fd1
|
Storing pHash. Fixed RedGIFs user agent.
|
2024-09-11 05:16:58 +02:00 |
|
DebaucheryLibrarian
|
7d633c31b4
|
Using Imgur API rate limit feedback to prevent exceeding it.
|
2024-09-11 05:16:58 +02:00 |
|
DebaucheryLibrarian
|
bed4fe288f
|
Added predata step. Using RedGifs temporary API key.
|
2024-09-11 05:16:58 +02:00 |
|
DebaucheryLibrarian
|
de50d609f3
|
Added support for RedGifs and Reddit albums. Improved command line logger. Added rate limiters for reddit and host URLs.
|
2024-09-11 05:16:58 +02:00 |
|
DebaucheryLibrarian
|
6e3bfdd175
|
Added support for various tube and social media sites via youtube-dl.
|
2024-09-11 05:16:58 +02:00 |
|
DebaucheryLibrarian
|
7de0c51c16
|
Fetching and storing comments for self posts.
|
2024-09-11 05:16:58 +02:00 |
|
DebaucheryLibrarian
|
b9a7e4b83a
|
Added support for fetching content directly from host. Improved pattern interpolation. Refactored content modules.
|
2024-09-11 05:16:57 +02:00 |
|
DebaucheryLibrarian
|
8b85ec219d
|
Removed debug log. Updated README to mention imgur API key requirement.
|
2024-09-11 05:16:57 +02:00 |
|
DebaucheryLibrarian
|
416a3254fb
|
Removed HTML scraper from imgur module, no longer support due to login restriction. Preserving 'preview' property in index file.
|
2024-09-11 05:16:57 +02:00 |
|
DebaucheryLibrarian
|
9b0ef4da91
|
Added after/before-index alias for after/before-indexed
|
2024-09-11 05:16:57 +02:00 |
|
DebaucheryLibrarian
|
b05ae06b00
|
Improved missing gfycat handling. Added 'preview' marker to index.
|
2024-09-11 05:16:56 +02:00 |
|
DebaucheryLibrarian
|
6696438da0
|
Refactored info content fetching and saving to handle users object and utilize async/await.
|
2024-09-11 05:16:56 +02:00 |
|
DebaucheryLibrarian
|
bba0f8f1d7
|
Fetching and curating posts per user without merge.
|
2024-09-11 05:16:56 +02:00 |
|
DebaucheryLibrarian
|
7f00e5b6b2
|
Added support for reddit preview fallback.
|
2024-09-11 05:16:54 +02:00 |
|
DebaucheryLibrarian
|
1ae51b18f8
|
Added preview property. Removed debugging intercepts. Logging post permalink on failed info fetch.
|
2024-09-11 05:16:54 +02:00 |
|
DebaucheryLibrarian
|
f0e312f2b1
|
Added archive support, and the IP archive.
|
2024-09-11 05:16:54 +02:00 |
|
DebaucheryLibrarian
|
de64cc6d13
|
Added support for fetching individual posts. Improved use of yargs, --help now available. Refactored main app flow.
|
2024-09-11 05:16:54 +02:00 |
|
DebaucheryLibrarian
|
2b9801999b
|
Moved source into dedicated directory.
|
2024-09-11 05:16:53 +02:00 |