DebaucheryLibrarian
|
60c151ff6a
|
Reduced deep scrape concurrency to 1.
|
2021-12-01 23:39:09 +01:00 |
|
DebaucheryLibrarian
|
c97d18fcf9
|
1.203.1
|
2021-12-01 23:30:12 +01:00 |
|
DebaucheryLibrarian
|
e41f9fa937
|
Added waitImmediate to deep scrape, reduced concurrency.
|
2021-12-01 23:30:10 +01:00 |
|
DebaucheryLibrarian
|
56a7fb0ad9
|
1.203.0
|
2021-12-01 17:26:34 +01:00 |
|
DebaucheryLibrarian
|
e29cbc9fea
|
Closing JSDOM window after deep scrape in an attempt to save memory. Reduced deep scrape concurrency to 5.
|
2021-12-01 17:26:13 +01:00 |
|
DebaucheryLibrarian
|
08f725a0b6
|
1.202.3
|
2021-12-01 00:00:26 +01:00 |
|
DebaucheryLibrarian
|
b93a5715cb
|
Updated Jules Jordan scraper for new update page layout.
|
2021-12-01 00:00:24 +01:00 |
|
DebaucheryLibrarian
|
2018d5c298
|
1.202.2
|
2021-11-29 02:49:12 +01:00 |
|
DebaucheryLibrarian
|
87094a9498
|
Replaced cheerio with qu in Gamma scraper.
|
2021-11-29 02:49:07 +01:00 |
|
DebaucheryLibrarian
|
53a1c697d0
|
1.202.1
|
2021-11-28 01:20:41 +01:00 |
|
DebaucheryLibrarian
|
f04eb72891
|
Added upcoming scraper to PurgatoryX.
|
2021-11-28 01:20:39 +01:00 |
|
DebaucheryLibrarian
|
dfeb0c08cf
|
1.202.0
|
2021-11-27 23:55:22 +01:00 |
|
DebaucheryLibrarian
|
9d7183ac69
|
Added PurgatoryX scraper.
|
2021-11-27 23:55:16 +01:00 |
|
DebaucheryLibrarian
|
2539e88f47
|
1.201.6
|
2021-11-22 02:51:55 +01:00 |
|
DebaucheryLibrarian
|
20d0d860d3
|
Fixed MindGeek scraper trying to acquire session from mindgeek.com
|
2021-11-22 02:51:52 +01:00 |
|
DebaucheryLibrarian
|
6b4aa64d74
|
Improved MindGeek scraper session check to prevent crash when network session isn't available yet.
|
2021-11-22 02:44:03 +01:00 |
|
DebaucheryLibrarian
|
c7b9ec7a4b
|
1.201.5
|
2021-11-21 00:47:34 +01:00 |
|
DebaucheryLibrarian
|
e81864ebde
|
Removed verbose http queued output.
|
2021-11-21 00:47:32 +01:00 |
|
DebaucheryLibrarian
|
0305a22a24
|
Removed stray console log from media module.
|
2021-11-21 00:43:35 +01:00 |
|
DebaucheryLibrarian
|
a406eb584d
|
1.201.4
|
2021-11-21 00:41:15 +01:00 |
|
DebaucheryLibrarian
|
2be3ea9bbb
|
Explicitly adding headers to http module result.
|
2021-11-21 00:41:12 +01:00 |
|
DebaucheryLibrarian
|
0a8a7ff9a5
|
1.201.3
|
2021-11-21 00:31:12 +01:00 |
|
DebaucheryLibrarian
|
98c103c625
|
Fixed uuid import. Changed fs rmdir to rm.
|
2021-11-21 00:31:09 +01:00 |
|
DebaucheryLibrarian
|
e0908a5f5e
|
1.201.2
|
2021-11-21 00:19:13 +01:00 |
|
DebaucheryLibrarian
|
f0b7678444
|
Fixed upsert failing on empty insert array due breaking Knex API change.
|
2021-11-21 00:19:10 +01:00 |
|
DebaucheryLibrarian
|
64e9efe095
|
1.201.1
|
2021-11-21 00:15:21 +01:00 |
|
DebaucheryLibrarian
|
ab29ab053e
|
Increased tile heart button size. Hiding entity tile info under hover effect.
|
2021-11-21 00:15:19 +01:00 |
|
DebaucheryLibrarian
|
a5081bc7c9
|
Updated primary color.
|
2021-11-21 00:04:21 +01:00 |
|
DebaucheryLibrarian
|
da9c628f9b
|
1.201.0
|
2021-11-21 00:00:14 +01:00 |
|
DebaucheryLibrarian
|
26539b74a5
|
Updated dependencies. Added periodic memory logger.
|
2021-11-20 23:59:48 +01:00 |
|
DebaucheryLibrarian
|
ccb99e278c
|
Added periodic memory logger.
|
2021-11-20 23:59:15 +01:00 |
|
DebaucheryLibrarian
|
a867817dc1
|
Improved scene tile scaling.
|
2021-10-31 01:00:12 +02:00 |
|
DebaucheryLibrarian
|
d1e05915b5
|
Tweaked scene and actor tile design, tags grid breakpoints.
|
2021-10-31 00:31:18 +02:00 |
|
DebaucheryLibrarian
|
b764fdec85
|
Showing scene and channel count on entity page and tile.
|
2021-10-30 22:41:58 +02:00 |
|
DebaucheryLibrarian
|
8322d43b09
|
1.200.2
|
2021-10-28 02:10:37 +02:00 |
|
DebaucheryLibrarian
|
29b8c5e38e
|
Including unextracted scenes in date determination.
|
2021-10-28 02:10:30 +02:00 |
|
DebaucheryLibrarian
|
83dd233991
|
1.200.1
|
2021-10-28 02:00:04 +02:00 |
|
DebaucheryLibrarian
|
0864154a0e
|
Added unextracted property to keep paginating when extracting scenes.
|
2021-10-28 01:59:53 +02:00 |
|
DebaucheryLibrarian
|
53357d4bd2
|
1.200.0
|
2021-10-27 17:19:33 +02:00 |
|
DebaucheryLibrarian
|
69bf98edf1
|
1.199.17
|
2021-10-27 17:19:30 +02:00 |
|
DebaucheryLibrarian
|
a22c4d5679
|
Added beforeNetwork hook, used by MindGeek. Added Filthy Kings to Gamma.
|
2021-10-27 17:19:23 +02:00 |
|
DebaucheryLibrarian
|
e5ad1648eb
|
1.199.16
|
2021-10-26 23:42:42 +02:00 |
|
DebaucheryLibrarian
|
100a35b4e8
|
Added before scene fetch method to prevent e.g. unnecessary session requests, moved scraper assignment to entity lookup. Removed channel URL hostname matching..
|
2021-10-26 23:42:32 +02:00 |
|
DebaucheryLibrarian
|
6c5d4389fe
|
Not parsing HTML with jsdom when using http module directly to save memory. Added loading ellipsis to release grid pages.
|
2021-10-25 02:06:24 +02:00 |
|
DebaucheryLibrarian
|
92f9ff4104
|
1.199.15
|
2021-10-20 01:47:04 +02:00 |
|
DebaucheryLibrarian
|
0e4fd12d70
|
Added more loggers to http module.
|
2021-10-20 01:46:56 +02:00 |
|
DebaucheryLibrarian
|
9040285ce5
|
1.199.14
|
2021-10-17 23:57:10 +02:00 |
|
DebaucheryLibrarian
|
972b15e72d
|
Added memory profiling.
|
2021-10-17 23:56:49 +02:00 |
|
DebaucheryLibrarian
|
c1aea78496
|
1.199.13
|
2021-10-17 19:59:11 +02:00 |
|
DebaucheryLibrarian
|
49f891ba44
|
Ignoring 1-second scene duration from MindGeek API.
|
2021-10-17 19:59:05 +02:00 |