DebaucheryLibrarian/traxxx
2
1
Fork 1
Code Issues 40 Pull Requests 1 Releases Wiki Activity

Commit Graph

  • 0ad64ef5f4 1.204.1 DebaucheryLibrarian 2021-12-20 03:29:16 +01:00
  • 3bfe1e8fdb Storing scenes before fetching movies. DebaucheryLibrarian 2021-12-20 03:29:14 +01:00
  • 7d992f4129 Added triggers to memory dump. DebaucheryLibrarian 2021-12-20 02:28:59 +01:00
  • 280032937f Added centralized movie page fetcher. Added memory heap dump. DebaucheryLibrarian 2021-12-20 02:22:10 +01:00
  • d93670842b 1.204.0 DebaucheryLibrarian 2021-12-19 23:03:48 +01:00
  • dc187a9a3a Added execute method to qu, removed runScripts from Gamma's fetchMovie to observe effect on memory usage. DebaucheryLibrarian 2021-12-19 23:03:44 +01:00
  • 5f89c6e14c 1.203.13 DebaucheryLibrarian 2021-12-19 00:08:22 +01:00
  • 9f10420eb9 Fixed tag search GraphQL query. DebaucheryLibrarian 2021-12-19 00:08:21 +01:00
  • 9568370132 1.203.12 DebaucheryLibrarian 2021-12-18 23:44:54 +01:00
  • 1c0c30be11 Improved and re-enabled why-is-node-running logger. DebaucheryLibrarian 2021-12-18 23:44:51 +01:00
  • cdb7dcd6e9 1.203.11 DebaucheryLibrarian 2021-12-18 23:22:38 +01:00
  • 8e4be06675 Closing JSDOM window after deep scrapes in an attempt to save memory. DebaucheryLibrarian 2021-12-18 23:22:35 +01:00
  • de7a8c756a 1.203.10 DebaucheryLibrarian 2021-12-13 01:20:04 +01:00
  • 65e2b72c6a Fixed Gamma movie scraper failing when data object is not available. DebaucheryLibrarian 2021-12-13 01:20:02 +01:00
  • 523c36ecd4 1.203.9 DebaucheryLibrarian 2021-12-11 22:46:58 +01:00
  • 5b5688438c Fixed Gamma movie scene query. Added tag photos. DebaucheryLibrarian 2021-12-11 22:46:55 +01:00
  • 4ca07631c7 1.203.8 DebaucheryLibrarian 2021-12-05 23:59:20 +01:00
  • ec4e7bc12a Updated Jules Jordan scraper for Sperm Swallowers and The Ass Factory. DebaucheryLibrarian 2021-12-05 23:59:17 +01:00
  • 26d15c0a6f Updated Jules Jordan scraper for Manuel Ferrara and Girl Girl. DebaucheryLibrarian 2021-12-05 23:43:23 +01:00
  • a484396db4 Hiding scenes with missing dates from network overview. Using computed effective date column. DebaucheryLibrarian 2021-12-05 23:29:27 +01:00
  • 681db02784 1.203.7 DebaucheryLibrarian 2021-12-05 02:54:57 +01:00
  • e88554666c Reduced media concurrency to assess effect on memory. Moved qu context removal to deep scrape runner. Updated movie graphql queries. DebaucheryLibrarian 2021-12-05 02:54:55 +01:00
  • 9f37ec4cff 1.203.6 DebaucheryLibrarian 2021-12-04 00:32:31 +01:00
  • abd063a578 Removed window map from http module to prevent memory pile-up with update scraping. DebaucheryLibrarian 2021-12-04 00:32:28 +01:00
  • 883e57ce1f 1.203.5 DebaucheryLibrarian 2021-12-02 15:51:33 +01:00
  • ad04502a8c Added Radical favicons. DebaucheryLibrarian 2021-12-02 15:51:30 +01:00
  • f65ed16842 1.203.4 DebaucheryLibrarian 2021-12-02 00:45:24 +01:00
  • 1918dd4ad5 Removing query methods from XEmpire release. DebaucheryLibrarian 2021-12-02 00:45:22 +01:00
  • 3983d3464f 1.203.3 DebaucheryLibrarian 2021-12-01 23:44:27 +01:00
  • 61daf5f037 Added debug log for jsdom window closing. DebaucheryLibrarian 2021-12-01 23:44:25 +01:00
  • eafa144104 1.203.2 DebaucheryLibrarian 2021-12-01 23:39:11 +01:00
  • 60c151ff6a Reduced deep scrape concurrency to 1. DebaucheryLibrarian 2021-12-01 23:39:09 +01:00
  • c97d18fcf9 1.203.1 DebaucheryLibrarian 2021-12-01 23:30:12 +01:00
  • e41f9fa937 Added waitImmediate to deep scrape, reduced concurrency. DebaucheryLibrarian 2021-12-01 23:30:10 +01:00
  • 56a7fb0ad9 1.203.0 DebaucheryLibrarian 2021-12-01 17:26:34 +01:00
  • e29cbc9fea Closing JSDOM window after deep scrape in an attempt to save memory. Reduced deep scrape concurrency to 5. DebaucheryLibrarian 2021-12-01 17:26:13 +01:00
  • 08f725a0b6 1.202.3 DebaucheryLibrarian 2021-12-01 00:00:26 +01:00
  • b93a5715cb Updated Jules Jordan scraper for new update page layout. DebaucheryLibrarian 2021-12-01 00:00:24 +01:00
  • 2018d5c298 1.202.2 DebaucheryLibrarian 2021-11-29 02:49:12 +01:00
  • 87094a9498 Replaced cheerio with qu in Gamma scraper. DebaucheryLibrarian 2021-11-29 02:49:07 +01:00
  • 53a1c697d0 1.202.1 DebaucheryLibrarian 2021-11-28 01:20:41 +01:00
  • f04eb72891 Added upcoming scraper to PurgatoryX. DebaucheryLibrarian 2021-11-28 01:20:39 +01:00
  • dfeb0c08cf 1.202.0 DebaucheryLibrarian 2021-11-27 23:55:22 +01:00
  • 9d7183ac69 Added PurgatoryX scraper. DebaucheryLibrarian 2021-11-27 23:55:16 +01:00
  • 2539e88f47 1.201.6 DebaucheryLibrarian 2021-11-22 02:51:55 +01:00
  • 20d0d860d3 Fixed MindGeek scraper trying to acquire session from mindgeek.com DebaucheryLibrarian 2021-11-22 02:51:52 +01:00
  • 6b4aa64d74 Improved MindGeek scraper session check to prevent crash when network session isn't available yet. DebaucheryLibrarian 2021-11-22 02:44:03 +01:00
  • c7b9ec7a4b 1.201.5 DebaucheryLibrarian 2021-11-21 00:47:34 +01:00
  • e81864ebde Removed verbose http queued output. DebaucheryLibrarian 2021-11-21 00:47:32 +01:00
  • 0305a22a24 Removed stray console log from media module. DebaucheryLibrarian 2021-11-21 00:43:35 +01:00
  • a406eb584d 1.201.4 DebaucheryLibrarian 2021-11-21 00:41:15 +01:00
  • 2be3ea9bbb Explicitly adding headers to http module result. DebaucheryLibrarian 2021-11-21 00:41:12 +01:00
  • 0a8a7ff9a5 1.201.3 DebaucheryLibrarian 2021-11-21 00:31:12 +01:00
  • 98c103c625 Fixed uuid import. Changed fs rmdir to rm. DebaucheryLibrarian 2021-11-21 00:31:09 +01:00
  • e0908a5f5e 1.201.2 DebaucheryLibrarian 2021-11-21 00:19:13 +01:00
  • f0b7678444 Fixed upsert failing on empty insert array due breaking Knex API change. DebaucheryLibrarian 2021-11-21 00:19:10 +01:00
  • 64e9efe095 1.201.1 DebaucheryLibrarian 2021-11-21 00:15:21 +01:00
  • ab29ab053e Increased tile heart button size. Hiding entity tile info under hover effect. DebaucheryLibrarian 2021-11-21 00:15:19 +01:00
  • a5081bc7c9 Updated primary color. DebaucheryLibrarian 2021-11-21 00:04:21 +01:00
  • da9c628f9b 1.201.0 DebaucheryLibrarian 2021-11-21 00:00:14 +01:00
  • 26539b74a5 Updated dependencies. Added periodic memory logger. DebaucheryLibrarian 2021-11-20 23:59:15 +01:00
  • ccb99e278c Added periodic memory logger. DebaucheryLibrarian 2021-11-20 23:59:15 +01:00
  • a867817dc1 Improved scene tile scaling. DebaucheryLibrarian 2021-10-31 01:00:12 +02:00
  • d1e05915b5 Tweaked scene and actor tile design, tags grid breakpoints. DebaucheryLibrarian 2021-10-31 00:31:18 +02:00
  • b764fdec85 Showing scene and channel count on entity page and tile. DebaucheryLibrarian 2021-10-30 22:41:58 +02:00
  • 8322d43b09 1.200.2 1770054493894197443/tmp_refs/heads/experimental 1770054493894197443/experimental 1740896707355129987/tmp_refs/heads/experimental 1740896707355129987/experimental DebaucheryLibrarian 2021-10-28 02:10:37 +02:00
  • 29b8c5e38e Including unextracted scenes in date determination. DebaucheryLibrarian 2021-10-28 02:10:30 +02:00
  • 83dd233991 1.200.1 DebaucheryLibrarian 2021-10-28 02:00:04 +02:00
  • 0864154a0e Added unextracted property to keep paginating when extracting scenes. DebaucheryLibrarian 2021-10-28 01:59:53 +02:00
  • 53357d4bd2 1.200.0 DebaucheryLibrarian 2021-10-27 17:19:33 +02:00
  • 69bf98edf1 1.199.17 DebaucheryLibrarian 2021-10-27 17:19:30 +02:00
  • a22c4d5679 Added beforeNetwork hook, used by MindGeek. Added Filthy Kings to Gamma. DebaucheryLibrarian 2021-10-27 17:19:23 +02:00
  • e5ad1648eb 1.199.16 DebaucheryLibrarian 2021-10-26 23:42:42 +02:00
  • 100a35b4e8 Added before scene fetch method to prevent e.g. unnecessary session requests, moved scraper assignment to entity lookup. Removed channel URL hostname matching.. DebaucheryLibrarian 2021-10-26 23:42:32 +02:00
  • 6c5d4389fe Not parsing HTML with jsdom when using http module directly to save memory. Added loading ellipsis to release grid pages. DebaucheryLibrarian 2021-10-25 02:06:24 +02:00
  • 92f9ff4104 1.199.15 DebaucheryLibrarian 2021-10-20 01:47:04 +02:00
  • 0e4fd12d70 Added more loggers to http module. DebaucheryLibrarian 2021-10-20 01:46:56 +02:00
  • 9040285ce5 1.199.14 DebaucheryLibrarian 2021-10-17 23:57:10 +02:00
  • 972b15e72d Added memory profiling. DebaucheryLibrarian 2021-10-17 23:56:49 +02:00
  • c1aea78496 1.199.13 DebaucheryLibrarian 2021-10-17 19:59:11 +02:00
  • 49f891ba44 Ignoring 1-second scene duration from MindGeek API. DebaucheryLibrarian 2021-10-17 19:59:05 +02:00
  • 239057f1b6 1.199.12 DebaucheryLibrarian 2021-10-17 00:28:18 +02:00
  • 167df35d37 Fixed tags module not dealing with empty releases or tags, added origin tag column to chapter tag table. DebaucheryLibrarian 2021-10-17 00:28:13 +02:00
  • b1b2ad2111 1.199.11 DebaucheryLibrarian 2021-10-11 04:31:46 +02:00
  • f1ff662be2 Fixed tags seed file. DebaucheryLibrarian 2021-10-11 04:31:40 +02:00
  • 2418fec9c9 1.199.10 DebaucheryLibrarian 2021-10-11 02:16:58 +02:00
  • aaaa0a6afb Updated proxy list. DebaucheryLibrarian 2021-10-11 02:16:51 +02:00
  • afe22003e1 1.199.9 DebaucheryLibrarian 2021-10-10 00:04:28 +02:00
  • b6ad2903f3 Storing original tags. DebaucheryLibrarian 2021-10-10 00:04:21 +02:00
  • 6c298cd639 1.199.8 DebaucheryLibrarian 2021-09-28 20:45:30 +02:00
  • dbff3e9539 Added Brad Montana. Added teaser link to trailer video. DebaucheryLibrarian 2021-09-28 20:45:22 +02:00
  • fcc6b33d07 1.199.7 DebaucheryLibrarian 2021-09-17 04:28:54 +02:00
  • 0224c26ca0 Fixed alert searches. Added Teen Mega World campaigns. DebaucheryLibrarian 2021-09-17 04:28:48 +02:00
  • 294f15e694 1.199.6 DebaucheryLibrarian 2021-09-17 03:30:58 +02:00
  • 522584711b Added Teen Mega World scraper. DebaucheryLibrarian 2021-09-17 03:30:49 +02:00
  • ae40f33283 Added Transfixed to Adult Time. DebaucheryLibrarian 2021-09-16 16:57:14 +02:00
  • 172e01c80e Added Score to default ignored networks. DebaucheryLibrarian 2021-09-15 02:01:13 +02:00
  • 901acf1390 1.199.5 DebaucheryLibrarian 2021-09-14 00:42:59 +02:00
  • a316da3083 Retrieving Spizoo trailers. DebaucheryLibrarian 2021-09-14 00:42:51 +02:00
  • 0b46e27497 1.199.4 DebaucheryLibrarian 2021-09-13 01:29:47 +02:00