DebaucheryLibrarian/traxxx
2
1
Fork 1
Code Issues 39 Pull Requests 1 Releases Wiki Activity

Commit Graph

  • 5c5a11fdca Added Bang Bros members page scraper (not for full scenes). DebaucheryLibrarian 2022-01-29 01:21:41 +01:00
  • a22c62d893 1.205.5 DebaucheryLibrarian 2022-01-28 04:05:38 +01:00
  • 90bc2f3724 Changed release media association existence check, added log for details. DebaucheryLibrarian 2022-01-28 04:05:29 +01:00
  • 8cdc794a3a 1.205.4 DebaucheryLibrarian 2022-01-26 13:52:41 +01:00
  • 250618df8b Added entity scene count function. DebaucheryLibrarian 2022-01-26 13:52:39 +01:00
  • b62ae00c54 1.205.3 DebaucheryLibrarian 2022-01-26 01:47:36 +01:00
  • 67d0a9e0e0 Fixed scene entity tag association. DebaucheryLibrarian 2022-01-26 01:47:34 +01:00
  • b4425bc3bb Merge pull request 'Add Facials4k' (#44) from boiii/traxxx:add-facials-4k into master ThePendulum 2022-01-25 22:29:10 +00:00
  • d77c145de3 Update 'seeds/02_sites.js' boiii 2022-01-25 20:56:11 +00:00
  • 6753f923d9 1.205.2 DebaucheryLibrarian 2022-01-25 15:34:17 +01:00
  • 452f725332 Switched poster URL preference in Gamma scraper to prevent cropped image on XEmpire. DebaucheryLibrarian 2022-01-25 15:34:15 +01:00
  • 7c1f45bcfb 1.205.1 DebaucheryLibrarian 2022-01-24 22:29:29 +01:00
  • 11ea54f6e8 Fixed outdated alerts query. DebaucheryLibrarian 2022-01-24 22:29:27 +01:00
  • 5b623ee46f 1.205.0 DebaucheryLibrarian 2022-01-24 00:15:19 +01:00
  • 7ceec1c739 Added indexes to scene tag and movie scene tables improve performance. Removed scene count from channel overview, too expensive. DebaucheryLibrarian 2022-01-24 00:15:11 +01:00
  • fc318536aa 1.204.13 DebaucheryLibrarian 2022-01-23 02:46:44 +01:00
  • cd8f690ac6 Preferring network over channel in deep URL channel matching. DebaucheryLibrarian 2022-01-23 02:46:42 +01:00
  • 240a8e86fd 1.204.12 DebaucheryLibrarian 2022-01-22 23:20:10 +01:00
  • c557f0f1f0 Improved Gamma image sources to prevent cropped images. DebaucheryLibrarian 2022-01-22 23:20:08 +01:00
  • 86f56695e2 1.204.11 DebaucheryLibrarian 2022-01-20 00:54:13 +01:00
  • 20da2d1cf6 Reusing batch ID for movies to preserve new-flag. DebaucheryLibrarian 2022-01-20 00:54:10 +01:00
  • 372db86927 Disabled MindGeek session bundling to analyze Too Many Requests errors. DebaucheryLibrarian 2022-01-16 22:24:47 +01:00
  • 4c503a3177 1.204.10 DebaucheryLibrarian 2022-01-16 17:17:49 +01:00
  • 57d46f5842 Fixed latest query in Gamma scraper. DebaucheryLibrarian 2022-01-16 17:17:45 +01:00
  • 7f11d0ca91 1.204.9 DebaucheryLibrarian 2022-01-12 17:50:27 +01:00
  • bbd788699e Fixed GraphQL query for scenes REST API. Added entry ID to scene search document. DebaucheryLibrarian 2022-01-12 17:50:23 +01:00
  • e24add98ea 1.204.8 DebaucheryLibrarian 2022-01-10 02:17:21 +01:00
  • 506971b44b Chunked duplicate check to prevent postgres stack depth errors. DebaucheryLibrarian 2022-01-10 02:17:17 +01:00
  • 43a0bc8a2c 1.204.7 DebaucheryLibrarian 2022-01-07 01:07:43 +01:00
  • baebdbc0bb Adding comment listing sister sites for non-exclusive Gamma API scenes. DebaucheryLibrarian 2022-01-07 01:07:41 +01:00
  • 1c24cae3b1 1.204.6 DebaucheryLibrarian 2022-01-07 01:02:36 +01:00
  • b9146aee5f Removed exclusive filter from Evil Angel parameters. DebaucheryLibrarian 2022-01-07 01:02:34 +01:00
  • 09bfcb01f5 1.204.5 DebaucheryLibrarian 2022-01-06 01:41:29 +01:00
  • 5d80b6dc21 Added and improved Reality Kings logos. Added tag photos. DebaucheryLibrarian 2022-01-06 01:41:26 +01:00
  • 140a38c349 1.204.4 DebaucheryLibrarian 2021-12-31 01:45:06 +01:00
  • 6760c11881 Disabled why-is-node-running to assess OOM. DebaucheryLibrarian 2021-12-31 01:45:03 +01:00
  • 2dcdbf9c37 1.204.3 DebaucheryLibrarian 2021-12-27 22:36:03 +01:00
  • 3b958a02ef Added memory profiler configuration options. DebaucheryLibrarian 2021-12-27 22:36:01 +01:00
  • 605242b399 1.204.2 DebaucheryLibrarian 2021-12-27 17:29:33 +01:00
  • 299f257a01 Logging memory usage on media fetch. DebaucheryLibrarian 2021-12-27 17:29:23 +01:00
  • 0ad64ef5f4 1.204.1 DebaucheryLibrarian 2021-12-20 03:29:16 +01:00
  • 3bfe1e8fdb Storing scenes before fetching movies. DebaucheryLibrarian 2021-12-20 03:29:14 +01:00
  • 7d992f4129 Added triggers to memory dump. DebaucheryLibrarian 2021-12-20 02:28:59 +01:00
  • 280032937f Added centralized movie page fetcher. Added memory heap dump. DebaucheryLibrarian 2021-12-20 02:22:10 +01:00
  • d93670842b 1.204.0 DebaucheryLibrarian 2021-12-19 23:03:48 +01:00
  • dc187a9a3a Added execute method to qu, removed runScripts from Gamma's fetchMovie to observe effect on memory usage. DebaucheryLibrarian 2021-12-19 23:03:44 +01:00
  • 5f89c6e14c 1.203.13 DebaucheryLibrarian 2021-12-19 00:08:22 +01:00
  • 9f10420eb9 Fixed tag search GraphQL query. DebaucheryLibrarian 2021-12-19 00:08:21 +01:00
  • 9568370132 1.203.12 DebaucheryLibrarian 2021-12-18 23:44:54 +01:00
  • 1c0c30be11 Improved and re-enabled why-is-node-running logger. DebaucheryLibrarian 2021-12-18 23:44:51 +01:00
  • cdb7dcd6e9 1.203.11 DebaucheryLibrarian 2021-12-18 23:22:38 +01:00
  • 8e4be06675 Closing JSDOM window after deep scrapes in an attempt to save memory. DebaucheryLibrarian 2021-12-18 23:22:35 +01:00
  • de7a8c756a 1.203.10 DebaucheryLibrarian 2021-12-13 01:20:04 +01:00
  • 65e2b72c6a Fixed Gamma movie scraper failing when data object is not available. DebaucheryLibrarian 2021-12-13 01:20:02 +01:00
  • 523c36ecd4 1.203.9 DebaucheryLibrarian 2021-12-11 22:46:58 +01:00
  • 5b5688438c Fixed Gamma movie scene query. Added tag photos. DebaucheryLibrarian 2021-12-11 22:46:55 +01:00
  • 4ca07631c7 1.203.8 DebaucheryLibrarian 2021-12-05 23:59:20 +01:00
  • ec4e7bc12a Updated Jules Jordan scraper for Sperm Swallowers and The Ass Factory. DebaucheryLibrarian 2021-12-05 23:59:17 +01:00
  • 26d15c0a6f Updated Jules Jordan scraper for Manuel Ferrara and Girl Girl. DebaucheryLibrarian 2021-12-05 23:43:23 +01:00
  • a484396db4 Hiding scenes with missing dates from network overview. Using computed effective date column. DebaucheryLibrarian 2021-12-05 23:29:27 +01:00
  • 681db02784 1.203.7 DebaucheryLibrarian 2021-12-05 02:54:57 +01:00
  • e88554666c Reduced media concurrency to assess effect on memory. Moved qu context removal to deep scrape runner. Updated movie graphql queries. DebaucheryLibrarian 2021-12-05 02:54:55 +01:00
  • 9f37ec4cff 1.203.6 DebaucheryLibrarian 2021-12-04 00:32:31 +01:00
  • abd063a578 Removed window map from http module to prevent memory pile-up with update scraping. DebaucheryLibrarian 2021-12-04 00:32:28 +01:00
  • 883e57ce1f 1.203.5 DebaucheryLibrarian 2021-12-02 15:51:33 +01:00
  • ad04502a8c Added Radical favicons. DebaucheryLibrarian 2021-12-02 15:51:30 +01:00
  • f65ed16842 1.203.4 DebaucheryLibrarian 2021-12-02 00:45:24 +01:00
  • 1918dd4ad5 Removing query methods from XEmpire release. DebaucheryLibrarian 2021-12-02 00:45:22 +01:00
  • 3983d3464f 1.203.3 DebaucheryLibrarian 2021-12-01 23:44:27 +01:00
  • 61daf5f037 Added debug log for jsdom window closing. DebaucheryLibrarian 2021-12-01 23:44:25 +01:00
  • eafa144104 1.203.2 DebaucheryLibrarian 2021-12-01 23:39:11 +01:00
  • 60c151ff6a Reduced deep scrape concurrency to 1. DebaucheryLibrarian 2021-12-01 23:39:09 +01:00
  • c97d18fcf9 1.203.1 DebaucheryLibrarian 2021-12-01 23:30:12 +01:00
  • e41f9fa937 Added waitImmediate to deep scrape, reduced concurrency. DebaucheryLibrarian 2021-12-01 23:30:10 +01:00
  • 56a7fb0ad9 1.203.0 DebaucheryLibrarian 2021-12-01 17:26:34 +01:00
  • e29cbc9fea Closing JSDOM window after deep scrape in an attempt to save memory. Reduced deep scrape concurrency to 5. DebaucheryLibrarian 2021-12-01 17:26:13 +01:00
  • 08f725a0b6 1.202.3 DebaucheryLibrarian 2021-12-01 00:00:26 +01:00
  • b93a5715cb Updated Jules Jordan scraper for new update page layout. DebaucheryLibrarian 2021-12-01 00:00:24 +01:00
  • 2018d5c298 1.202.2 DebaucheryLibrarian 2021-11-29 02:49:12 +01:00
  • 87094a9498 Replaced cheerio with qu in Gamma scraper. DebaucheryLibrarian 2021-11-29 02:49:07 +01:00
  • 53a1c697d0 1.202.1 DebaucheryLibrarian 2021-11-28 01:20:41 +01:00
  • f04eb72891 Added upcoming scraper to PurgatoryX. DebaucheryLibrarian 2021-11-28 01:20:39 +01:00
  • dfeb0c08cf 1.202.0 DebaucheryLibrarian 2021-11-27 23:55:22 +01:00
  • 9d7183ac69 Added PurgatoryX scraper. DebaucheryLibrarian 2021-11-27 23:55:16 +01:00
  • 2539e88f47 1.201.6 DebaucheryLibrarian 2021-11-22 02:51:55 +01:00
  • 20d0d860d3 Fixed MindGeek scraper trying to acquire session from mindgeek.com DebaucheryLibrarian 2021-11-22 02:51:52 +01:00
  • 6b4aa64d74 Improved MindGeek scraper session check to prevent crash when network session isn't available yet. DebaucheryLibrarian 2021-11-22 02:44:03 +01:00
  • c7b9ec7a4b 1.201.5 DebaucheryLibrarian 2021-11-21 00:47:34 +01:00
  • e81864ebde Removed verbose http queued output. DebaucheryLibrarian 2021-11-21 00:47:32 +01:00
  • 0305a22a24 Removed stray console log from media module. DebaucheryLibrarian 2021-11-21 00:43:35 +01:00
  • a406eb584d 1.201.4 DebaucheryLibrarian 2021-11-21 00:41:15 +01:00
  • 2be3ea9bbb Explicitly adding headers to http module result. DebaucheryLibrarian 2021-11-21 00:41:12 +01:00
  • 0a8a7ff9a5 1.201.3 DebaucheryLibrarian 2021-11-21 00:31:12 +01:00
  • 98c103c625 Fixed uuid import. Changed fs rmdir to rm. DebaucheryLibrarian 2021-11-21 00:31:09 +01:00
  • e0908a5f5e 1.201.2 DebaucheryLibrarian 2021-11-21 00:19:13 +01:00
  • f0b7678444 Fixed upsert failing on empty insert array due breaking Knex API change. DebaucheryLibrarian 2021-11-21 00:19:10 +01:00
  • 64e9efe095 1.201.1 DebaucheryLibrarian 2021-11-21 00:15:21 +01:00
  • ab29ab053e Increased tile heart button size. Hiding entity tile info under hover effect. DebaucheryLibrarian 2021-11-21 00:15:19 +01:00
  • a5081bc7c9 Updated primary color. DebaucheryLibrarian 2021-11-21 00:04:21 +01:00
  • da9c628f9b 1.201.0 DebaucheryLibrarian 2021-11-21 00:00:14 +01:00