boiii
/
traxxx
forked from DebaucheryLibrarian/traxxx
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
731 Commits 8 Branches 0 Tags 4.7 GiB
Commit Graph

38 Commits

Author SHA1 Message Date
ThePendulum 11eb66f834 Switched to tabs. Adding missing actor entries when scraping actors, with batch ID. 2020-05-14 04:26:05 +02:00
ThePendulum 93d4f0ff1a Added WIP media module. Returning releases from release search database function. Fixed page loop in update module. 2020-03-29 04:00:46 +02:00
ThePendulum 95d115b585 Added Aziani. Added URL origin parameter to relevant qu methods. 2020-03-28 01:40:02 +01:00
ThePendulum 238ebcbf34 Moved SFW mode to server, added HTTP header trigger. 2020-03-27 17:37:13 +01:00
ThePendulum fdb2b132f6 Improved release storage module. Added new tags module. Added movie scraping. 2020-03-22 03:50:24 +01:00
ThePendulum d765543b30 Improved update runner. Improved HTTP module API, added default user agent. Added PornCZ and Czechav logos. 2020-03-21 02:48:24 +01:00
ThePendulum 4b310e9dfa Added configurable proxy to HTTP module (also used by qu). Added network and site URL to search documents. 2020-03-19 01:54:25 +01:00
ThePendulum 0f09fd53eb Refactoring deep scrape. Added tag posters. 2020-03-16 04:10:52 +01:00
ThePendulum c8ebe7892a Refactored update scraper into new module. 2020-03-14 02:56:28 +01:00
ThePendulum 0d0acb6f3c Fixed release sites for profile scraping. 2020-03-11 03:01:37 +01:00
ThePendulum d97b1ab894 Split up profile scrape runner. Fixed wrong search document date key. Added search update CLI. 2020-03-10 23:46:55 +01:00
ThePendulum 638757b6e4 Added rudimentary movie relations. 2020-03-09 05:06:37 +01:00
ThePendulum db01599569 Added profile scraper with releases to Hush. Added qtexts to q to return text nodes individually. Including network in profile site. 2020-03-06 02:49:55 +01:00
ThePendulum 377970f874 Added parent-child relations to network, showing parent network in sidebar. Added Burning Angel using Gamma API. 2020-02-20 02:35:23 +01:00
ThePendulum 6e1de52a40 Added Fame Digital. Added actor release scraping to DDF Network. Improved q and Gamma scraper. 2020-02-06 23:15:28 +01:00
ThePendulum ffdf0690e7 Added option to fetch all of an actor's releases (for supporter scrapers), and a utility to extract posters. 2020-01-31 01:55:55 +01:00
ThePendulum 68f9043910 Not fetching basic actors when actor names are supplied. Set default media directory to ./media. 2020-01-25 03:26:49 +00:00
ThePendulum 70e27a6cd9 Moved networks to GraphQL. 2020-01-03 00:59:02 +01:00
ThePendulum 7ba716cd6f Experimenting using GraphQL in favor of REST. 2019-12-15 05:42:51 +01:00
ThePendulum 77307d2d13 Refactored media module to generalize avatar and poster storage into photo storage. 2019-12-13 03:28:52 +01:00
ThePendulum 04a89efa58 Refactored 21sextury scraper. 2019-12-09 05:00:49 +01:00
ThePendulum 4be508b388 Drastic actor page redesign. Storing one avatar per actor, other profile photos as 'photo' role; no longer assuming first photo is avatar. 2019-11-28 05:36:22 +01:00
ThePendulum 3ec7b15886 Improved scraping and association behavior. 2019-11-19 04:36:15 +01:00
ThePendulum e8130c3634 Scraping actor profiles from FreeOnes. 2019-11-17 03:56:45 +01:00
ThePendulum 2857387441 Added bash CLI shorthand. Properly setting parameters in site results. Removed obsolete URL restriction from Reality Kings scraper. 2019-11-16 23:37:33 +01:00
ThePendulum b489c8fc33 Major refactor, cleand up site scrape module, fixed and cleaned up release scrape module. Removed old CLI code 2019-11-16 03:33:36 +01:00
ThePendulum b8aa81b3f1 Transitioning to Vue. Installed environment and restored homepage scene overview. 2019-06-03 05:31:38 +02:00
ThePendulum 3df5a821b6 Saving results to database. Showing webpage. 2019-05-06 02:01:57 +02:00
ThePendulum d044aff9dd Destroying knex when done to ensure process exit. 2019-04-12 03:54:34 +02:00
ThePendulum 82419be402 Changed scene fetch title source for BlowPass scraper. 2019-04-10 04:44:36 +02:00
ThePendulum e85a0f45f9 Improved copy & quit options. 2019-03-24 03:08:51 +01:00
ThePendulum 4fcabb4aae Added tags and duration to scraping. Added LegalPorno scraper. 2019-03-24 01:29:22 +01:00
ThePendulum e8d4b76403 Improved module structure. Added individual scene scrapers for Jules Jordan and XEmpire. 2019-03-23 22:48:39 +01:00
ThePendulum 1a170bfbd5 Added Jules Jordan scraper. Added render argument to stop going into ncurses mode during dev. 2019-03-18 04:46:53 +01:00
ThePendulum 02c421b737 Displaying results in terminal table with select, scroll and experimental search. Expanded broken character handling for PervCity scraper. 2019-03-11 04:19:36 +01:00
ThePendulum af9565b296 Completed Perv City scraper. Outputting results as list. 2019-03-04 04:19:03 +01:00
ThePendulum 53ea694894 Added include and exclude config options. Moved network definitions to dedicated file. Scraping all XEmpire sites. Added definitions for Perv City. 2019-03-04 02:46:33 +01:00
ThePendulum 71aa31dda6 Experimentally scraping data from HardX. 2019-03-03 04:18:33 +01:00