DebaucheryLibrarian
/
traxxx
2
1
Fork 1
Code Issues 37 Pull Requests 1 Releases Wiki Activity
2,186 Commits 3 Branches 0 Tags 2.4 GiB
Commit Graph

899 Commits

Author SHA1 Message Date
ThePendulum 298eabe56e Improved Vixen and XEmpire scrapers. Added media to Blowpass scraper. Improved release fetch code. 2019-09-26 03:27:01 +02:00
ThePendulum 96d8cfbcb6 Improved media handling, added trailer support. Fetching media from Vixen network frontpages. 2019-09-25 04:52:58 +02:00
ThePendulum b12d74cbb3 Fixed Vixen scraper, site restructured. Added Deeper to Vixen network. 2019-09-25 02:44:25 +02:00
ThePendulum c78f7f957f Merge branch 'master' of unknown.name:pendulum/traxxx 2019-09-25 01:38:21 +02:00
ThePendulum 05263a97ea Scrolling content container instead of whole page. Improved title source in XEmpire scraper. Fixed scene page breaking when no photos are available. 2019-09-25 01:38:06 +02:00
boiii a9f64a82a2 Legalporno title scene ID fix 
Old regex would fail on some videos
e.g.
Little Sofi Smile plays with two big cocks AF001
Whitney Wright Gets Punished by Two Big Black Cocks AB015
 2019-09-23 18:32:47 +02:00
ThePendulum cf4987ba48 Using media database for images. 2019-09-10 16:48:04 +02:00
ThePendulum 02e81a8be9 Refactored site accumulation to work with new database structure 2019-09-08 04:06:49 +02:00
ThePendulum 926c227b85 Refactored database to separate IDs from slugs 2019-09-08 03:53:09 +02:00
ThePendulum f2a6b58370 Added release page with photo viewer. Added photo count to database. Improved styling. 2019-07-06 05:29:12 +02:00
ThePendulum b8aa81b3f1 Transitioning to Vue. Installed environment and restored homepage scene overview. 2019-06-03 05:31:38 +02:00
ThePendulum fda6d1e475 Added release page. 2019-05-19 01:34:08 +02:00
ThePendulum e3558fc0c5 Using grid layout with thumbnails. 2019-05-08 05:50:13 +02:00
ThePendulum 8eb2dcfd89 Storing and fetching tags. 2019-05-06 23:41:38 +02:00
ThePendulum 3df5a821b6 Saving results to database. Showing webpage. 2019-05-06 02:01:57 +02:00
ThePendulum d044aff9dd Destroying knex when done to ensure process exit. 2019-04-12 03:54:34 +02:00
ThePendulum b486b6abdd Added Bang Bros scraper. 2019-04-12 03:12:53 +02:00
ThePendulum 82419be402 Changed scene fetch title source for BlowPass scraper. 2019-04-10 04:44:36 +02:00
ThePendulum 7dd2432837 Changed title source for 21Sextury scene fetch, 2019-04-10 03:57:34 +02:00
ThePendulum bc01cbe6dc Added Bang Bros data (no scraper yet). Added 21Sextury scene fetch date fallback. 2019-04-10 03:42:20 +02:00
ThePendulum be74f84781 Expanded README. 2019-04-08 04:07:39 +02:00
ThePendulum db05bcf666 Added site stats to README. 2019-04-08 03:09:37 +02:00
ThePendulum 763ffb341a Added Naughty America scraper. 2019-04-08 03:07:16 +02:00
ThePendulum d526e4daea Added Reality Kings scraper. Improved site finder. 2019-04-08 01:49:45 +02:00
ThePendulum ec056a177a Added 21Sextury scraper. Various improvements. 2019-04-07 20:51:14 +02:00
ThePendulum d5b9fec0db Added duration property to scraper template. 2019-04-07 05:21:27 +02:00
ThePendulum 6b9d99f495 Added description property to recent scrapers (apparently forgotten). Reconfigured eslint for scrapers. 2019-04-07 05:19:44 +02:00
ThePendulum c8abb302e4 Added DDFNetwork scraper. Modified tag matching query to be case insensitive. 2019-04-07 05:01:06 +02:00
ThePendulum 885a815022 Added tag groups. Added MOFOS scraped. Improved entry ID handling. 2019-04-07 02:15:57 +02:00
ThePendulum 3a90f98d41 Added Blowpass scraper. Split shootId and pageId. 2019-04-06 23:24:26 +02:00
ThePendulum 2b818e379a Scrapers can now iterate through pages. Filtering unique releases before saving to database. Improved scrapers and rendering. 2019-04-05 03:45:40 +02:00
ThePendulum cbb4fdc919 Added utils directory to repository. 2019-04-04 21:10:44 +02:00
ThePendulum 6190247ac5 Added Brazzers scraper. Removed scene-only sites in database in favor of automatic network fallback. 2019-04-04 20:22:47 +02:00
ThePendulum 784542253b Expanded tag database. 2019-04-04 04:44:37 +02:00
ThePendulum b3beeef3e4 Added Private scraper. Added Vixen scraper to repository. 2019-04-04 04:00:28 +02:00
ThePendulum 439d3225ec Added Vixen scraper. Added LegalPorno studio IDs. 2019-04-01 02:45:15 +02:00
ThePendulum 8421cd8648 Added parameters column to sites database, fixes Perv City scraper. Getting shoot ID from all existing scrapers. 2019-03-26 01:26:47 +01:00
ThePendulum c60ceeabfa Fixed actor list and title trimming for Jules Jordan scraper. 2019-03-25 04:15:45 +01:00
ThePendulum 4d7f323e86 Replaced network and tag files with SQLite database. 2019-03-25 03:57:33 +01:00
ThePendulum 845f46e9ad Added Kink scraper with elaborate site specification. 2019-03-24 05:28:18 +01:00
ThePendulum e85a0f45f9 Improved copy & quit options. 2019-03-24 03:08:51 +01:00
ThePendulum 4fcabb4aae Added tags and duration to scraping. Added LegalPorno scraper. 2019-03-24 01:29:22 +01:00
ThePendulum e8d4b76403 Improved module structure. Added individual scene scrapers for Jules Jordan and XEmpire. 2019-03-23 22:48:39 +01:00
ThePendulum 1a170bfbd5 Added Jules Jordan scraper. Added render argument to stop going into ncurses mode during dev. 2019-03-18 04:46:53 +01:00
ThePendulum ddbed3c142 Added colors to ratings. TUI renderer accounts for style encodings in formatted values. 2019-03-11 04:51:28 +01:00
ThePendulum 02c421b737 Displaying results in terminal table with select, scroll and experimental search. Expanded broken character handling for PervCity scraper. 2019-03-11 04:19:36 +01:00
ThePendulum af9565b296 Completed Perv City scraper. Outputting results as list. 2019-03-04 04:19:03 +01:00
ThePendulum 53ea694894 Added include and exclude config options. Moved network definitions to dedicated file. Scraping all XEmpire sites. Added definitions for Perv City. 2019-03-04 02:46:33 +01:00
ThePendulum 71aa31dda6 Experimentally scraping data from HardX. 2019-03-03 04:18:33 +01:00