Commit Graph

82 Commits

Author SHA1 Message Date
3ec7b15886 Improved scraping and association behavior. 2019-11-19 04:36:15 +01:00
e8130c3634 Scraping actor profiles from FreeOnes. 2019-11-17 03:56:45 +01:00
bd041c528d Fixed ID number/string incompatability in duplicate detection. Expanded Reality Kings scraper to handle older scenes and fix URLs. 2019-11-17 00:45:31 +01:00
2857387441 Added bash CLI shorthand. Properly setting parameters in site results. Removed obsolete URL restriction from Reality Kings scraper. 2019-11-16 23:37:33 +01:00
b489c8fc33 Major refactor, cleand up site scrape module, fixed and cleaned up release scrape module. Removed old CLI code 2019-11-16 03:33:36 +01:00
5620dfcb65 Added filter bar to all pages. Added 'upcoming' marker. Improved date tidbit. 2019-11-15 05:10:59 +01:00
0575dbc7e4 Generalized filters bar, added to network page. 2019-11-15 02:37:17 +01:00
1c3f17ec82 Added timerange filters. Refactored releases module for more efficient queries. 2019-11-15 01:27:58 +01:00
bf223adc55 Redesigned release page. Added 'single site' marker, linking directly to network page. Fixed Dogfart scraper duration. 2019-11-14 05:13:38 +01:00
117d669a69 Added Private Black, improved Private scraper to handle their non-private.com sites. 2019-11-14 00:00:29 +01:00
f9f9cc7977 Added tag filter to releases query, enabled on homepage. 2019-11-13 03:14:24 +01:00
832e96ced1 Improved site and network pages. Fixed various issues. 2019-11-12 01:22:20 +01:00
681f1bca85 Added tag page. Added default 'anal' tag to Vixen scraper for Tushy and Tushy Raw. 2019-11-11 05:18:28 +01:00
50816d7b28 Generating thumbnails. Added site overview page. 2019-11-11 03:20:00 +01:00
6ed484af76 Moved icons into network directories. Improved network logo handling. 2019-11-10 04:47:41 +01:00
a9b91ff76c Added actors page. Added site logos with overview on network page. 2019-11-10 04:20:22 +01:00
82c9bc664a Added network page and sites back-end. Split release tiles into own component. 2019-11-09 04:43:58 +01:00
e9277028e2 Added Mike Adriano scraper (True Anal, All Anal, Swallowed, Nympho). Updated README. 2019-11-09 01:22:50 +01:00
0567b1b2ff Refactored seed files to use programmatic upsert instead of SQL duplicate ignore. 2019-11-06 02:47:10 +01:00
f8f6428e36 Added media support to Private scraper. 2019-11-05 01:41:13 +01:00
c466d791f5 Removed upsert from store releases, observing effects; fixes ? inserted as . Removed query from stored Dogfart URLs. 2019-11-05 00:54:47 +01:00
e4399380d3 Fixed photo plucker to prevent duplicate at end. 2019-11-04 06:04:43 +01:00
5745cd33d8 Added Dogfart scraper. Added 'date added' property to release page. 2019-11-04 05:47:37 +01:00
2198c7ceb0 Added media support to Bang Bros scraper. Added untracked files. 2019-10-31 01:53:26 +01:00
382e40b651 Added studio support. Added studios for LegalPorno. Improved media fetch error handling. Fixed DDFNetwork scraper, added media support. 2019-10-30 04:45:42 +01:00
ffe2564bb3 Added full photo album to Jules Jordan scraper. 2019-10-29 04:49:27 +01:00
eb50af7b81 Added media support to Brazzers scraper. 2019-10-29 03:50:39 +01:00
d5073a73ce Added media support to XEmpire (HardX) scraper. 2019-10-29 03:13:56 +01:00
a4d936523b Added media to LegalPorno scraper. 2019-10-29 01:47:16 +01:00
5f853792b8 Added icon component. Stylized filter bar. 2019-10-28 02:54:37 +01:00
f7f5e8a306 Deriving transsexual tag from actors in Evil Angel scraper. 2019-10-28 02:12:11 +01:00
0e784a274f Reworked tag matching. Added tag filter groundwork. 2019-10-28 00:58:54 +01:00
2c32ed6549 Completed Evil Angel scraper. Added trans tags. 2019-09-28 03:26:04 +02:00
298eabe56e Improved Vixen and XEmpire scrapers. Added media to Blowpass scraper. Improved release fetch code. 2019-09-26 03:27:01 +02:00
96d8cfbcb6 Improved media handling, added trailer support. Fetching media from Vixen network frontpages. 2019-09-25 04:52:58 +02:00
b12d74cbb3 Fixed Vixen scraper, site restructured. Added Deeper to Vixen network. 2019-09-25 02:44:25 +02:00
c78f7f957f Merge branch 'master' of unknown.name:pendulum/traxxx 2019-09-25 01:38:21 +02:00
05263a97ea Scrolling content container instead of whole page. Improved title source in XEmpire scraper. Fixed scene page breaking when no photos are available. 2019-09-25 01:38:06 +02:00
a9f64a82a2 Legalporno title scene ID fix
Old regex would fail on some videos
e.g.
Little Sofi Smile plays with two big cocks AF001
Whitney Wright Gets Punished by Two Big Black Cocks AB015
2019-09-23 18:32:47 +02:00
cf4987ba48 Using media database for images. 2019-09-10 16:48:04 +02:00
02e81a8be9 Refactored site accumulation to work with new database structure 2019-09-08 04:06:49 +02:00
926c227b85 Refactored database to separate IDs from slugs 2019-09-08 03:53:09 +02:00
f2a6b58370 Added release page with photo viewer. Added photo count to database. Improved styling. 2019-07-06 05:29:12 +02:00
b8aa81b3f1 Transitioning to Vue. Installed environment and restored homepage scene overview. 2019-06-03 05:31:38 +02:00
fda6d1e475 Added release page. 2019-05-19 01:34:08 +02:00
e3558fc0c5 Using grid layout with thumbnails. 2019-05-08 05:50:13 +02:00
8eb2dcfd89 Storing and fetching tags. 2019-05-06 23:41:38 +02:00
3df5a821b6 Saving results to database. Showing webpage. 2019-05-06 02:01:57 +02:00
d044aff9dd Destroying knex when done to ensure process exit. 2019-04-12 03:54:34 +02:00
b486b6abdd Added Bang Bros scraper. 2019-04-12 03:12:53 +02:00