boiii
/
traxxx
forked from DebaucheryLibrarian/traxxx
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
1,469 Commits 8 Branches 0 Tags 4.7 GiB
Commit Graph

142 Commits

Author SHA1 Message Date
ThePendulum f0a89df6ab Refactoring to use entities over sites and networks. 2020-06-17 04:07:24 +02:00
ThePendulum 9843023c1f Added Filthy Family and 'legacy' scraper to Bang Bros. Added trans generic avatar. Added pagination support to site actions. 2020-05-24 03:54:29 +02:00
ThePendulum 75d49517b7 Added pagination to actor overview. Lazy loading actor avatars. Reduced hash digest length. 2020-05-23 04:32:50 +02:00
ThePendulum 532a4b679b Using batch insert for profiles to prevent errors on large inserts. 2020-05-21 03:44:44 +02:00
ThePendulum b6691e1991 Added release type distinction to REST API. 2020-05-20 01:38:58 +02:00
ThePendulum 057362d011 Added basic release and actor API. 2020-05-20 01:11:32 +02:00
ThePendulum 6973d39cbd Replacing one or multiple space-like characters with single space in actor description. Using logo thumbnails in descriptions. 2020-05-19 05:06:01 +02:00
ThePendulum c0898b84d6 Showing all unique descriptions on profile with network logo. Fixed Fame Digital scraper. 2020-05-19 04:46:49 +02:00
ThePendulum 9883c3d9c2 Not scraping existing actor profiles unless --force is used. 2020-05-19 02:02:48 +02:00
ThePendulum 0c4628677f Fixed profile location interpolation. Generalizing ethnicity, hair color and eye color. 2020-05-19 01:10:32 +02:00
ThePendulum 003e07491d Added network to profile context when site is available. 2020-05-18 03:34:41 +02:00
ThePendulum 885aa4f627 Passing context object with site or network instead of scraper slug and 'site or network' to all profile scrapers. 2020-05-18 03:22:03 +02:00
ThePendulum 8733fdc657 Improved actor scraping and display. 2020-05-18 01:22:56 +02:00
ThePendulum af5543190a Showing avatar on release actor tile. Fixed social URL validation. 2020-05-17 05:24:46 +02:00
ThePendulum 61965d480c Added birthday to Bang actor scraper. 2020-05-17 05:08:41 +02:00
ThePendulum f42ca7bd52 Added Bang! actor scraper. Fixed date interpolation. Showing date and age of death on profile (only if actor has already died). 2020-05-17 04:59:09 +02:00
ThePendulum 7f86399033 Fixed averaging interpolating function. 2020-05-17 03:04:58 +02:00
ThePendulum 985ab9d2dc Added profile interpolation. 2020-05-17 03:00:44 +02:00
ThePendulum 05ee57378a Storing actor avatars. Using 1 second interval queue for location resolve as per OSM code of conduct. 2020-05-16 04:36:45 +02:00
ThePendulum 21d4dd6bfa Scraping and storing actor profiles. 2020-05-15 04:40:59 +02:00
ThePendulum 11eb66f834 Switched to tabs. Adding missing actor entries when scraping actors, with batch ID. 2020-05-14 04:26:05 +02:00
ThePendulum f1eb29c713 Added thumb and lazy image scripts. Added FreeOnes and Boobpedia as sites. 2020-05-13 23:17:39 +02:00
ThePendulum dac451bb86 Using alias actor ID when available. Using basic SVG flags instead of PNG. Moved PNG and HD SVG flags to assets. 2020-05-13 20:27:06 +02:00
ThePendulum 6040a3f41f Associating actors without network. 2020-05-13 02:56:20 +02:00
ThePendulum 95d115b585 Added Aziani. Added URL origin parameter to relevant qu methods. 2020-03-28 01:40:02 +01:00
ThePendulum fb59bf552a Added actor assignment to new actors module. Showing network icon on network-specific actors. Improved dark theme. Changed tag tile design. Added Digital Playground logos. 2020-03-27 04:39:13 +01:00
ThePendulum d29e296799 Added database structure for profiles and tattoos. Improved sidebar appearance. Expanded new actors module. 2020-03-26 03:32:07 +01:00
ThePendulum d724f96728 Added new actors module boilerplate. Added tag posters. 2020-03-24 03:48:24 +01:00
ThePendulum 0f09fd53eb Refactoring deep scrape. Added tag posters. 2020-03-16 04:10:52 +01:00
ThePendulum 370605554b Added profile scraper with scenes to BAM Visions. Passing 'includes' object instead of withReleases boolean to Gamma. 2020-03-12 02:19:45 +01:00
ThePendulum 0d0acb6f3c Fixed release sites for profile scraping. 2020-03-11 03:01:37 +01:00
ThePendulum d97b1ab894 Split up profile scrape runner. Fixed wrong search document date key. Added search update CLI. 2020-03-10 23:46:55 +01:00
ThePendulum db01599569 Added profile scraper with releases to Hush. Added qtexts to q to return text nodes individually. Including network in profile site. 2020-03-06 02:49:55 +01:00
ThePendulum 6d1f30f703 Passing matching site to profile scrapers. Allowing scrapers to pass avatar metadata. Added scraper and copyright properties to media. Auto-adding copyright from site or scraper to avatars. Separated Porn Pros from Whale Member. 2020-02-24 03:12:58 +01:00
ThePendulum 0d719d88ea Removed Boob Pedia as gender source, unreliable. 2020-02-23 22:26:14 +01:00
ThePendulum 8359f78e2e Fixed RK scraper returning dick size as bust size. 2020-02-23 22:01:12 +01:00
ThePendulum 0ede7e0f82 Added various Porn Pros archive sites. 2020-02-23 05:00:08 +01:00
ThePendulum 915eb75719 Refactored Vixen scraper, using API endpoint and added actor profile and releases scraper. Release scraper will return base release when present and 'deep' argument is false. 2020-02-22 23:25:10 +01:00
ThePendulum 97f5e49187 Refactored media module. Returning 320p and 720p videos from MindGeek as teasers instead of trailers. 2020-02-19 04:41:53 +01:00
ThePendulum 40bf476ea6 Fixed Porn Pros scraper. Added various Score site logos. 2020-02-18 16:00:36 +01:00
ThePendulum 2f70de8e11 Added preflight method to scrapers. Added Assylum. 2020-02-12 01:54:54 +01:00
ThePendulum dd6a1d9bfd Added Vivid network. Added ASMR Fantasy to Adult Time. Storing deep URL in database. Added href to header links. 2020-02-11 04:58:18 +01:00
ThePendulum 139f0ce7cb Allowing release scrapers to return actor details. Added True Amateurs. 2020-02-09 23:25:54 +01:00
ThePendulum 0f513266a0 Added Black for Wife to JayRock. Switched parameters field to JSON type. 2020-02-09 19:41:39 +01:00
ThePendulum 9d9eda29be Added scene count to actor inspect. Preferring network slug over data brand for scene URLs in MindGeek scraper, since milehighmedia.com's brand is milehigh, resulting in milehigh.com. 2020-02-09 03:09:06 +01:00
ThePendulum 1546e0836c Split Girlsway from Adult Time. Added Fantasy Massage. Using Gamma scraper for Pure Taboo. Added photo path parameter to Gamma scraper. 2020-02-08 02:49:39 +01:00
ThePendulum 6e1de52a40 Added Fame Digital. Added actor release scraping to DDF Network. Improved q and Gamma scraper. 2020-02-06 23:15:28 +01:00
ThePendulum d4801bb240 Returning window.document instead of element as document from q. Fixed actor collisions when scrapers return same scene multiple times. Scraping all Score actor release pages. Fixed 21Sextury and PureTaboo photo scraping. 2020-02-05 23:57:55 +01:00
ThePendulum 38bab672d4 Better handling of empty profiles. Modified Score scraper for Big Tit Terry Nova. Improved Naughty America and various other logos. 2020-02-05 01:41:30 +01:00
ThePendulum f921bb4ae9 Generating and using URL slugs for releases, improver slugify module. Added 'extract' parameter to MindGeek scraper to get scenes not associate with a channel (see Digital Playground). Added various high res logos. 2020-02-04 03:12:09 +01:00
ThePendulum ef602a3a15 Added basic filename copy. Added HTTP helper to q. Fetching all actor release pages from Naughty America. Added various high res network logos. 2020-02-04 00:18:53 +01:00
ThePendulum 5bae5b6e5f Adapted Score scraper for 18eighteen, 40 Something Mag and 50 Plus Milfs. Updated Score network logo and favicon. 2020-02-03 02:57:53 +01:00
ThePendulum a97c6defca Added teaser support. Added Score network with scraper for Scoreland. Improved q. Added assets. 2020-02-02 05:14:58 +01:00
ThePendulum cde9aba0cb Redundant actor sources can now be bundled in configuration. Fixed Men network actor path. 2020-02-01 04:14:08 +01:00
ThePendulum 09ea3125df Fixed release merge order. 2020-02-01 03:30:11 +01:00
ThePendulum 94bf207397 Added Wicked network. Merged Evil Angel, XEmpire and Wicked into generic Gamma scraper. 2020-02-01 01:15:40 +01:00
ThePendulum ffdf0690e7 Added option to fetch all of an actor's releases (for supporter scrapers), and a utility to extract posters. 2020-01-31 01:55:55 +01:00
ThePendulum 345103d759 Fixed ;. 2020-01-27 01:54:42 +01:00
ThePendulum eca65f6b4d Inspecting performance. 2020-01-27 00:41:04 +00:00
ThePendulum ab82329171 Improved q so missing date element returns null. 2020-01-25 01:46:58 +01:00
ThePendulum c93116dee2 Added actor expand button to profile. 2020-01-24 23:36:06 +01:00
ThePendulum 6ef5c82c6a Added URL helper to q. Getting social links from Boobpedia. 2020-01-23 23:32:51 +01:00
ThePendulum 9db0e97512 Improved actor profile flow. Added images. 2020-01-23 03:52:12 +01:00
ThePendulum b92b9f3e18 Fixed actor avatar duplicates. Added new Jules Jordan logo. 2020-01-22 23:17:39 +01:00
ThePendulum f8175f6054 Added generic Gamma photo and actor scraper for XEmpire, 21Sextury, Blowpass and Evil Angel. 2020-01-22 22:25:58 +01:00
ThePendulum 8f72e61928 Added Jay Rock network. Fixed site logo not showing up without URL. 2020-01-11 05:31:04 +01:00
ThePendulum 4b36de2f55 Fixed Evil Angel upcoming and actor association issues. Moving from console.log to logger. 2020-01-10 02:43:04 +01:00
ThePendulum 0a19f2e624 Added Bang! deep scrape. Improved network page layout. Added Bang Bros logos. 2020-01-07 04:23:28 +01:00
ThePendulum 70e27a6cd9 Moved networks to GraphQL. 2020-01-03 00:59:02 +01:00
ThePendulum 5a6bf2b42f Further refactoring. Fixed actor pages and more. 2019-12-31 03:12:52 +01:00
ThePendulum 1c43884102 Refactoring client to reflect database changes. 2019-12-19 04:42:50 +01:00
ThePendulum 77307d2d13 Refactored media module to generalize avatar and poster storage into photo storage. 2019-12-13 03:28:52 +01:00
ThePendulum 18f37e3fbd Moved all tag photos to public asset directory. 2019-12-11 02:25:25 +01:00
ThePendulum b9bac6d8f9 Added Kelly Madison profile scraper. 2019-12-10 22:35:00 +01:00
ThePendulum b6123b9418 Added source maps. Fixed DDFNetwork avatar and improved photo fetch error handling. 2019-12-10 00:30:55 +01:00
ThePendulum 04a89efa58 Refactored 21sextury scraper. 2019-12-09 05:00:49 +01:00
ThePendulum 55e3130062 Move tag posters and photos to media database. 2019-12-04 21:58:08 +01:00
ThePendulum cf81aa99e0 Added rudimentary tags page. Improved social match behavior. 2019-12-01 05:32:47 +01:00
ThePendulum bead69de49 Added basic actor and network overview. Added DDF Network actor scraper. Various bug fixes and layout improvements. 2019-11-30 05:55:32 +01:00
ThePendulum 0dbe853f39 Resolving actor birth and residence place before storage. Layout improvements. 2019-11-29 05:46:06 +01:00
ThePendulum 4be508b388 Drastic actor page redesign. Storing one avatar per actor, other profile photos as 'photo' role; no longer assuming first photo is avatar. 2019-11-28 05:36:22 +01:00
ThePendulum 884ef248e4 Fixed actor birthdate and social links scraping. 2019-11-27 05:12:51 +01:00
ThePendulum d113123778 Fixed countries seed file. Updated MOFOS scraper. Improved Reality Kings scraper. Limiting photos for XEmpire scraper. 2019-11-27 04:58:38 +01:00
ThePendulum de36ed97e4 Added profile scraping in try/catch block. Re-added boobs enhanced info to actor page. 2019-11-21 11:43:07 +01:00
ThePendulum 31a8f1cac1 Improved profile scrapers. Sorting avatars on actor page by index. 2019-11-21 04:24:55 +01:00
ThePendulum 9224b441e2 Added Brazzers and Jules Jordan as profile sources. Changed profile structure for proper bust-waist-hip properties and improved stability. 2019-11-21 04:05:32 +01:00
ThePendulum 9fcc40dd17 Added avatars. Added PornHub and LegalPorno actor profile scrapers. 2019-11-20 04:53:36 +01:00
ThePendulum 3ec7b15886 Improved scraping and association behavior. 2019-11-19 04:36:15 +01:00
ThePendulum e8130c3634 Scraping actor profiles from FreeOnes. 2019-11-17 03:56:45 +01:00
ThePendulum f9f9cc7977 Added tag filter to releases query, enabled on homepage. 2019-11-13 03:14:24 +01:00
ThePendulum 50816d7b28 Generating thumbnails. Added site overview page. 2019-11-11 03:20:00 +01:00
ThePendulum a9b91ff76c Added actors page. Added site logos with overview on network page. 2019-11-10 04:20:22 +01:00