ThePendulum
|
b03775fa07
|
Using generic slugify for MindGeek channel.
|
2020-02-29 05:00:50 +01:00 |
ThePendulum
|
a828fee476
|
Handling NULL actors and tags in search table query. Added limit parameter to home URL, default to 30.
|
2020-02-29 03:22:51 +01:00 |
ThePendulum
|
f1f33080f6
|
Ignoring undefined video entropy.
|
2020-02-28 03:56:58 +01:00 |
ThePendulum
|
3dc8547431
|
Added fake data and Markov experiments.
|
2020-02-27 05:44:24 +01:00 |
ThePendulum
|
3c30e9107a
|
Using dedicated releases search table for ts vector documents.
|
2020-02-26 22:33:15 +01:00 |
ThePendulum
|
915eb75719
|
Refactored Vixen scraper, using API endpoint and added actor profile and releases scraper. Release scraper will return base release when present and 'deep' argument is false.
|
2020-02-22 23:25:10 +01:00 |
ThePendulum
|
e5c6ccd252
|
Scraping upcoming Vixen scenes. Fetching release media groups sequentially to prevent collisions.
|
2020-02-22 04:37:48 +01:00 |
ThePendulum
|
349a5a506e
|
Queueing and batching media HTTP requests for improved reliability.
|
2020-02-22 03:22:30 +01:00 |
ThePendulum
|
7ac5a8e08c
|
Catching media failures per batch. Refined teaser logging.
|
2020-02-20 22:27:00 +01:00 |
ThePendulum
|
377970f874
|
Added parent-child relations to network, showing parent network in sidebar. Added Burning Angel using Gamma API.
|
2020-02-20 02:35:23 +01:00 |
ThePendulum
|
97f5e49187
|
Refactored media module. Returning 320p and 720p videos from MindGeek as teasers instead of trailers.
|
2020-02-19 04:41:53 +01:00 |
ThePendulum
|
40bf476ea6
|
Fixed Porn Pros scraper. Added various Score site logos.
|
2020-02-18 16:00:36 +01:00 |
ThePendulum
|
dd6a1d9bfd
|
Added Vivid network. Added ASMR Fantasy to Adult Time. Storing deep URL in database. Added href to header links.
|
2020-02-11 04:58:18 +01:00 |
ThePendulum
|
139f0ce7cb
|
Allowing release scrapers to return actor details. Added True Amateurs.
|
2020-02-09 23:25:54 +01:00 |
ThePendulum
|
0f513266a0
|
Added Black for Wife to JayRock. Switched parameters field to JSON type.
|
2020-02-09 19:41:39 +01:00 |
ThePendulum
|
1546e0836c
|
Split Girlsway from Adult Time. Added Fantasy Massage. Using Gamma scraper for Pure Taboo. Added photo path parameter to Gamma scraper.
|
2020-02-08 02:49:39 +01:00 |
ThePendulum
|
5ba308f07a
|
Added Adult Time. Adding context to logger.
|
2020-02-07 19:53:16 +01:00 |
ThePendulum
|
d4801bb240
|
Returning window.document instead of element as document from q. Fixed actor collisions when scrapers return same scene multiple times. Scraping all Score actor release pages. Fixed 21Sextury and PureTaboo photo scraping.
|
2020-02-05 23:57:55 +01:00 |
ThePendulum
|
f921bb4ae9
|
Generating and using URL slugs for releases, improver slugify module. Added 'extract' parameter to MindGeek scraper to get scenes not associate with a channel (see Digital Playground). Added various high res logos.
|
2020-02-04 03:12:09 +01:00 |
ThePendulum
|
a671190fff
|
Adapted Score scraper for Score Classics.
|
2020-02-03 02:04:47 +01:00 |
ThePendulum
|
a45bebddac
|
Adapter Score scraper for Score Videos.
|
2020-02-03 00:39:43 +01:00 |
ThePendulum
|
a97c6defca
|
Added teaser support. Added Score network with scraper for Scoreland. Improved q. Added assets.
|
2020-02-02 05:14:58 +01:00 |
ThePendulum
|
94bf207397
|
Added Wicked network. Merged Evil Angel, XEmpire and Wicked into generic Gamma scraper.
|
2020-02-01 01:15:40 +01:00 |
ThePendulum
|
345103d759
|
Fixed ;.
|
2020-01-27 01:54:42 +01:00 |
ThePendulum
|
eca65f6b4d
|
Inspecting performance.
|
2020-01-27 00:41:04 +00:00 |
ThePendulum
|
f8175f6054
|
Added generic Gamma photo and actor scraper for XEmpire, 21Sextury, Blowpass and Evil Angel.
|
2020-01-22 22:25:58 +01:00 |
ThePendulum
|
75c53d338a
|
Added Porn Pros sites and scraper.
|
2020-01-14 21:45:30 +01:00 |
ThePendulum
|
859cb7e1f3
|
Added support for Family Strokes.
|
2020-01-13 23:45:09 +01:00 |
ThePendulum
|
4b36de2f55
|
Fixed Evil Angel upcoming and actor association issues. Moving from console.log to logger.
|
2020-01-10 02:43:04 +01:00 |
ThePendulum
|
863df38b29
|
Simplified tag media seed file. Renamed tags. Media refactor experiment.
|
2020-01-08 23:33:24 +01:00 |
ThePendulum
|
4c28c8b640
|
Fixed duplicate query. Updated Jules Jordan logo's.
|
2020-01-08 19:23:50 +01:00 |
ThePendulum
|
0a19f2e624
|
Added Bang! deep scrape. Improved network page layout. Added Bang Bros logos.
|
2020-01-07 04:23:28 +01:00 |
ThePendulum
|
bb5b8085f6
|
Added Bang! scraper. Showing studio on tile. Added favicons to tiles.
|
2020-01-06 05:19:38 +01:00 |
ThePendulum
|
e77dbca954
|
Fixed actor data and avatar fetching and display.
|
2020-01-02 17:13:57 +01:00 |
ThePendulum
|
5a6bf2b42f
|
Further refactoring. Fixed actor pages and more.
|
2019-12-31 03:12:52 +01:00 |
ThePendulum
|
577c03f9b7
|
Fixed queries.
|
2019-12-15 23:46:42 +01:00 |
ThePendulum
|
ce92d13327
|
Fixed site fallback handling.
|
2019-12-15 23:14:43 +01:00 |
ThePendulum
|
07a6c77ce2
|
Improvements, GrapQL experiments. Fixed Babel dependencies.
|
2019-12-15 22:16:55 +01:00 |
ThePendulum
|
7ba716cd6f
|
Experimenting using GraphQL in favor of REST.
|
2019-12-15 05:42:51 +01:00 |
ThePendulum
|
fed2b0be8a
|
When poster is not available during scraping, first photo is stored as poster; removed client-side fallback. Added screencap album fallback to Jules Jordan scraper. Simplified JJ page traversal.
|
2019-12-13 16:59:04 +01:00 |
ThePendulum
|
c998fcf933
|
Added photo album support to Blowpass scraper.
|
2019-12-13 05:04:04 +01:00 |
ThePendulum
|
e69b7744c8
|
Showing movie covers as poster when available.
|
2019-12-13 03:57:01 +01:00 |
ThePendulum
|
77307d2d13
|
Refactored media module to generalize avatar and poster storage into photo storage.
|
2019-12-13 03:28:52 +01:00 |
ThePendulum
|
a310f9bb1d
|
Added support for release photo fallbacks. Limited photo fetching concurrency. Modifier XEmpire scraper for AllBlackX support and improved photo scraping. Added movie property to Evil Angel scraper.
|
2019-12-12 03:12:05 +01:00 |
ThePendulum
|
b9af7255f6
|
Fixed release actor origin bug.
|
2019-12-11 05:15:23 +01:00 |
ThePendulum
|
b9bac6d8f9
|
Added Kelly Madison profile scraper.
|
2019-12-10 22:35:00 +01:00 |
ThePendulum
|
04a89efa58
|
Refactored 21sextury scraper.
|
2019-12-09 05:00:49 +01:00 |
ThePendulum
|
222260d3cf
|
Generalized tags to allow them to be assigned to anything.
|
2019-12-07 04:41:16 +01:00 |
ThePendulum
|
c4d620c6ff
|
Refactored media module for better duplicate handling, readability and DRY.
|
2019-12-07 03:59:55 +01:00 |
ThePendulum
|
7cb888801f
|
Updated Naughty America scraper, added media support..
|
2019-12-05 04:26:54 +01:00 |
ThePendulum
|
2697aaa0af
|
Removed release_date selection, not working as desired. Removed site and tag fetching from Kink scraper.
|
2019-12-05 01:33:57 +01:00 |
ThePendulum
|
71cb85c3e1
|
Allowing scrapers to return raw tags and site URLs or slugs, to gradually remove site and tag fetching from individual scrapers. Added media and deep fetchin support to Perv City scraper.
|
2019-12-05 01:26:22 +01:00 |
ThePendulum
|
55e3130062
|
Move tag posters and photos to media database.
|
2019-12-04 21:58:08 +01:00 |
ThePendulum
|
9224b441e2
|
Added Brazzers and Jules Jordan as profile sources. Changed profile structure for proper bust-waist-hip properties and improved stability.
|
2019-11-21 04:05:32 +01:00 |
ThePendulum
|
9fcc40dd17
|
Added avatars. Added PornHub and LegalPorno actor profile scrapers.
|
2019-11-20 04:53:36 +01:00 |
ThePendulum
|
3ec7b15886
|
Improved scraping and association behavior.
|
2019-11-19 04:36:15 +01:00 |
ThePendulum
|
e8130c3634
|
Scraping actor profiles from FreeOnes.
|
2019-11-17 03:56:45 +01:00 |
ThePendulum
|
bd041c528d
|
Fixed ID number/string incompatability in duplicate detection. Expanded Reality Kings scraper to handle older scenes and fix URLs.
|
2019-11-17 00:45:31 +01:00 |
ThePendulum
|
b489c8fc33
|
Major refactor, cleand up site scrape module, fixed and cleaned up release scrape module. Removed old CLI code
|
2019-11-16 03:33:36 +01:00 |
ThePendulum
|
0575dbc7e4
|
Generalized filters bar, added to network page.
|
2019-11-15 02:37:17 +01:00 |
ThePendulum
|
1c3f17ec82
|
Added timerange filters. Refactored releases module for more efficient queries.
|
2019-11-15 01:27:58 +01:00 |
ThePendulum
|
bf223adc55
|
Redesigned release page. Added 'single site' marker, linking directly to network page. Fixed Dogfart scraper duration.
|
2019-11-14 05:13:38 +01:00 |
ThePendulum
|
f9f9cc7977
|
Added tag filter to releases query, enabled on homepage.
|
2019-11-13 03:14:24 +01:00 |
ThePendulum
|
832e96ced1
|
Improved site and network pages. Fixed various issues.
|
2019-11-12 01:22:20 +01:00 |
ThePendulum
|
681f1bca85
|
Added tag page. Added default 'anal' tag to Vixen scraper for Tushy and Tushy Raw.
|
2019-11-11 05:18:28 +01:00 |
ThePendulum
|
a9b91ff76c
|
Added actors page. Added site logos with overview on network page.
|
2019-11-10 04:20:22 +01:00 |
ThePendulum
|
82c9bc664a
|
Added network page and sites back-end. Split release tiles into own component.
|
2019-11-09 04:43:58 +01:00 |
ThePendulum
|
e9277028e2
|
Added Mike Adriano scraper (True Anal, All Anal, Swallowed, Nympho). Updated README.
|
2019-11-09 01:22:50 +01:00 |
ThePendulum
|
5745cd33d8
|
Added Dogfart scraper. Added 'date added' property to release page.
|
2019-11-04 05:47:37 +01:00 |
ThePendulum
|
382e40b651
|
Added studio support. Added studios for LegalPorno. Improved media fetch error handling. Fixed DDFNetwork scraper, added media support.
|
2019-10-30 04:45:42 +01:00 |
ThePendulum
|
0e784a274f
|
Reworked tag matching. Added tag filter groundwork.
|
2019-10-28 00:58:54 +01:00 |
ThePendulum
|
96d8cfbcb6
|
Improved media handling, added trailer support. Fetching media from Vixen network frontpages.
|
2019-09-25 04:52:58 +02:00 |
ThePendulum
|
cf4987ba48
|
Using media database for images.
|
2019-09-10 16:48:04 +02:00 |
ThePendulum
|
f2a6b58370
|
Added release page with photo viewer. Added photo count to database. Improved styling.
|
2019-07-06 05:29:12 +02:00 |
ThePendulum
|
b8aa81b3f1
|
Transitioning to Vue. Installed environment and restored homepage scene overview.
|
2019-06-03 05:31:38 +02:00 |
ThePendulum
|
fda6d1e475
|
Added release page.
|
2019-05-19 01:34:08 +02:00 |
ThePendulum
|
e3558fc0c5
|
Using grid layout with thumbnails.
|
2019-05-08 05:50:13 +02:00 |
ThePendulum
|
8eb2dcfd89
|
Storing and fetching tags.
|
2019-05-06 23:41:38 +02:00 |
ThePendulum
|
3df5a821b6
|
Saving results to database. Showing webpage.
|
2019-05-06 02:01:57 +02:00 |