 ThePendulum
|
e5c6ccd252
|
Scraping upcoming Vixen scenes. Fetching release media groups sequentially to prevent collisions.
|
2020-02-22 04:37:48 +01:00 |
|
ThePendulum
|
349a5a506e
|
Queueing and batching media HTTP requests for improved reliability.
|
2020-02-22 03:22:30 +01:00 |
|
ThePendulum
|
7ac5a8e08c
|
Catching media failures per batch. Refined teaser logging.
|
2020-02-20 22:27:00 +01:00 |
|
ThePendulum
|
377970f874
|
Added parent-child relations to network, showing parent network in sidebar. Added Burning Angel using Gamma API.
|
2020-02-20 02:35:23 +01:00 |
|
ThePendulum
|
97f5e49187
|
Refactored media module. Returning 320p and 720p videos from MindGeek as teasers instead of trailers.
|
2020-02-19 04:41:53 +01:00 |
|
ThePendulum
|
40bf476ea6
|
Fixed Porn Pros scraper. Added various Score site logos.
|
2020-02-18 16:00:36 +01:00 |
|
ThePendulum
|
dd6a1d9bfd
|
Added Vivid network. Added ASMR Fantasy to Adult Time. Storing deep URL in database. Added href to header links.
|
2020-02-11 04:58:18 +01:00 |
|
ThePendulum
|
139f0ce7cb
|
Allowing release scrapers to return actor details. Added True Amateurs.
|
2020-02-09 23:25:54 +01:00 |
|
ThePendulum
|
0f513266a0
|
Added Black for Wife to JayRock. Switched parameters field to JSON type.
|
2020-02-09 19:41:39 +01:00 |
|
ThePendulum
|
1546e0836c
|
Split Girlsway from Adult Time. Added Fantasy Massage. Using Gamma scraper for Pure Taboo. Added photo path parameter to Gamma scraper.
|
2020-02-08 02:49:39 +01:00 |
|
ThePendulum
|
5ba308f07a
|
Added Adult Time. Adding context to logger.
|
2020-02-07 19:53:16 +01:00 |
|
ThePendulum
|
d4801bb240
|
Returning window.document instead of element as document from q. Fixed actor collisions when scrapers return same scene multiple times. Scraping all Score actor release pages. Fixed 21Sextury and PureTaboo photo scraping.
|
2020-02-05 23:57:55 +01:00 |
|
ThePendulum
|
f921bb4ae9
|
Generating and using URL slugs for releases, improver slugify module. Added 'extract' parameter to MindGeek scraper to get scenes not associate with a channel (see Digital Playground). Added various high res logos.
|
2020-02-04 03:12:09 +01:00 |
|
ThePendulum
|
a671190fff
|
Adapted Score scraper for Score Classics.
|
2020-02-03 02:04:47 +01:00 |
|
ThePendulum
|
a45bebddac
|
Adapter Score scraper for Score Videos.
|
2020-02-03 00:39:43 +01:00 |
|
ThePendulum
|
a97c6defca
|
Added teaser support. Added Score network with scraper for Scoreland. Improved q. Added assets.
|
2020-02-02 05:14:58 +01:00 |
|
ThePendulum
|
94bf207397
|
Added Wicked network. Merged Evil Angel, XEmpire and Wicked into generic Gamma scraper.
|
2020-02-01 01:15:40 +01:00 |
|
ThePendulum
|
345103d759
|
Fixed ;.
|
2020-01-27 01:54:42 +01:00 |
|
ThePendulum
|
eca65f6b4d
|
Inspecting performance.
|
2020-01-27 00:41:04 +00:00 |
|
ThePendulum
|
f8175f6054
|
Added generic Gamma photo and actor scraper for XEmpire, 21Sextury, Blowpass and Evil Angel.
|
2020-01-22 22:25:58 +01:00 |
|
ThePendulum
|
75c53d338a
|
Added Porn Pros sites and scraper.
|
2020-01-14 21:45:30 +01:00 |
|
ThePendulum
|
859cb7e1f3
|
Added support for Family Strokes.
|
2020-01-13 23:45:09 +01:00 |
|
ThePendulum
|
4b36de2f55
|
Fixed Evil Angel upcoming and actor association issues. Moving from console.log to logger.
|
2020-01-10 02:43:04 +01:00 |
|
ThePendulum
|
863df38b29
|
Simplified tag media seed file. Renamed tags. Media refactor experiment.
|
2020-01-08 23:33:24 +01:00 |
|
ThePendulum
|
4c28c8b640
|
Fixed duplicate query. Updated Jules Jordan logo's.
|
2020-01-08 19:23:50 +01:00 |
|
ThePendulum
|
0a19f2e624
|
Added Bang! deep scrape. Improved network page layout. Added Bang Bros logos.
|
2020-01-07 04:23:28 +01:00 |
|
ThePendulum
|
bb5b8085f6
|
Added Bang! scraper. Showing studio on tile. Added favicons to tiles.
|
2020-01-06 05:19:38 +01:00 |
|
ThePendulum
|
e77dbca954
|
Fixed actor data and avatar fetching and display.
|
2020-01-02 17:13:57 +01:00 |
|
ThePendulum
|
5a6bf2b42f
|
Further refactoring. Fixed actor pages and more.
|
2019-12-31 03:12:52 +01:00 |
|
ThePendulum
|
577c03f9b7
|
Fixed queries.
|
2019-12-15 23:46:42 +01:00 |
|
ThePendulum
|
ce92d13327
|
Fixed site fallback handling.
|
2019-12-15 23:14:43 +01:00 |
|
ThePendulum
|
07a6c77ce2
|
Improvements, GrapQL experiments. Fixed Babel dependencies.
|
2019-12-15 22:16:55 +01:00 |
|
ThePendulum
|
7ba716cd6f
|
Experimenting using GraphQL in favor of REST.
|
2019-12-15 05:42:51 +01:00 |
|
ThePendulum
|
fed2b0be8a
|
When poster is not available during scraping, first photo is stored as poster; removed client-side fallback. Added screencap album fallback to Jules Jordan scraper. Simplified JJ page traversal.
|
2019-12-13 16:59:04 +01:00 |
|
ThePendulum
|
c998fcf933
|
Added photo album support to Blowpass scraper.
|
2019-12-13 05:04:04 +01:00 |
|
ThePendulum
|
e69b7744c8
|
Showing movie covers as poster when available.
|
2019-12-13 03:57:01 +01:00 |
|
ThePendulum
|
77307d2d13
|
Refactored media module to generalize avatar and poster storage into photo storage.
|
2019-12-13 03:28:52 +01:00 |
|
ThePendulum
|
a310f9bb1d
|
Added support for release photo fallbacks. Limited photo fetching concurrency. Modifier XEmpire scraper for AllBlackX support and improved photo scraping. Added movie property to Evil Angel scraper.
|
2019-12-12 03:12:05 +01:00 |
|
ThePendulum
|
b9af7255f6
|
Fixed release actor origin bug.
|
2019-12-11 05:15:23 +01:00 |
|
ThePendulum
|
b9bac6d8f9
|
Added Kelly Madison profile scraper.
|
2019-12-10 22:35:00 +01:00 |
|
ThePendulum
|
04a89efa58
|
Refactored 21sextury scraper.
|
2019-12-09 05:00:49 +01:00 |
|
ThePendulum
|
222260d3cf
|
Generalized tags to allow them to be assigned to anything.
|
2019-12-07 04:41:16 +01:00 |
|
ThePendulum
|
c4d620c6ff
|
Refactored media module for better duplicate handling, readability and DRY.
|
2019-12-07 03:59:55 +01:00 |
|
ThePendulum
|
7cb888801f
|
Updated Naughty America scraper, added media support..
|
2019-12-05 04:26:54 +01:00 |
|
ThePendulum
|
2697aaa0af
|
Removed release_date selection, not working as desired. Removed site and tag fetching from Kink scraper.
|
2019-12-05 01:33:57 +01:00 |
|
ThePendulum
|
71cb85c3e1
|
Allowing scrapers to return raw tags and site URLs or slugs, to gradually remove site and tag fetching from individual scrapers. Added media and deep fetchin support to Perv City scraper.
|
2019-12-05 01:26:22 +01:00 |
|
ThePendulum
|
55e3130062
|
Move tag posters and photos to media database.
|
2019-12-04 21:58:08 +01:00 |
|
ThePendulum
|
9224b441e2
|
Added Brazzers and Jules Jordan as profile sources. Changed profile structure for proper bust-waist-hip properties and improved stability.
|
2019-11-21 04:05:32 +01:00 |
|
ThePendulum
|
9fcc40dd17
|
Added avatars. Added PornHub and LegalPorno actor profile scrapers.
|
2019-11-20 04:53:36 +01:00 |
|
ThePendulum
|
3ec7b15886
|
Improved scraping and association behavior.
|
2019-11-19 04:36:15 +01:00 |