 ThePendulum
|
94bf207397
|
Added Wicked network. Merged Evil Angel, XEmpire and Wicked into generic Gamma scraper.
|
2020-02-01 01:15:40 +01:00 |
|
ThePendulum
|
b7f51a8deb
|
Added avatar and actor releases to Bang Bros scraper.
|
2020-01-31 21:43:16 +01:00 |
|
ThePendulum
|
504bcd02e3
|
Added Naughty America profile and actor releases scraper.
|
2020-01-31 19:25:42 +01:00 |
|
ThePendulum
|
2fef4b4314
|
Fetching and returning releases for Evil Angel actors.
|
2020-01-31 00:39:49 +01:00 |
|
ThePendulum
|
3f113310e3
|
Added Trans Angels to MindGeek. Interpreting MindGeek 'other' gender as transsexual.
|
2020-01-31 00:25:51 +01:00 |
|
ThePendulum
|
c300d4d251
|
Added trailer support to Vogov. Set preferred trailer resolution to 480p. Added 480p and other resolution trailers support to XEmpire.
|
2020-01-30 03:53:54 +01:00 |
|
ThePendulum
|
ff61094b69
|
Added Men network and Icon Male to MindGeek. Added entropy filter to media module to help filter out generic avatars. Added Pure Taboo. Various logo updates.
|
2020-01-30 01:14:31 +01:00 |
|
ThePendulum
|
8b840f52d1
|
Added description property to LegalPorno scraper (rarely used, see GIO337).
|
2020-01-29 03:19:38 +01:00 |
|
ThePendulum
|
81ede3f511
|
Improved MindGeek avatar fix.
|
2020-01-29 02:31:55 +01:00 |
|
ThePendulum
|
fc675ae144
|
Added Metro HD network using MindGeek scraper. Fixed MindGeek profile scraper avatar issue.
|
2020-01-29 02:24:19 +01:00 |
|
ThePendulum
|
76852daf6d
|
Added VogoV (no trailer yet). Fixed MindGeek profile scraper.
|
2020-01-28 03:05:53 +01:00 |
|
ThePendulum
|
6d4fd5fd77
|
Added MindGeek profile scraper for all MG sites.
|
2020-01-27 22:54:14 +01:00 |
|
ThePendulum
|
32a0188b72
|
Fixed Boobpedia scraper. Catching non-OK responses for Vixen scraper.
|
2020-01-27 03:07:06 +01:00 |
|
ThePendulum
|
eca65f6b4d
|
Inspecting performance.
|
2020-01-27 00:41:04 +00:00 |
|
ThePendulum
|
bceded3ebd
|
Added gender indicator to actor tiles. Fixed PornHub scraper fetching default avatars.
|
2020-01-25 01:26:13 +01:00 |
|
ThePendulum
|
c93116dee2
|
Added actor expand button to profile.
|
2020-01-24 23:36:06 +01:00 |
|
ThePendulum
|
6ef5c82c6a
|
Added URL helper to q. Getting social links from Boobpedia.
|
2020-01-23 23:32:51 +01:00 |
|
ThePendulum
|
42d07e86f8
|
Context q methods can accept alternative element as first argument. Added BoobPedia profile scraper. Showing fake boobs icon again.
|
2020-01-23 22:45:46 +01:00 |
|
ThePendulum
|
9db0e97512
|
Improved actor profile flow. Added images.
|
2020-01-23 03:52:12 +01:00 |
|
ThePendulum
|
f8175f6054
|
Added generic Gamma photo and actor scraper for XEmpire, 21Sextury, Blowpass and Evil Angel.
|
2020-01-22 22:25:58 +01:00 |
|
ThePendulum
|
4e4323704a
|
Getting more and higher quality Vixen photos.
|
2020-01-18 23:10:31 +01:00 |
|
ThePendulum
|
daee426ba6
|
Removed site and tag matching from Dogfart scraper. Filtering duplicate tag associations before insert attempt.
|
2020-01-17 01:55:54 +01:00 |
|
ThePendulum
|
4074a5bb64
|
Added Mile High Media scraper.
|
2020-01-16 21:56:33 +01:00 |
|
ThePendulum
|
61fee5e4f6
|
Added q scraping helper. Added Perfect Gonzo scraper.
|
2020-01-16 21:04:44 +01:00 |
|
ThePendulum
|
5dda81535d
|
Added PornPros satellite sites.
|
2020-01-15 01:01:16 +01:00 |
|
ThePendulum
|
75c53d338a
|
Added Porn Pros sites and scraper.
|
2020-01-14 21:45:30 +01:00 |
|
ThePendulum
|
9255467091
|
Refactored MOFOS scraper to use generic MindGeek scraper. Added Digital Playground and Fake Hub.
|
2020-01-14 19:56:46 +01:00 |
|
ThePendulum
|
ef76909d3c
|
Merged Reality Kings and Babes into MindGeek scraper. Kept classic latest wrapper for Look At Her Now and Tranny Surprise.
|
2020-01-14 04:50:42 +01:00 |
|
ThePendulum
|
f5704451f8
|
Wrapping up
|
2020-01-14 01:51:18 +01:00 |
|
ThePendulum
|
8c76568f44
|
Added Babes network
|
2020-01-14 01:50:11 +01:00 |
|
ThePendulum
|
859cb7e1f3
|
Added support for Family Strokes.
|
2020-01-13 23:45:09 +01:00 |
|
ThePendulum
|
97cb4a061e
|
Added Team Skeet scraper.
|
2020-01-12 05:30:46 +01:00 |
|
ThePendulum
|
8f72e61928
|
Added Jay Rock network. Fixed site logo not showing up without URL.
|
2020-01-11 05:31:04 +01:00 |
|
ThePendulum
|
f572f38b5c
|
Added Jay's POV scraper.
|
2020-01-10 22:10:11 +01:00 |
|
ThePendulum
|
4b36de2f55
|
Fixed Evil Angel upcoming and actor association issues. Moving from console.log to logger.
|
2020-01-10 02:43:04 +01:00 |
|
ThePendulum
|
a773e0bf54
|
Added Manuel Ferrara site to Jules Jordan. Refactored Jules Jordan photo scraper for better compatability and quality.
|
2020-01-08 05:12:14 +01:00 |
|
ThePendulum
|
0a19f2e624
|
Added Bang! deep scrape. Improved network page layout. Added Bang Bros logos.
|
2020-01-07 04:23:28 +01:00 |
|
ThePendulum
|
bb5b8085f6
|
Added Bang! scraper. Showing studio on tile. Added favicons to tiles.
|
2020-01-06 05:19:38 +01:00 |
|
ThePendulum
|
70e27a6cd9
|
Moved networks to GraphQL.
|
2020-01-03 00:59:02 +01:00 |
|
ThePendulum
|
5a6bf2b42f
|
Further refactoring. Fixed actor pages and more.
|
2019-12-31 03:12:52 +01:00 |
|
ThePendulum
|
07a6c77ce2
|
Improvements, GrapQL experiments. Fixed Babel dependencies.
|
2019-12-15 22:16:55 +01:00 |
|
ThePendulum
|
7ba716cd6f
|
Experimenting using GraphQL in favor of REST.
|
2019-12-15 05:42:51 +01:00 |
|
ThePendulum
|
fed2b0be8a
|
When poster is not available during scraping, first photo is stored as poster; removed client-side fallback. Added screencap album fallback to Jules Jordan scraper. Simplified JJ page traversal.
|
2019-12-13 16:59:04 +01:00 |
|
ThePendulum
|
c998fcf933
|
Added photo album support to Blowpass scraper.
|
2019-12-13 05:04:04 +01:00 |
|
ThePendulum
|
e69b7744c8
|
Showing movie covers as poster when available.
|
2019-12-13 03:57:01 +01:00 |
|
ThePendulum
|
77307d2d13
|
Refactored media module to generalize avatar and poster storage into photo storage.
|
2019-12-13 03:28:52 +01:00 |
|
ThePendulum
|
a03a00f5d9
|
Added Sperm Swallowers and The Ass Factory to Jules Jordan scraper. Added photo source.
|
2019-12-12 05:18:43 +01:00 |
|
ThePendulum
|
0b819713b5
|
Fixed off-by-one in photo plucker. Fixed source duplicate photo function not handling fallback sources.
|
2019-12-12 04:04:35 +01:00 |
|
ThePendulum
|
a310f9bb1d
|
Added support for release photo fallbacks. Limited photo fetching concurrency. Modifier XEmpire scraper for AllBlackX support and improved photo scraping. Added movie property to Evil Angel scraper.
|
2019-12-12 03:12:05 +01:00 |
|
ThePendulum
|
b9af7255f6
|
Fixed release actor origin bug.
|
2019-12-11 05:15:23 +01:00 |
|
ThePendulum
|
18f37e3fbd
|
Moved all tag photos to public asset directory.
|
2019-12-11 02:25:25 +01:00 |
|
ThePendulum
|
b9bac6d8f9
|
Added Kelly Madison profile scraper.
|
2019-12-10 22:35:00 +01:00 |
|
ThePendulum
|
3956994580
|
Swapped poster and photo for Kelly Madison scraper.
|
2019-12-10 05:19:08 +01:00 |
|
ThePendulum
|
85e55eebaf
|
Added Kelly Madison Media (Teen Fidelity) release scraper.
|
2019-12-10 05:10:08 +01:00 |
|
ThePendulum
|
b6123b9418
|
Added source maps. Fixed DDFNetwork avatar and improved photo fetch error handling.
|
2019-12-10 00:30:55 +01:00 |
|
ThePendulum
|
04a89efa58
|
Refactored 21sextury scraper.
|
2019-12-09 05:00:49 +01:00 |
|
ThePendulum
|
30f4a418e3
|
Allowing scrapers to return multiple trailer qualities, implemented for Brazzers. Removed tag and site matching from Brazzers scraper.
|
2019-12-07 04:17:14 +01:00 |
|
ThePendulum
|
98b9c885ec
|
Added support for Reality Kings sites 'Look At Her Now' and 'Tranny Surprise'.
|
2019-12-07 00:42:47 +01:00 |
|
ThePendulum
|
7cb888801f
|
Updated Naughty America scraper, added media support..
|
2019-12-05 04:26:54 +01:00 |
|
ThePendulum
|
2697aaa0af
|
Removed release_date selection, not working as desired. Removed site and tag fetching from Kink scraper.
|
2019-12-05 01:33:57 +01:00 |
|
ThePendulum
|
71cb85c3e1
|
Allowing scrapers to return raw tags and site URLs or slugs, to gradually remove site and tag fetching from individual scrapers. Added media and deep fetchin support to Perv City scraper.
|
2019-12-05 01:26:22 +01:00 |
|
ThePendulum
|
bead69de49
|
Added basic actor and network overview. Added DDF Network actor scraper. Various bug fixes and layout improvements.
|
2019-11-30 05:55:32 +01:00 |
|
ThePendulum
|
0dbe853f39
|
Resolving actor birth and residence place before storage. Layout improvements.
|
2019-11-29 05:46:06 +01:00 |
|
ThePendulum
|
4be508b388
|
Drastic actor page redesign. Storing one avatar per actor, other profile photos as 'photo' role; no longer assuming first photo is avatar.
|
2019-11-28 05:36:22 +01:00 |
|
ThePendulum
|
d113123778
|
Fixed countries seed file. Updated MOFOS scraper. Improved Reality Kings scraper. Limiting photos for XEmpire scraper.
|
2019-11-27 04:58:38 +01:00 |
|
ThePendulum
|
31a8f1cac1
|
Improved profile scrapers. Sorting avatars on actor page by index.
|
2019-11-21 04:24:55 +01:00 |
|
ThePendulum
|
9224b441e2
|
Added Brazzers and Jules Jordan as profile sources. Changed profile structure for proper bust-waist-hip properties and improved stability.
|
2019-11-21 04:05:32 +01:00 |
|
ThePendulum
|
9fcc40dd17
|
Added avatars. Added PornHub and LegalPorno actor profile scrapers.
|
2019-11-20 04:53:36 +01:00 |
|
ThePendulum
|
3ec7b15886
|
Improved scraping and association behavior.
|
2019-11-19 04:36:15 +01:00 |
|
ThePendulum
|
e8130c3634
|
Scraping actor profiles from FreeOnes.
|
2019-11-17 03:56:45 +01:00 |
|
ThePendulum
|
bd041c528d
|
Fixed ID number/string incompatability in duplicate detection. Expanded Reality Kings scraper to handle older scenes and fix URLs.
|
2019-11-17 00:45:31 +01:00 |
|
ThePendulum
|
2857387441
|
Added bash CLI shorthand. Properly setting parameters in site results. Removed obsolete URL restriction from Reality Kings scraper.
|
2019-11-16 23:37:33 +01:00 |
|
ThePendulum
|
b489c8fc33
|
Major refactor, cleand up site scrape module, fixed and cleaned up release scrape module. Removed old CLI code
|
2019-11-16 03:33:36 +01:00 |
|
ThePendulum
|
5620dfcb65
|
Added filter bar to all pages. Added 'upcoming' marker. Improved date tidbit.
|
2019-11-15 05:10:59 +01:00 |
|
ThePendulum
|
bf223adc55
|
Redesigned release page. Added 'single site' marker, linking directly to network page. Fixed Dogfart scraper duration.
|
2019-11-14 05:13:38 +01:00 |
|
ThePendulum
|
117d669a69
|
Added Private Black, improved Private scraper to handle their non-private.com sites.
|
2019-11-14 00:00:29 +01:00 |
|
ThePendulum
|
f9f9cc7977
|
Added tag filter to releases query, enabled on homepage.
|
2019-11-13 03:14:24 +01:00 |
|
ThePendulum
|
832e96ced1
|
Improved site and network pages. Fixed various issues.
|
2019-11-12 01:22:20 +01:00 |
|
ThePendulum
|
681f1bca85
|
Added tag page. Added default 'anal' tag to Vixen scraper for Tushy and Tushy Raw.
|
2019-11-11 05:18:28 +01:00 |
|
ThePendulum
|
e9277028e2
|
Added Mike Adriano scraper (True Anal, All Anal, Swallowed, Nympho). Updated README.
|
2019-11-09 01:22:50 +01:00 |
|
ThePendulum
|
f8f6428e36
|
Added media support to Private scraper.
|
2019-11-05 01:41:13 +01:00 |
|
ThePendulum
|
c466d791f5
|
Removed upsert from store releases, observing effects; fixes ? inserted as . Removed query from stored Dogfart URLs.
|
2019-11-05 00:54:47 +01:00 |
|
ThePendulum
|
e4399380d3
|
Fixed photo plucker to prevent duplicate at end.
|
2019-11-04 06:04:43 +01:00 |
|
ThePendulum
|
5745cd33d8
|
Added Dogfart scraper. Added 'date added' property to release page.
|
2019-11-04 05:47:37 +01:00 |
|
ThePendulum
|
2198c7ceb0
|
Added media support to Bang Bros scraper. Added untracked files.
|
2019-10-31 01:53:26 +01:00 |
|
ThePendulum
|
382e40b651
|
Added studio support. Added studios for LegalPorno. Improved media fetch error handling. Fixed DDFNetwork scraper, added media support.
|
2019-10-30 04:45:42 +01:00 |
|
ThePendulum
|
ffe2564bb3
|
Added full photo album to Jules Jordan scraper.
|
2019-10-29 04:49:27 +01:00 |
|
ThePendulum
|
eb50af7b81
|
Added media support to Brazzers scraper.
|
2019-10-29 03:50:39 +01:00 |
|
ThePendulum
|
d5073a73ce
|
Added media support to XEmpire (HardX) scraper.
|
2019-10-29 03:13:56 +01:00 |
|
ThePendulum
|
a4d936523b
|
Added media to LegalPorno scraper.
|
2019-10-29 01:47:16 +01:00 |
|
ThePendulum
|
f7f5e8a306
|
Deriving transsexual tag from actors in Evil Angel scraper.
|
2019-10-28 02:12:11 +01:00 |
|
ThePendulum
|
2c32ed6549
|
Completed Evil Angel scraper. Added trans tags.
|
2019-09-28 03:26:04 +02:00 |
|
ThePendulum
|
298eabe56e
|
Improved Vixen and XEmpire scrapers. Added media to Blowpass scraper. Improved release fetch code.
|
2019-09-26 03:27:01 +02:00 |
|
ThePendulum
|
96d8cfbcb6
|
Improved media handling, added trailer support. Fetching media from Vixen network frontpages.
|
2019-09-25 04:52:58 +02:00 |
|
ThePendulum
|
b12d74cbb3
|
Fixed Vixen scraper, site restructured. Added Deeper to Vixen network.
|
2019-09-25 02:44:25 +02:00 |
|
ThePendulum
|
c78f7f957f
|
Merge branch 'master' of unknown.name:pendulum/traxxx
|
2019-09-25 01:38:21 +02:00 |
|
ThePendulum
|
05263a97ea
|
Scrolling content container instead of whole page. Improved title source in XEmpire scraper. Fixed scene page breaking when no photos are available.
|
2019-09-25 01:38:06 +02:00 |
 boiii
|
a9f64a82a2
|
Legalporno title scene ID fix
Old regex would fail on some videos
e.g.
Little Sofi Smile plays with two big cocks AF001
Whitney Wright Gets Punished by Two Big Black Cocks AB015
|
2019-09-23 18:32:47 +02:00 |
|
ThePendulum
|
cf4987ba48
|
Using media database for images.
|
2019-09-10 16:48:04 +02:00 |
|
ThePendulum
|
926c227b85
|
Refactored database to separate IDs from slugs
|
2019-09-08 03:53:09 +02:00 |