DebaucheryLibrarian
|
53b0101a12
|
Added new Naughty America sites.
|
2020-08-26 23:59:29 +02:00 |
DebaucheryLibrarian
|
8611d738b0
|
Using UTC to query date ranges. Removed stray console log from MindGeek scraper.
|
2020-08-26 02:01:38 +02:00 |
DebaucheryLibrarian
|
52f66e7982
|
Fixed undefined location in FreeOnes scraper.
|
2020-08-24 18:24:07 +02:00 |
DebaucheryLibrarian
|
7fed5b7138
|
Moved Brazzers to MindGeek scraper to support new site.
|
2020-08-24 05:13:34 +02:00 |
DebaucheryLibrarian
|
d8b8dfa299
|
Not creating batch ID when no movies are to be stored.
|
2020-08-23 03:41:29 +02:00 |
DebaucheryLibrarian
|
c3d771c8fc
|
Hush scraper uses children from entity argument for filter regexp, instead of making its own database request.
|
2020-08-23 03:31:37 +02:00 |
DebaucheryLibrarian
|
278b74e78c
|
Providing duplicate releases in predata. Using duplicates for filtering scenes without channel in Hush scraper.
|
2020-08-23 02:43:10 +02:00 |
DebaucheryLibrarian
|
3a5ea3dd9a
|
Returning duplicate releases from pagination.
|
2020-08-22 04:22:56 +02:00 |
DebaucheryLibrarian
|
5f5c48ea05
|
Fixed pagination behavior for upcoming scenes.
|
2020-08-22 01:57:23 +02:00 |
DebaucheryLibrarian
|
7c052fedfc
|
Fixed map error.
|
2020-08-22 00:28:22 +02:00 |
DebaucheryLibrarian
|
1c17cd1be5
|
Improved update scrape pagination and limits.
|
2020-08-21 03:55:51 +02:00 |
DebaucheryLibrarian
|
4ec89e2cc8
|
Added upcoming, profile and detailed scene actor scraping to InTheCrack. Fixed clip upsert.
|
2020-08-20 23:35:18 +02:00 |
DebaucheryLibrarian
|
501e764c21
|
Renamed chapters to clips. Fixed Vixen trailers.
|
2020-08-20 19:52:02 +02:00 |
DebaucheryLibrarian
|
2835c66694
|
Added chapters and shoot location. Added In The Crack.
|
2020-08-20 04:57:38 +02:00 |
DebaucheryLibrarian
|
fd4477bc50
|
Improved 'new' sorting.
|
2020-08-19 21:48:55 +02:00 |
DebaucheryLibrarian
|
e896d52968
|
Added separate task queue for video streams to prevent ffmpeg overstressing the CPU. Fixed entity parent in scene REST API.
|
2020-08-17 15:53:20 +02:00 |
DebaucheryLibrarian
|
b3435c97c3
|
Added footer and basic stats page.
|
2020-08-15 19:04:33 +02:00 |
DebaucheryLibrarian
|
d7974f057f
|
Fixed scene tile detail word wrap. Fixed Score posters.
|
2020-08-15 02:05:35 +02:00 |
DebaucheryLibrarian
|
50c5f921f5
|
Using new bulk insert utility for releases, media and actors.
|
2020-08-14 23:21:53 +02:00 |
DebaucheryLibrarian
|
e996a45bf5
|
Added new bulk upsert utility.
|
2020-08-14 23:05:25 +02:00 |
DebaucheryLibrarian
|
b3f784686f
|
Improved entity provision behavior.
|
2020-08-14 00:32:59 +02:00 |
DebaucheryLibrarian
|
77566eae0d
|
Fixed and documented entity configuration and query.
|
2020-08-13 23:59:54 +02:00 |
DebaucheryLibrarian
|
59e2124407
|
Removed type property from scenes API.
|
2020-08-13 16:10:58 +02:00 |
DebaucheryLibrarian
|
f8c9b69f4b
|
Allowing --actors-update to be used without --actors.
|
2020-08-12 21:04:38 +02:00 |
DebaucheryLibrarian
|
d14034d38b
|
Defauling --actors-update to 1900-01-01
|
2020-08-12 21:00:50 +02:00 |
DebaucheryLibrarian
|
7413d7db25
|
Improved and documented actor profile scraping.
|
2020-08-12 20:51:08 +02:00 |
DebaucheryLibrarian
|
5cabeed19d
|
Modularized release component between movie and scene. Added Kink Classics channel.
|
2020-08-12 03:30:20 +02:00 |
DebaucheryLibrarian
|
40aed1086f
|
Showing actors, tags and date on movie tiles.
|
2020-08-10 21:39:55 +02:00 |
DebaucheryLibrarian
|
a7d5bef93f
|
Filtering undefined scenes property from movies. Added movie page scraper to Elegant Angel.
|
2020-08-08 18:10:59 +02:00 |
DebaucheryLibrarian
|
b4f0501765
|
Scraping from Cherry Pimps when available. Showing cover in movie tile.
|
2020-08-02 03:44:14 +02:00 |
DebaucheryLibrarian
|
767437d9aa
|
Added movie tile. Fixed actor header. Larger breakpoint for nav menu.
|
2020-08-01 15:11:07 +02:00 |
DebaucheryLibrarian
|
6c5a62353c
|
Moved movies to separate table.
|
2020-07-25 03:44:19 +02:00 |
DebaucheryLibrarian
|
bfd54e94e7
|
Improved Team Skeet profile scraper.
|
2020-07-23 21:00:16 +02:00 |
DebaucheryLibrarian
|
747c2e1637
|
Checking nationality against alpha2 and alpha2. Improved Team Skeet profile scraper.
|
2020-07-23 04:39:12 +02:00 |
DebaucheryLibrarian
|
23e4f87af0
|
Added profile scraping and Hoby Buchanon to Team Skeet.
|
2020-07-23 04:29:46 +02:00 |
DebaucheryLibrarian
|
9ef5ea8fb6
|
Added the awkward pagination to PornCZ scraper.
|
2020-07-23 00:55:55 +02:00 |
DebaucheryLibrarian
|
46c6c4dd21
|
Added PornCZ.
|
2020-07-22 04:12:20 +02:00 |
DebaucheryLibrarian
|
9d89a38490
|
Added actor page scene thumbnails to Hitzefrei scraper.
|
2020-07-21 04:10:16 +02:00 |
DebaucheryLibrarian
|
d56da74168
|
Added Hitzefrei. Fixed date averaging.
|
2020-07-21 04:04:07 +02:00 |
DebaucheryLibrarian
|
dff4d15872
|
Updated profile scrapers to use base actor instead of actor name. Fixes for Reality Kings and Cherry Pimps scrapers.
|
2020-07-21 01:44:51 +02:00 |
DebaucheryLibrarian
|
939eba8e61
|
Changed qu's HTML element detection. Passing base actor instead of actorName to profile scrapers.
|
2020-07-21 01:16:26 +02:00 |
DebaucheryLibrarian
|
5291a87587
|
Added 'clear all' button to tag filter. Tag name never removes tag. Added actor scene scraping to LegalPorno.
|
2020-07-19 19:40:21 +02:00 |
DebaucheryLibrarian
|
689c701f34
|
Various tag photos.
|
2020-07-18 05:12:32 +02:00 |
DebaucheryLibrarian
|
a3d281192d
|
Reordered scraper arguments. Fixed Jules Jordan scraper for Amateur Allure.
|
2020-07-17 23:27:59 +02:00 |
DebaucheryLibrarian
|
f59e809713
|
Added experimental movie page scraping with Elegant Angel.
|
2020-07-17 04:33:05 +02:00 |
DebaucheryLibrarian
|
a88c2f0760
|
Added m3u8 stream support to media module. Added Elegant Angel. Added regex parameter to qu's number method. Various tags.
|
2020-07-17 03:39:13 +02:00 |
DebaucheryLibrarian
|
66d6322c1d
|
Updated GraphQL queries to Datetime. Updated template to latest guideline.
|
2020-07-16 15:55:03 +02:00 |
DebaucheryLibrarian
|
6adfded074
|
Refactored Mike Adriano scraper. Changed logo and favicon. Added style methods to qu.
|
2020-07-16 03:47:07 +02:00 |
DebaucheryLibrarian
|
5b886b3917
|
Improved actor extraction for fcuk scraper. Changed 'copyright' to 'credit'. Redused entity page favicon size.
|
2020-07-15 05:12:29 +02:00 |
DebaucheryLibrarian
|
c62df2228b
|
Added scraper for FCUK's coed sites.
|
2020-07-15 04:51:39 +02:00 |
DebaucheryLibrarian
|
17b3ba1272
|
Added partial 'fcuk' (Exploited College Girls) scraper. Added file parameter for actor names and scene URLs.
|
2020-07-15 03:24:47 +02:00 |
DebaucheryLibrarian
|
90fc7a0d9d
|
Fixed Kink profile scraper returning partial matches. Removed parent from BAM Visions and Vogov.
|
2020-07-14 21:21:27 +02:00 |
DebaucheryLibrarian
|
74b15aa8e9
|
Added 5K Porn and 5K Teens.
|
2020-07-14 04:36:14 +02:00 |
DebaucheryLibrarian
|
b7be97fcf9
|
Added Amateur Euro, For Bondage, Mamacitaz, TransBella and VIP Sex Vault. Refactored Kelly Madison scraper using qu, fixed trailers and improved reliability.
|
2020-07-14 03:46:31 +02:00 |
ThePendulum
|
1eab3be7f6
|
Added Lets Doe It scraper. Added timestamp matching to qu's duration method.
|
2020-07-13 03:51:17 +02:00 |
ThePendulum
|
6fd2bc2687
|
Added Kink profile scraper. Fixed --force causing media collisions.
|
2020-07-13 00:12:01 +02:00 |
ThePendulum
|
a7707b7b28
|
Merged DDF Network with Porn World. Fixed and updated DDF/PW scraper.
|
2020-07-12 22:36:53 +02:00 |
ThePendulum
|
70c60e93ac
|
Scraping Perv City updates to network entity.
|
2020-07-12 05:25:27 +02:00 |
ThePendulum
|
9c8cfe3bdb
|
Re-wrote broken Perv City scraper, added profile scraping.
|
2020-07-12 05:10:23 +02:00 |
ThePendulum
|
e8c55512e2
|
Added image processing options to media module. Cropping Killergram avatars. Overwriting images when --force is used.
|
2020-07-10 03:42:08 +02:00 |
ThePendulum
|
4c551cc15f
|
Fixed pagination for Killergram, added pagination to actor profiles, added Killergram Platinum. Added experimental m3u8 stream support.
|
2020-07-10 02:01:23 +02:00 |
ThePendulum
|
a013d73400
|
Added Killergram.
|
2020-07-09 04:31:27 +02:00 |
ThePendulum
|
44a8ced30c
|
Separated actor expand buttons. Refactored Brazzers scraper. Fixed actor releases not included in shallow scrape. Added number query and data-src default to qu img. Updated README. Removed post-install migrate and seed.
|
2020-07-09 02:00:54 +02:00 |
ThePendulum
|
17d46e804e
|
Updated tag photos.
|
2020-07-08 04:58:12 +02:00 |
ThePendulum
|
9e5d3aa139
|
Added 'visible' property to entities. Added various Teen Core Club logos.
|
2020-07-08 02:53:46 +02:00 |
ThePendulum
|
0fd1edd8fd
|
Added Teen Core Club profile scraper. Added all TCC channels. Added various TCC logos.
|
2020-07-07 04:37:12 +02:00 |
ThePendulum
|
abe7de5701
|
Added scene scraping to Teen Core Club.
|
2020-07-06 04:13:48 +02:00 |
ThePendulum
|
f4ef2d4cc2
|
Auto-shrinking pagination. Various Teen Core Club curations.
|
2020-07-05 04:10:35 +02:00 |
ThePendulum
|
c47fae3a1b
|
Setting composed title as page title. Using Teen Core Club title if it isn't shoot ID.
|
2020-07-03 04:42:20 +02:00 |
ThePendulum
|
48a127409e
|
Added date precision. Added Teen Core Club update scraper.
|
2020-07-03 04:12:56 +02:00 |
ThePendulum
|
945c2c45ce
|
Updated tag page layout. Added shoot date property. Showing parent favicon on compact entity page. Re-added 'new' indicator on tile. Added Family Sinner to Mile High Media. Various fixes and improvements.
|
2020-07-03 01:28:22 +02:00 |
ThePendulum
|
749864e922
|
Added 'independent' property for network-like channels. Changed release tile design. Adding Brazzers timeline events as tags. Added Property Sex to MindGeek. Changed DP, DAP and DVP tag slugs. Changed Porn Pros logo. Added better BAM Visions and Mug Fucked logos.
|
2020-07-02 04:04:28 +02:00 |
ThePendulum
|
1f444e58ce
|
Allowing image sources to specify queue method. Using 5s queue for Whale Member to avoid CDN time-outs.
|
2020-07-01 04:47:05 +02:00 |
ThePendulum
|
53870fda89
|
Improved release detail bar behavior.
|
2020-07-01 00:25:27 +02:00 |
ThePendulum
|
ff384fb734
|
Fixed search documents to coalesce empty parent entities.
|
2020-06-30 01:52:17 +02:00 |
ThePendulum
|
98c19b560f
|
Updated mindgeek scraper for entities. Various fixes.
|
2020-06-28 22:29:18 +02:00 |
ThePendulum
|
3462d7af2a
|
Entity refactor. Facilitating channels without parent.
|
2020-06-28 00:15:13 +02:00 |
ThePendulum
|
af56378ee2
|
Refactored various modules for entities. Updated and refactored Kink scraper.
|
2020-06-27 02:57:30 +02:00 |
ThePendulum
|
4959dfd14f
|
Refactored deep and store modules to use entities.
|
2020-06-25 02:26:25 +02:00 |
ThePendulum
|
f0a89df6ab
|
Refactoring to use entities over sites and networks.
|
2020-06-17 04:07:24 +02:00 |
ThePendulum
|
1907ce1e54
|
Changed sites from argument query to group by network.
|
2020-06-15 03:58:35 +02:00 |
ThePendulum
|
79465d9634
|
Added Teen Core Club. Changed network to entity in GraphQL query.
|
2020-06-08 03:41:12 +02:00 |
ThePendulum
|
09d849eb9d
|
Adding networks and sites as entities,
|
2020-06-04 01:03:02 +02:00 |
ThePendulum
|
8abcc7194a
|
Updated Full Porn Network scraper.
|
2020-05-29 22:43:03 +02:00 |
ThePendulum
|
88a88227c4
|
Applying tag filters to URL.
|
2020-05-27 01:40:10 +02:00 |
ThePendulum
|
86377fec5f
|
Enabled pagination on network page.
|
2020-05-26 04:11:29 +02:00 |
ThePendulum
|
9843023c1f
|
Added Filthy Family and 'legacy' scraper to Bang Bros. Added trans generic avatar. Added pagination support to site actions.
|
2020-05-24 03:54:29 +02:00 |
ThePendulum
|
75d49517b7
|
Added pagination to actor overview. Lazy loading actor avatars. Reduced hash digest length.
|
2020-05-23 04:32:50 +02:00 |
ThePendulum
|
2fcd426b49
|
Added basic pagination to homepage.
|
2020-05-22 04:32:16 +02:00 |
ThePendulum
|
f38be7a706
|
Added components.
|
2020-05-22 00:55:11 +02:00 |
ThePendulum
|
532a4b679b
|
Using batch insert for profiles to prevent errors on large inserts.
|
2020-05-21 03:44:44 +02:00 |
ThePendulum
|
703b77897d
|
Added actor scenes to deep fetch sources.
|
2020-05-20 03:03:42 +02:00 |
ThePendulum
|
7275fb10e3
|
Improved Gamma scraper for (XEmpire) actors.
|
2020-05-20 03:00:46 +02:00 |
ThePendulum
|
b1b7cd6d50
|
Fixed Whale Member posters and photos.
|
2020-05-20 02:23:45 +02:00 |
ThePendulum
|
b6691e1991
|
Added release type distinction to REST API.
|
2020-05-20 01:38:58 +02:00 |
ThePendulum
|
057362d011
|
Added basic release and actor API.
|
2020-05-20 01:11:32 +02:00 |
ThePendulum
|
6973d39cbd
|
Replacing one or multiple space-like characters with single space in actor description. Using logo thumbnails in descriptions.
|
2020-05-19 05:06:01 +02:00 |
ThePendulum
|
c0898b84d6
|
Showing all unique descriptions on profile with network logo. Fixed Fame Digital scraper.
|
2020-05-19 04:46:49 +02:00 |
ThePendulum
|
9883c3d9c2
|
Not scraping existing actor profiles unless --force is used.
|
2020-05-19 02:02:48 +02:00 |
ThePendulum
|
0c4628677f
|
Fixed profile location interpolation. Generalizing ethnicity, hair color and eye color.
|
2020-05-19 01:10:32 +02:00 |
ThePendulum
|
4826ae8571
|
Added oil tag. Removed Fame Digital from profile config.
|
2020-05-18 04:28:38 +02:00 |
ThePendulum
|
003e07491d
|
Added network to profile context when site is available.
|
2020-05-18 03:34:41 +02:00 |
ThePendulum
|
885aa4f627
|
Passing context object with site or network instead of scraper slug and 'site or network' to all profile scrapers.
|
2020-05-18 03:22:03 +02:00 |
ThePendulum
|
8733fdc657
|
Improved actor scraping and display.
|
2020-05-18 01:22:56 +02:00 |
ThePendulum
|
af5543190a
|
Showing avatar on release actor tile. Fixed social URL validation.
|
2020-05-17 05:24:46 +02:00 |
ThePendulum
|
61965d480c
|
Added birthday to Bang actor scraper.
|
2020-05-17 05:08:41 +02:00 |
ThePendulum
|
f42ca7bd52
|
Added Bang! actor scraper. Fixed date interpolation. Showing date and age of death on profile (only if actor has already died).
|
2020-05-17 04:59:09 +02:00 |
ThePendulum
|
7f86399033
|
Fixed averaging interpolating function.
|
2020-05-17 03:04:58 +02:00 |
ThePendulum
|
985ab9d2dc
|
Added profile interpolation.
|
2020-05-17 03:00:44 +02:00 |
ThePendulum
|
05ee57378a
|
Storing actor avatars. Using 1 second interval queue for location resolve as per OSM code of conduct.
|
2020-05-16 04:36:45 +02:00 |
ThePendulum
|
21d4dd6bfa
|
Scraping and storing actor profiles.
|
2020-05-15 04:40:59 +02:00 |
ThePendulum
|
11eb66f834
|
Switched to tabs. Adding missing actor entries when scraping actors, with batch ID.
|
2020-05-14 04:26:05 +02:00 |
ThePendulum
|
f1eb29c713
|
Added thumb and lazy image scripts. Added FreeOnes and Boobpedia as sites.
|
2020-05-13 23:17:39 +02:00 |
ThePendulum
|
dac451bb86
|
Using alias actor ID when available. Using basic SVG flags instead of PNG. Moved PNG and HD SVG flags to assets.
|
2020-05-13 20:27:06 +02:00 |
ThePendulum
|
6040a3f41f
|
Associating actors without network.
|
2020-05-13 02:56:20 +02:00 |
ThePendulum
|
525995615a
|
Changed range toggles to links for home and actor pages.
|
2020-05-07 03:20:51 +02:00 |
ThePendulum
|
2b2fb9e3e7
|
Removed memory usage logs.
|
2020-05-07 02:16:20 +02:00 |
ThePendulum
|
c410294022
|
Added lazy-loading to release tile posters.
|
2020-05-07 02:10:28 +02:00 |
ThePendulum
|
af9d8f7858
|
Drastically improved memory performance media module using streams and temp files.
|
2020-05-07 01:53:07 +02:00 |
ThePendulum
|
79c7847f1c
|
Preserving aspect ratio on release tiles.
|
2020-04-27 04:00:16 +02:00 |
ThePendulum
|
f684923a8a
|
Actor tiles maintain aspect ratio.
|
2020-04-27 02:37:30 +02:00 |
ThePendulum
|
a223f933ce
|
Added 2 minute timeout to media fetch.
|
2020-04-26 04:21:57 +02:00 |
ThePendulum
|
2ac879d276
|
Fixed Vixen scraper, using new token URL for trailers.
|
2020-04-26 03:51:59 +02:00 |
ThePendulum
|
2cfbd21560
|
Adding media streaming experiments.
|
2020-04-20 23:52:37 +02:00 |
ThePendulum
|
4b26f8f476
|
Added covers to media module. Fixed 'New' sorting for all pages.
|
2020-04-16 22:54:07 +02:00 |
ThePendulum
|
3b2bf921f3
|
Replaced batch ranges with 'New' sorting.
|
2020-04-16 22:23:25 +02:00 |
ThePendulum
|
e3dfaf4440
|
Staging release media store by role.
|
2020-04-16 16:24:59 +02:00 |
ThePendulum
|
fc58850e56
|
Added media limit sampling.
|
2020-04-11 22:49:37 +02:00 |
ThePendulum
|
cb68319ac0
|
Added lazy loading to tag photos. Changed tag thumb location.
|
2020-04-08 14:50:43 +02:00 |
ThePendulum
|
c39bfb234d
|
Blurring video when paused in SFW mode.
|
2020-04-02 02:23:54 +02:00 |
ThePendulum
|
ad7874649f
|
Added self hash filtering to media module. Moved Girl Girl back to Jules Jordan.
|
2020-04-02 01:10:50 +02:00 |
ThePendulum
|
9a712e7371
|
Media module saves files.
|
2020-03-31 04:05:31 +02:00 |
ThePendulum
|
4eaacf5697
|
Expanded new media module. Added network to channel site to fix actor glitch.
|
2020-03-30 03:01:08 +02:00 |
ThePendulum
|
a5d859471d
|
Added Jesse Loads Monster Facials. Added various logos.
|
2020-03-29 23:42:41 +02:00 |
ThePendulum
|
93d4f0ff1a
|
Added WIP media module. Returning releases from release search database function. Fixed page loop in update module.
|
2020-03-29 04:00:46 +02:00 |
ThePendulum
|
6d9f96c5d5
|
Improved duplicate filtering, now also applying to upcoming updates. Updated Gamma fetchLatest method parameters. Added shortcut for SFW-mode.
|
2020-03-28 04:37:04 +01:00 |
ThePendulum
|
95d115b585
|
Added Aziani. Added URL origin parameter to relevant qu methods.
|
2020-03-28 01:40:02 +01:00 |
ThePendulum
|
238ebcbf34
|
Moved SFW mode to server, added HTTP header trigger.
|
2020-03-27 17:37:13 +01:00 |
ThePendulum
|
fb59bf552a
|
Added actor assignment to new actors module. Showing network icon on network-specific actors. Improved dark theme. Changed tag tile design. Added Digital Playground logos.
|
2020-03-27 04:39:13 +01:00 |
ThePendulum
|
d29e296799
|
Added database structure for profiles and tattoos. Improved sidebar appearance. Expanded new actors module.
|
2020-03-26 03:32:07 +01:00 |
ThePendulum
|
d724f96728
|
Added new actors module boilerplate. Added tag posters.
|
2020-03-24 03:48:24 +01:00 |
ThePendulum
|
58ead7b426
|
Added dark and SFW modes.
|
2020-03-23 01:43:49 +01:00 |
ThePendulum
|
fdb2b132f6
|
Improved release storage module. Added new tags module. Added movie scraping.
|
2020-03-22 03:50:24 +01:00 |
ThePendulum
|
d765543b30
|
Improved update runner. Improved HTTP module API, added default user agent. Added PornCZ and Czechav logos.
|
2020-03-21 02:48:24 +01:00 |
ThePendulum
|
4b310e9dfa
|
Added configurable proxy to HTTP module (also used by qu). Added network and site URL to search documents.
|
2020-03-19 01:54:25 +01:00 |
ThePendulum
|
e4b269956e
|
Attaching channel site and studio to stored releases.
|
2020-03-17 00:58:03 +01:00 |
ThePendulum
|
0f09fd53eb
|
Refactoring deep scrape. Added tag posters.
|
2020-03-16 04:10:52 +01:00 |
ThePendulum
|
c8ebe7892a
|
Refactored update scraper into new module.
|
2020-03-14 02:56:28 +01:00 |
ThePendulum
|
8d484ba728
|
Added tag photos. Auto-adding BTS tag to BAM Visions scenes.
|
2020-03-13 21:54:44 +01:00 |
ThePendulum
|
01b59f0a9b
|
Changed withReleases boolean to include object in Vixen and Fame Digital scrapers.
|
2020-03-12 02:21:59 +01:00 |