DebaucheryLibrarian/traxxx
2
1
Fork 1
Code Issues 40 Pull Requests 1 Releases Wiki Activity

Filter media by source to stop exceptions #33

New Issue
Closed
opened 2021-02-11 00:14:10 +00:00 by Ghost · 1 comment
Ghost commented 2021-02-11 00:14:10 +00:00
Copy Link
Copy Source

The hash can be different if the destination alters the file but the url is the same.

media.js

async function findHashDuplicates(medias) {
	const hashes = medias.map(media => media.meta?.hash || media.entry?.hash).filter(Boolean);
	const srcs = medias.map(media => media.src).filter(Boolean);

	const existingHashMediaEntries = await knex('media').whereIn('hash', hashes);
	const existingHashMediaEntriesByHash = itemsByKey(existingHashMediaEntries, 'hash');

	const existingSourceMediaEntries = await knex('media').whereIn('source', srcs);
	const existingSourceMediaEntriesBySource = itemsByKey(existingSourceMediaEntries, 'source');

	const uniqueHashMedias = medias.filter(media => !media.entry && !existingSourceMediaEntriesBySource[media.src] && !existingHashMediaEntriesByHash[media.meta?.hash]);
The hash can be different if the destination alters the file but the url is the same. media.js ``` async function findHashDuplicates(medias) { const hashes = medias.map(media => media.meta?.hash || media.entry?.hash).filter(Boolean); const srcs = medias.map(media => media.src).filter(Boolean); const existingHashMediaEntries = await knex('media').whereIn('hash', hashes); const existingHashMediaEntriesByHash = itemsByKey(existingHashMediaEntries, 'hash'); const existingSourceMediaEntries = await knex('media').whereIn('source', srcs); const existingSourceMediaEntriesBySource = itemsByKey(existingSourceMediaEntries, 'source'); const uniqueHashMedias = medias.filter(media => !media.entry && !existingSourceMediaEntriesBySource[media.src] && !existingHashMediaEntriesByHash[media.meta?.hash]); ```
pendulum commented 2021-02-11 01:53:03 +00:00
Copy Link
Copy Source

pendulum/traxxx#14

https://gitea.unknown.name/pendulum/traxxx/issues/14
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
bug
Something is not working
 duplicate
This issue or pull request already exists
 enhancement
New feature
 feature
help wanted
Need some help
 invalid
Something is wrong
 question
More information is needed
 wontfix
This won't be fixed
No labels
Milestone
No items
No Milestone
Assignees
Clear assignees
DebaucheryLibrarian (DebaucheryLibrarian)
No Assignees
2 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: DebaucheryLibrarian/traxxx#33