Data Deduplication
Comments discuss data deduplication techniques in filesystems like BTRFS, ZFS, XFS, and cloud services like Dropbox and Mega, including block-level vs file-level dedup, cross-user deduplication, and storage efficiency benefits.
Activity Over Time
Top Contributors
Keywords
Sample Comments
There are storage systems which do this, de-dupe on disk level.
Just use a deduplicating filesystem. Both btrfs and xfs can deduplicate identical files.
Stupid question. Would a block based deduplicating file system solve this?
What file system are you using? Couldn't a deduplicating file system handle redundancy for you?
The feature you want is called dedup(lication).
Do they have some kind of data deduplication by the way?
Deduplication works well these days.
What makes you think Dropbox doesn't deduplicate data?
Only if you have a file system that automatically deduplicates everything, or lots of hard drives...
Dedup can be used with compression I thought.