Silent Data Corruption

Discussions center on detecting and preventing silent data corruption or bit rot using filesystems like ZFS and BTRFS with checksums, scrubs, and RAID, versus traditional filesystems, emphasizing the role of backups and error correction.

📉 Falling 0.5x DevOps & Infrastructure
3,636
Comments
20
Years Active
5
Top Authors
#821
Topic ID

Activity Over Time

2007
1
2008
10
2009
27
2010
44
2011
33
2012
51
2013
90
2014
230
2015
175
2016
215
2017
293
2018
185
2019
201
2020
289
2021
337
2022
431
2023
315
2024
344
2025
325
2026
40

Keywords

RAM e.g DVD CD RAID NAS FS FAT FEC VIC20 corrupted zfs data corruption raid filesystem disk integrity ecc rs

Sample Comments

heinrich5991 • Mar 12, 2017 • View on HN

You could use ZFS, then the file cannot silently become corrupted.

Arbortheus • Aug 17, 2024 • View on HN

Maybe it works like a RAID array with parity data to repair corruption :-)

jbarrs • Jun 25, 2021 • View on HN

Generally I'd recommend using a filesystem designed for that. Something like btrfs or (I think) ZFS, which have checksums built into the filesystem (and if you set them up in a RAID configuration, these checksums can be used to correct data as well)

bobcostas55 • May 29, 2022 • View on HN

Doesn't ZFS have a mechanism for periodically checking for and correcting bit rot?

dec0dedab0de • Jul 24, 2025 • View on HN

what if the corruption only affected the stored checksum, but not the data itself?

nightfly • Dec 7, 2023 • View on HN

Zfs has checksumming and scrubs, which can catch lots of data corruption that (most?) other filesystems can't catch catch at all

hosay123 • Jun 11, 2014 • View on HN

I don't know the numbers, but the probability of getting 26 corrupted at-rest files through natural causes sounds pretty much like winning the lottery twice on the same day you were struck by lightning twiceChecksums wouldn't have fixed this, they'd only alert the user to the fact the damage had already been done, which is exactly what the decompressor did in its own special way.As another comment points out, error correcting codes are the way to handle this, and its already

hpfr • Dec 29, 2020 • View on HN

Why would the file system affect bit rot rate?

technion • Apr 21, 2018 • View on HN

I would generally suggest you're more likely to corrupt/lose your whole backup than to have one corrupted bitflip not addressed by the filesystem or underlying storage.

antongribok • Jan 12, 2016 • View on HN

Your solution does not protect you from silent data corruption.