Silent Data Corruption

Discussions center on detecting and preventing silent data corruption or bit rot using filesystems like ZFS and BTRFS with checksums, scrubs, and RAID, versus traditional filesystems, emphasizing the role of backups and error correction.

📉 Falling 0.5x DevOps & Infrastructure
3,636
Comments
20
Years Active
5
Top Authors
#821
Topic ID

Activity Over Time

2007
1
2008
10
2009
27
2010
44
2011
33
2012
51
2013
90
2014
230
2015
175
2016
215
2017
293
2018
185
2019
201
2020
289
2021
337
2022
431
2023
315
2024
344
2025
325
2026
40

Keywords

RAM e.g DVD CD RAID NAS FS FAT FEC VIC20 corrupted zfs data corruption raid filesystem disk integrity ecc rs

Sample Comments

heinrich5991 Mar 12, 2017 View on HN

You could use ZFS, then the file cannot silently become corrupted.

Arbortheus Aug 17, 2024 View on HN

Maybe it works like a RAID array with parity data to repair corruption :-)

jbarrs Jun 25, 2021 View on HN

Generally I'd recommend using a filesystem designed for that. Something like btrfs or (I think) ZFS, which have checksums built into the filesystem (and if you set them up in a RAID configuration, these checksums can be used to correct data as well)

bobcostas55 May 29, 2022 View on HN

Doesn't ZFS have a mechanism for periodically checking for and correcting bit rot?

dec0dedab0de Jul 24, 2025 View on HN

what if the corruption only affected the stored checksum, but not the data itself?

nightfly Dec 7, 2023 View on HN

Zfs has checksumming and scrubs, which can catch lots of data corruption that (most?) other filesystems can't catch catch at all

hosay123 Jun 11, 2014 View on HN

I don't know the numbers, but the probability of getting 26 corrupted at-rest files through natural causes sounds pretty much like winning the lottery twice on the same day you were struck by lightning twiceChecksums wouldn't have fixed this, they'd only alert the user to the fact the damage had already been done, which is exactly what the decompressor did in its own special way.As another comment points out, error correcting codes are the way to handle this, and its already

hpfr Dec 29, 2020 View on HN

Why would the file system affect bit rot rate?

technion Apr 21, 2018 View on HN

I would generally suggest you're more likely to corrupt/lose your whole backup than to have one corrupted bitflip not addressed by the filesystem or underlying storage.

antongribok Jan 12, 2016 View on HN

Your solution does not protect you from silent data corruption.