Distributed Storage Systems
Comments primarily recommend and discuss distributed file systems and object stores like Ceph, GlusterFS, Lustre, and alternatives for scalable cluster storage solutions.
Activity Over Time
Top Contributors
Keywords
Sample Comments
Curious if something like Ceph would help.
Ceph or AFS may be worth a look-see
I'm not currently using any but I've tried:- Ceph: Very flexible. Supports many different kinds of replication. Has high overhead compared to local disk (on the order of ~50%) and was (for me) prone to hard to diagnose issues. Can be annoying to setup if you're not doing it on a supported Linux distro with ceph-deploy. It looks like Bluestore (a new on-disk format for data) will significantly improve performance but Bluestore is extremely RAM hungry.- GlusterFS: Much faster
Question from Githubbers:Have considered using cluster file systems such as GlusterFS or Ceph?
Is it possible you look for something like Ceph? https://en.wikipedia.org/wiki/Ceph_(software)
Or get a few more Pis and run Tahoe or Ceph ...
Do you have any opinions of Ceph? They seem to be dong a similar thing.
If not Ceph, what are you using for storage?
Use a distributed file system or object store with what you need, like Quobyte or Ceph.
You're probably better if using Cephfs or Lustre then NFS. Linearly scalable, no SPOF (single point of failure).