Network

LeilFS – distributed POSIX file system for scalable storage

LeilFS is a distributed POSIX file system that combines storage resources from multiple servers into a shared filesystem. Inspired by Google File System, it is designed for organisations that need scalable capacity, shared access and protection against individual storage failures.

The architecture separates metadata services from chunk storage and client access. Metadata servers coordinate filesystem operations, while chunkservers manage the underlying file data. Files are divided into chunks that can be replicated or protected with erasure coding.

LeilFS targets storage workloads ranging from enterprise file sharing and archives to scientific data, media production and high-performance computing. Administrators can combine different storage device types and apply policies that determine how data is protected and placed within a cluster.

This is free and open source software.

Key Features

  • Provides a distributed POSIX filesystem using separate metadata and chunk storage services.
  • Supports metadata redundancy with coordinated failover between metadata servers.
  • Offers configurable file replication and Reed-Solomon erasure coding.
  • Provides copy-on-write snapshots for protecting and recovering filesystem data.
  • Uses checksums and data scrubbing to detect corruption in stored chunks.
  • Supports automatic rebalancing when storage capacity changes.
  • Offers storage placement policies based on device labels and redundancy goals.
  • Provides quotas for users, groups and directories.
  • Supports POSIX and NFSv4 access control lists.
  • Offers filesystem locking through supported POSIX and flock mechanisms.
  • Supports NFS access and integration with Samba for network file sharing.
  • Can expose stored data through an S3-compatible gateway integration.

Website: github.com/leil-io/leilfs
Support:
Developer: Leil Storage
License: GNU General Public License v3.0

LeilFS is written in C++. Learn C++ with our recommended free books and free tutorials.


Related Software

File Systems
HDFSDistributed file system providing high-throughput access
SeaweedFSSimple and highly scalable distributed file system
LustreFile system for computer clusters
CephFSUnified, distributed storage system
AlluxioVirtual distributed file system
GlusterFSScale-out NAS file system
JuiceFSDistributed POSIX file system
XtreemFSObject-based, distributed file system for wide area networks
MooseFSPOSIX-compliant distributed file system
Quantcast File SystemHigh-performance, fault-tolerant, distributed file system
OrangeFSMulti-server scalable parallel file system
LeilFSDistributed POSIX file system

Read our verdict in the software roundup.


Best Free and Open Source Software Explore our carefully curated directory of recommended free and open source software, covering every major software category.

The directory forms part of our extensive collection of articles for Linux enthusiasts. It includes hundreds of detailed reviews, together with free and open source alternatives to proprietary software from companies such as Google, Microsoft, Apple, Adobe, IBM, Cisco, Oracle, and Autodesk.

LinuxLinks also covers interesting projects worth exploring, Linux-compatible hardware, free programming books and tutorials, and much more.

Know a useful free and open source Linux application that we haven’t covered? Tell us about it using our submission form.
Subscribe

Please read our Comment Policy before commenting.

Notify of
guest
0 Comments
Oldest
Newest Most Voted