Lustre is a parallel distributed file system developed for high-performance computing environments. It provides shared access to storage across large clusters, allowing many computing nodes to read and write data concurrently.
Lustre separates metadata management from file contents. Metadata Servers manage filesystem information stored on Metadata Targets, while Object Storage Servers provide access to data held on Object Storage Targets. Clients interact with these services to locate files and perform I/O.
This separation enables data access to be distributed across multiple storage targets. Lustre is widely associated with scientific simulations, research clusters and other applications where aggregate throughput and parallel access are more important than the characteristics of a conventional single-server filesystem.
This is free and open source software.
Key Features
- Allows multiple clients to access a shared POSIX filesystem concurrently.
- Stripes file data across multiple Object Storage Targets for parallel I/O.
- Supports configurable stripe counts and stripe sizes for different workloads.
- Offers progressive file layouts with different placement policies for different file extents.
- Supports distributed namespace functionality to spread metadata workloads across Metadata Targets.
- Provides directory striping for metadata-intensive applications.
- Includes Lustre Networking (LNet) for communication across supported network transports.
- Supports server failover and recovery configurations for high availability.
- Offers filesystem quotas for controlling storage usage.
- Provides tools for monitoring clients, storage targets and filesystem performance.
- Supports data management policies for selecting and moving files between storage tiers.
Website: lustre.org
Support:
Developer: Lustre community
License: GNU General Public License v2.0
Lustre is written in C. Learn C with our recommended free books and free tutorials.
Related Software
| File Systems | |
|---|---|
| HDFS | Distributed file system providing high-throughput access |
| SeaweedFS | Simple and highly scalable distributed file system |
| Lustre | File system for computer clusters |
| CephFS | Unified, distributed storage system |
| Alluxio | Virtual distributed file system |
| GlusterFS | Scale-out NAS file system |
| JuiceFS | Distributed POSIX file system |
| XtreemFS | Object-based, distributed file system for wide area networks |
| MooseFS | POSIX-compliant distributed file system |
| Quantcast File System | High-performance, fault-tolerant, distributed file system |
| OrangeFS | Multi-server scalable parallel file system |
| LeilFS | Distributed POSIX file system |
Read our verdict in the software roundup.
 Explore our carefully curated directory of recommended free and open source software, covering every major software category.The directory forms part of our extensive collection of articles for Linux enthusiasts. It includes hundreds of detailed reviews, together with free and open source alternatives to proprietary software from companies such as Google, Microsoft, Apple, Adobe, IBM, Cisco, Oracle, and Autodesk. LinuxLinks also covers interesting projects worth exploring, Linux-compatible hardware, free programming books and tutorials, and much more. Know a useful free and open source Linux application that we haven’t covered? Tell us about it using our submission form. |
Please read our Comment Policy before commenting.