Lustre is a massively, global, parallel distributed file system, generally used for large scale cluster computing.
Lustre file systems are available under the GNU GPL (v2 only) and provide a high performance file system for computer clusters ranging in size from small workgroup clusters to large-scale, multi-site clusters.
There are two main Lustre server components of a Lustre file system; Object Storage Servers (OSS) nodes and Meta Data Servers (MDS) nodes. File system Meta data is stored on the Lustre MDS nodes and file data is stored on the Object Storage Servers. The data for the MDS server is stored on a Meta Data Target (MDT), which essentially corresponds to any LUN being used to store the actual Meta data. The data for the OSS servers are stored on hardware LUNs called Object Storage Targets (OSTs).
Eight of the top ten and 70% of the top 100 fastest supercomputers in the world rely on Lustre for their storage needs.
Key Features
- Designed to provide cluster client nodes with shared access to file system data in parallel.
- Highly scalable and offers very significant storage management advantages.
- Supports tens of thousands of client systems, tens of petabytes of software, and more than a terabye per second of aggregate I/O throughput. This makes this file system ideal for high end HPC cluster I/O systems.
- Lustre Networking (LNET).
- High Availability.
- Lustre failover mechanism delivers call completion that is completely application transparent.
- Use any common storage technologies along with high-speed interconnects.
Website: lustre.org
Support: Wiki
Developer: Community Project
License: GNU General Public License v2.0
Lustre is written in C. Learn C with our recommended free books and free tutorials.
Related Software
| File Systems | |
|---|---|
| HDFS | Distributed file system providing high-throughput access |
| SeaweedFS | Simple and highly scalable distributed file system |
| Lustre | File system for computer clusters |
| CephFS | Unified, distributed storage system |
| Alluxio | Virtual distributed file system |
| GlusterFS | Scale-out NAS file system |
| JuiceFS | Distributed POSIX file system |
| XtreemFS | Object-based, distributed file system for wide area networks |
| MooseFS | POSIX-compliant distributed file system |
| Quantcast File System | High-performance, fault-tolerant, distributed file system |
| OrangeFS | Multi-server scalable parallel file system |
| LeilFS | Distributed POSIX file system |
Read our verdict in the software roundup.
 Explore our comprehensive directory of recommended free and open source software. Our carefully curated collection spans every major software category.This directory is part of our ongoing series of informative articles for Linux enthusiasts. It features hundreds of detailed reviews, along with open source alternatives to proprietary solutions from major corporations such as Google, Microsoft, Apple, Adobe, IBM, Cisco, Oracle, and Autodesk. You’ll also find interesting projects to try, hardware coverage, free programming books and tutorials, and much more. Discovered a useful open source Linux program that we haven’t covered yet? Let us know by completing this form. |