Network

OrangeFS – parallel file system for computing clusters

OrangeFS is a parallel file system designed for scientific computing, high-performance clusters and applications that need concurrent access to large datasets. It originated from the Parallel Virtual File System project and is designed to distribute both data and metadata across multiple storage servers.

The system provides a shared filesystem namespace while allowing clients to communicate with servers holding different parts of a file. This arrangement enables parallel applications to use several storage resources concurrently rather than depending on a single storage server.

OrangeFS combines user-space server components with different client interfaces. It also integrates with the Linux Virtual File System through an upstream kernel client, making it accessible to applications using conventional filesystem operations.

The project is used in parallel I/O research as well as production computing environments where flexible data layouts and scalable storage access are important.

This is free and open source software.

Key Features

  • Distributes file data across multiple servers for parallel access.
  • Supports distributed metadata to avoid concentrating all metadata operations on one server.
  • Provides an integrated Linux kernel client for normal filesystem access.
  • Offers native interfaces for applications that require direct storage operations.
  • Supports MPI-IO through ROMIO for parallel scientific applications.
  • Provides FUSE-based filesystem access for supported client environments.
  • Supports configurable file distribution and data striping policies.
  • Allows data and metadata services to run on the same or separate servers.
  • Supports POSIX-style operations through compatible client interfaces.
  • Offers integration options for Hadoop-oriented data processing workflows.
  • Provides Windows client access and macOS access through supported FUSE configurations.
  • Cross-platform support – runs on Linux, macOS, and Windows.

Website: www.orangefs.org
Support:
Developer: Omnibond, Clemson University, Argonne National Laboratory and community contributors
License: GNU Lesser General Public License v2.1

OrangeFS is written in C. Learn C with our recommended free books and free tutorials.


Related Software

File Systems
HDFSDistributed file system providing high-throughput access
SeaweedFSSimple and highly scalable distributed file system
LustreFile system for computer clusters
CephFSUnified, distributed storage system
AlluxioVirtual distributed file system
GlusterFSScale-out NAS file system
JuiceFSDistributed POSIX file system
XtreemFSObject-based, distributed file system for wide area networks
MooseFSPOSIX-compliant distributed file system
Quantcast File SystemHigh-performance, fault-tolerant, distributed file system
OrangeFSMulti-server scalable parallel file system
LeilFSDistributed POSIX file system

Read our verdict in the software roundup.


Best Free and Open Source Software LinuxLinks helps you discover the best free and open source software for Linux. Explore our extensive collection of recommended applications, including alternatives to popular proprietary software.

We also publish software reviews, Linux tutorials, hardware reviews, free programming books and articles covering the wider open source community. Browse our Linux resources to discover more.

Know a useful free and open source Linux application we haven't covered? Suggest a program for inclusion.

Has your software been featured on LinuxLinks? Display one of our Featured on LinuxLinks badges on your website or GitHub README.
Subscribe

Please read our Comment Policy before commenting.

Notify of
guest
0 Comments
Oldest
Newest Most Voted