Network

XtreemFS – object-based, distributed file system for wide area networks

XtreemFS is a general purpose storage system and covers most storage needs in a single deployment. XtreemFS is a fault-tolerant distributed file system.

It is open-source, requires no special hardware or kernel modules, and can be mounted on Linux, Windows and OS X.

XtreemFS is a file system for a variety of different use cases and purposes.

XtreemFS can be deployed:

  • as a filer replacement (home directories and group shares),
  • in HPC cluster,
  • in Hadoop clusters,
  • for VM block storage
  • cross-branch data sharing
  • and many more use cases, all in a single system.

Key Features

  • Close-to-open consistency model in the event of concurrent file accesses.
  • Scales according to your needs within minutes, simply by adding new standard hardware.
  • Cross-site file replication with auto-failover. Fault-tolerant replication keeps your data safe and gives you peace of mind.
  • Partial replicas, objects fetched on demand.
  • POSIX compatibility. Users can mount and access XtreemFS like any other common file system. Application can access XtreemFS via the standard file system interface, i.e. without having to be rebuilt against a specialized API. XtreemFS supports a POSIX-compliant access control model.
  • Plugins for authentication policies, replica selection.
  • RAID0 (striping) with parallel I/O over stripes. A striped file is split into multiple chunks (“stripes”), which are stored on different storage servers.
  • Read-only replication. XtreemFS supports the replication of mutable files as well as a replicated Directory Service (DIR) and Metadata Catalog (MRC). All components in XtreemFS can be replicated for redundancy which results in a fully fault-tolerant file system. The replication in XtreemFS works with hot backups, which automatically take over if the primary replica fails.
  • Security (SSL, X.509 certificates). XtreemFS uses unauthenticated and unencrypted TCP connections by default. To encrypt all network traffic, services and clients can establish SSL connections.
  • File system driver for Hadoop.
  • Servers for Linux and Solaris Natively and Non-Native Windows Java & ANT based server.
  • Cross-platform support – there are clients for Linux, Mac OS X, and Windows.

Website: www.xtreemfs.org
Support: User Guide, Mailing List
Developer: Matthias Noack, Robert Schmidtke, Felix Seibert (project is funded by the Zuse Institute Berlin)
License: New BSD

XtreemFS is written in Java. Learn Java with our recommended free books and free tutorials.


Related Software

File Systems
HDFSDistributed file system providing high-throughput access
SeaweedFSSimple and highly scalable distributed file system
LustreFile system for computer clusters
CephFSUnified, distributed storage system
AlluxioVirtual distributed file system
GlusterFSScale-out NAS file system
JuiceFSDistributed POSIX file system
XtreemFSObject-based, distributed file system for wide area networks
MooseFSPOSIX-compliant distributed file system
Quantcast File SystemHigh-performance, fault-tolerant, distributed file system
OrangeFSMulti-server scalable parallel file system
LeilFSDistributed POSIX file system

Read our verdict in the software roundup.


Best Free and Open Source Software Explore our comprehensive directory of recommended free and open source software. Our carefully curated collection spans every major software category.

This directory is part of our ongoing series of informative articles for Linux enthusiasts. It features hundreds of detailed reviews, along with open source alternatives to proprietary solutions from major corporations such as Google, Microsoft, Apple, Adobe, IBM, Cisco, Oracle, and Autodesk.

You’ll also find interesting projects to try, hardware coverage, free programming books and tutorials, and much more.

Discovered a useful open source Linux program that we haven’t covered yet? Let us know by completing this form.
Subscribe
Notify of
guest
0 Comments
Oldest
Newest Most Voted