Network

Alluxio – virtual distributed file system

Alluxio (formerly known as Tachyon) is a virtual distributed storage system. It bridges the gap between computation frameworks and storage systems, enabling computation applications to connect to numerous storage systems through a common interface.

Alluxio is used in production to manage Petabytes of data in many leading companies, with the largest deployment exceeding 1300 nodes.

Alluxio sits between computation and storage in the big data analytics stack. It provides a data abstraction layer for computation frameworks, enabling applications to connect to numerous storage systems through a common interface.

In the data ecosystem, Alluxio lies between data driven applications, such as Apache Spark, Presto, Tensorflow, Apache HBase, Apache Hive, or Apache Flink, and various persistent storage systems, such as Amazon S3, Google Cloud Storage, OpenStack Swift, HDFS, GlusterFS, IBM Cleversafe, EMC ECS, Ceph, NFS, Minio, and Alibaba OSS. Alluxio unifies the data stored in these different storage systems, presenting unified client APIs and a global namespace to its upper layer data driven applications.

Website: www.alluxio.io
Support: Mailing List, GitHub Code Repository
Developer: UC Berkeley AMPLab
License: Apache License 2.0

Alluxio is written in Java. Learn Java with our recommended free books and free tutorials.


Related Software

File Systems
HDFSDistributed file system providing high-throughput access
SeaweedFSSimple and highly scalable distributed file system
LustreFile system for computer clusters
CephFSUnified, distributed storage system
AlluxioVirtual distributed file system
GlusterFSScale-out NAS file system
JuiceFSDistributed POSIX file system
XtreemFSObject-based, distributed file system for wide area networks
MooseFSPOSIX-compliant distributed file system
Quantcast File SystemHigh-performance, fault-tolerant, distributed file system
OrangeFSMulti-server scalable parallel file system
LeilFSDistributed POSIX file system

Read our verdict in the software roundup.


Best Free and Open Source Software Explore our carefully curated directory of recommended free and open source software, covering every major software category.

The directory forms part of our extensive collection of articles for Linux enthusiasts. It includes hundreds of detailed reviews, together with free and open source alternatives to proprietary software from companies such as Google, Microsoft, Apple, Adobe, IBM, Cisco, Oracle, and Autodesk.

LinuxLinks also covers interesting projects worth exploring, Linux-compatible hardware, free programming books and tutorials, and much more.

Know a useful free and open source Linux application that we haven’t covered? Tell us about it using our submission form.
Subscribe

Please read our Comment Policy before commenting.

Notify of
guest
0 Comments
Oldest
Newest Most Voted