SeaweedFS is a distributed storage system designed to manage large numbers of files while maintaining efficient access to their contents. It combines file and object storage capabilities in a single architecture.
The system separates volume management from file metadata. Master servers track storage volumes, while volume servers store the underlying data. An optional filer provides directory structures and filesystem-oriented access, allowing applications to work with stored objects through familiar file operations.
SeaweedFS is suitable for applications that need to store many small files, serve media, maintain shared datasets or combine local storage with cloud services. Its architecture allows storage capacity to grow by adding more volume servers.
This is free and open source software.
Key Features
- Supports file access through a filer, including FUSE mounts.
- Provides an S3-compatible API for object storage applications.
- Includes HTTP interfaces for accessing files and storage services.
- Supports configurable replication policies across servers, racks and data centres.
- Offers erasure coding for storage-efficient protection of suitable data.
- Provides automatic master failover for improved service availability.
- Supports cloud tiering, allowing data to move between local and remote storage.
- Offers configurable storage classes for different storage devices and workloads.
- Includes volume compaction to reclaim space after deletions and updates.
- Supports time-to-live policies for automatically expiring stored data.
- Provides data balancing and administrative tools for managing cluster capacity.
- Supports an Iceberg-compatible lakehouse workflow alongside conventional file and object storage.
Website: github.com/seaweedfs/seaweedfs
Support:
Developer: SeaweedFS developers
License: Apache License 2.0
SeaweedFS is written in Go. Learn Go with our recommended free books and free tutorials.
Related Software
| File Systems | |
|---|---|
| HDFS | Distributed file system providing high-throughput access |
| SeaweedFS | Simple and highly scalable distributed file system |
| Lustre | File system for computer clusters |
| CephFS | Unified, distributed storage system |
| Alluxio | Virtual distributed file system |
| GlusterFS | Scale-out NAS file system |
| JuiceFS | Distributed POSIX file system |
| XtreemFS | Object-based, distributed file system for wide area networks |
| MooseFS | POSIX-compliant distributed file system |
| Quantcast File System | High-performance, fault-tolerant, distributed file system |
| OrangeFS | Multi-server scalable parallel file system |
| LeilFS | Distributed POSIX file system |
Read our verdict in the software roundup.
| S3 File Systems | |
|---|---|
| SeaweedFS | Fast distributed storage system |
| JuiceFS | Distributed POSIX file system |
| ZeroFS | Filesystem that makes S3 your primary storage |
| s3fs | Mount an S3 bucket via FUSE |
| Mountpoint for Amazon S3 | High-throughput file client |
| GeeseFS | POSIX-ish S3 file system |
| gcsfuse | Cloud Storage FUSE |
| rclone | Command line program to sync files and directories |
| Garage | S3-compatible distributed object storage service |
| S3QL | File system that stores all its data online |
| Goofys | S3 backend filey-system interface |
Read our verdict in the software roundup.
 LinuxLinks helps you discover the best free and open source software for Linux. Explore our extensive collection of recommended applications, including alternatives to popular proprietary software.We also publish software reviews, Linux tutorials, hardware reviews, free programming books and articles covering the wider open source community. Browse our Linux resources to discover more. Know a useful free and open source Linux application we haven't covered? Suggest a program for inclusion. Has your software been featured on LinuxLinks? Display one of our Featured on LinuxLinks badges on your website or GitHub README. |
Please read our Comment Policy before commenting.