HugeSCM is a cloud-native version control system designed for extremely large repositories. It is particularly suited to AI model development, game production, dataset management and monorepos containing large binary files.
The system separates frequently accessed metadata from file content, storing metadata in a distributed database and large blobs in object storage. Its Zeta client maintains a shallow local copy and retrieves data on demand, avoiding the storage and transfer overhead associated with cloning an entire Git repository.
This is free and open source software.
Key Features
- Handles large repositories, binary assets, datasets and AI model files.
- Separates repository metadata from file content.
- Stores file data in object storage or a distributed file system.
- Offers familiar Git-like status, add, commit, push, pull, switch and stash commands.
- Supports sparse, single-file and one-by-one checkouts.
- Downloads missing objects automatically when they are required.
- Uses content-defined chunking for efficient large-file updates and deduplication.
- Supports parallel downloads, resumable transfers and external download accelerators.
- Provides merge, rebase and fast-forward-only pull strategies.
- Uses BLAKE3 hashes for repository objects.
- Includes tools for migrating repositories from Git.
- Offers JSON output from many commands for integration with other tools.
Website: github.com/antgroup/hugescm
Support:
Developer: Ant Group
License: Apache License 2.0
HugeSCM is written in Go. Learn Go with our recommended free books and free tutorials.
Related Software
| Revision Control Tools | |
|---|---|
| Git | Used in high profile open source projects, most notably the Linux kernel |
| Jujutsu | Powerful version control system for software projects |
| Mercurial | Fast, lightweight Source Control Management system |
| Subversion | General system that can be used to manage any collection of files |
| Lore | Centralized, content-addressed version control system |
| Darcs | An advanced revision control system |
| Fossil | Distributed version control system |
| dat | Distributed data community for the next generation Web |
| Sapling | Scalable, user-friendly source control system |
| Pijul | Sound and fast distributed version control system |
| CVS | Concurrent Versions System |
| Breezy | Decentralized revision control system supporting Bazaar and Git formats |
| Monotone | Especially strong in its support of a diverge/merge workflow |
| Game of Trees | Prioritizes ease of use and simplicity over flexibility |
| HugeSCM | Cloud-native version control system |
Read our verdict in the software roundup.
 LinuxLinks helps you discover the best free and open source software for Linux. Explore our extensive collection of recommended applications, including alternatives to popular proprietary software.We also publish software reviews, Linux tutorials, hardware reviews, free programming books and articles covering the wider open source community. Browse our Linux resources to discover more. Know a useful free and open source Linux application we haven't covered? Suggest a program for inclusion. Has your software been featured on LinuxLinks? Display one of our Featured on LinuxLinks badges on your website or GitHub README. |
Please read our Comment Policy before commenting.