all-smi is a terminal-based tool for monitoring GPUs, NPUs and other system resources.
all-smi provides local and remote cluster monitoring for NVIDIA and AMD GPUs, NVIDIA Jetson, Apple Silicon, Intel graphics, Google Cloud TPUs, AWS Trainium and Inferentia, and accelerators from Intel Gaudi, Tenstorrent, Rebellions and Furiosa. It displays hardware utilisation, memory consumption, temperatures, clock speeds, power consumption and running processes in real time.
This is free and open source software.
Key Features
- Monitors GPUs and NPUs from a wide range of hardware vendors.
- Displays utilization, memory, temperature, frequency and power metrics.
- Provides local, remote and multi-node cluster monitoring.
- Reports CPU, system memory, swap, chassis power and thermal information.
- Offers interactive sorting, filtering and process-tree views.
- Shows process IDs, commands, users, states, CPU usage and GPU memory consumption.
- Exports metrics through an API for integration with Prometheus.
- Produces one-shot snapshots in JSON, CSV or Prometheus format.
- Records metric streams and replays them through the terminal interface.
- Supports threshold alerts, webhook notifications and energy-cost accounting.
- Includes configurable refresh intervals, colour schemes and alert thresholds.
- Provides diagnostic checks and support-bundle generation.
Website: github.com/lablup/all-smi
Support:
Developer: Jeongkyu Shin
License: Apache License 2.0
all-smi is written in Rust. Learn Rust with our recommended free books and free tutorials.
Related Software
| NVIDIA GPU Monitoring Tools | |
|---|---|
| NVTOP | (h)top like task monitor for AMD, Intel and NVIDIA GPUs |
| nvitop | Bills itself as “the one-stop solution for GPU process management” |
| LACT | Configures and monitors AMD, NVIDIA and Intel GPUs |
| GPU Hot | Real-time NVIDIA GPU monitoring dashboard |
| gpustat | Query and monitor GPU status |
| GreenWithEnvy | GUI System tool |
| NVDashboard | JupyterLab extension for displaying dashboards of GPU usage |
| nv-monitor | Lightweight terminal-based monitoring application |
| nvidia-htop | Enriches the output of nvidia-smi |
| gptop | Cross-platform GPU monitor |
| NVIDIA System Monitor | Task manager monitoring your GPU |
Read our verdict in the software roundup.
 Explore our carefully curated directory of recommended free and open source software, covering every major software category.The directory forms part of our extensive collection of articles for Linux enthusiasts. It includes hundreds of detailed reviews, together with free and open source alternatives to proprietary software from companies such as Google, Microsoft, Apple, Adobe, IBM, Cisco, Oracle, and Autodesk. LinuxLinks also covers interesting projects worth exploring, Linux-compatible hardware, free programming books and tutorials, and much more. Know a useful free and open source Linux application that we haven’t covered? Tell us about it using our submission form. |
Please read our Comment Policy before commenting.