Utilities

Excellent Utilities: nvitop – GPU process management

In Operation

As you may be aware, nvidia-smi prints its results only once. nvitop can do the same with the command $ nvitop -1. But by default the software starts in its monitoring mode.

Issuing the command $ nvitop lets us monitor GPU usage with bar charts in addition to a process list.

nvitop
Click image for full size

We can sort the process list by GPU-INDEX, PID, USER, GPU-MEM, %SM, %CPU, %MEM and by TIME, both in ascending and descending order. We can also filter the processes so that only GPU processes with the compute context or graphics context are displayed.

For each process we can interrogate the process environment, kill or terminate the selected process, as well as toggle a tree-view screen showing the GPU processes and their parent processes.

We can change the display mode to display history graphs by pressing the f key.

nvitop
Click image for full size

Our test machine hosts a single GPU, but the tool will display multiple GPUs if present on a system.

There’s a handy help screen (accessed by pressing the h key in the program) which shows the keyboard shortcuts.

nvitop - help screen

Summary

nvitop is our recommended tool for monitoring NVIDIA GPUs. It can run as a single instance (nvitop -1) like nvidia-smi, or in its default monitoring mode.

Unlike some other tools, nvitop doesn’t access the output of nvidia-smi. Instead, it queries the device stats using NVML Python bindings directly. This offers efficiency gains over other similar tools.

There’s support for keyboard and mouse.

nvitop provides APIs to query the device and process status. This enables developers to integrate the tool into their applications.

This is cross-platform software running under Linux and Windows.

Website: github.com/XuehaiPan/nvitop
Support: Documentation
Developer: Xuehai Pan
License: Dual license: Apache License Version 2.0 and GNU General Public License v3.0

nvitop is written in Python. Learn Python with our recommended free books and free tutorials.

Pages in this article:
Page 1 – Introduction / Installation
Page 2 – In Operation / Summary


Complete list of articles in this series:

Excellent Utilities
AES CryptEncrypt files using the Advanced Encryption Standard
AnanicyShell daemon created to manage processes’ IO and CPU priorities
brootNext gen tree explorer and customizable launcher
CerebroFast application launcher
cheat.shCommunity driven unified cheat sheet
CopyQAdvanced clipboard manager
crocSecurely transfer files and folders from the command-line
DeskreenLive streaming your desktop to a web browser
dufDisk usage utility with more polished presentation than the classic df
ezaA turbo-charged alternative to the venerable ls command
Extension ManagerBrowse, install and manage GNOME Shell Extensions
fdWonderful alternative to the venerable find
fkillKill processes quick and easy
fontpreviewQuickly search and preview fonts
horcruxFile splitter with encryption and redundancy
KoohaSimple screen recorder
KOReaderDocument viewer for a wide variety of file formats
ImagineA simple yet effective image optimization tool
LanguageToolStyle and grammar checker for 30+ languages
Liquid PromptAdaptive prompt for Bash & Zsh
lnavAdvanced log file viewer for the small-scale; great for troubleshooting
lsdLike exa, lsd is a turbo-charged alternative to ls
Mark TextSimple and elegant Markdown editor
McFlyNavigate through your bash shell history
mdlessFormatted and highlighted view of Markdown files
naviInteractive cheatsheet tool
notiMonitors a command or process and triggers a notification
NushellFlexible cross-platform shell with a modern feel
nvitopGPU process management for NVIDIA graphics cards
OCRmyPDFAdd OCR text layer to scanned PDFs
Oh My ZshFramework to manage your Zsh configuration
PaperworkDesigned to simplify the management of your paperwork
pastelGenerate, analyze, convert and manipulate colors
PDF Mix ToolPerform common editing operations on PDF files
pecoSimple interactive filtering tool that's remarkably useful
ripgrepRecursively search directories for a regex pattern
RnoteSketch and take handwritten notes
scrcpyDisplay and control Android devices
StickySimulates the traditional “sticky note” style stationery on your desktop
tldrSimplified and community-driven man pages
tmuxA terminal multiplexer that offers a massive boost to your workflow
TuskAn unofficial Evernote client with bags of potential
UlauncherSublime application launcher
WatsonTrack the time spent on projects
Whoogle SearchSelf-hosted and privacy-focused metasearch engine
ZellijTerminal workspace with batteries included
Subscribe
Notify of
guest

This site uses Akismet to reduce spam. Learn how your comment data is processed.

0 Comments
Inline Feedbacks
View all comments