llm-visuals monitors local LLM inference with token throughput, GPU telemetry, model memory, performance alerts and session replay.
Read more
llm-visuals monitors local LLM inference with token throughput, GPU telemetry, model memory, performance alerts and session replay.
Read more