this is really nice, gonna help me dial in my settings when running multiple models
Is it possible to get more information about the GPU processes? Context, I'm running vllm on k3s on the dgx and do not know at quick glance which model is which process (other than doing mental matching best I can)
3 comments
[ 6.9 ms ] story [ 24.9 ms ] threadI update the dgxtop to v2 now!!
It's built for the DGX Spark (originally...ww).
Support the GB10 GPU shares one pool of memory （Uniform Memory Access）
And it runs on any Linux machine with NVIDIA GPUs (x86_64 or aarch64).
I won't say much, plus my English isn't great.
So just go in and look at the screenshot, you'll see what it is right away lol.
Is it possible to get more information about the GPU processes? Context, I'm running vllm on k3s on the dgx and do not know at quick glance which model is which process (other than doing mental matching best I can)