Simple LLM VRAM calculator for model inference (bestgpusforai.com) 2 points by javaeeeee 9mo ago ↗ HN
[–] javaeeeee 9mo ago ↗ This calculator estimates the GPU memory needed to run LLM inference. Select the model size and precision (FP32 - FP4) to get a quick memory range estimate.
1 comment
[ 2.8 ms ] story [ 16.6 ms ] thread