Show HN: A GPU/VRAM filter for finding LLMs that will run on your hardware (whichllmmodel.com)

Very broken: "live minimums" do not allow me to remove 512 token limit and put a bigger number easily.

No unified or shared memory scenarios (like Apple's M platform or AMD's integrated GPU platform).

very nice idea. Would be nice if you could also keep desired context as a free parameter and let the models tell you what maximum context you could have.

Awesome, how do I contribute to this? A gihub link or smthg?

handy, but the gap most of these filters have is that "fits in VRAM" doesn't mean usable. context length blows up the KV cache fast, a 7B that fits at 2k tokens will OOM at 32k. factoring context len + quant into the estimate is where it'd actually save people from getting burned.

[flagged]