[–] Philpax 14d ago ↗ See also https://huggingface.co/nvidia/NVIDIA-Nemotron-3.5-Bolt-74B-A..., which fits in a 24GB card through a special 2-bit quantisation.
1 comment
[ 2.3 ms ] story [ 85.9 ms ] thread