[–] danielhanchen 1y ago ↗ I shrank DeepSeek V3 to 230GB or so from 720GB and it works still! Model uploads are at https://huggingface.co/unsloth/DeepSeek-V3-0324-GGUF
1 comment
[ 9.0 ms ] story [ 20.5 ms ] thread