[–] danielhanchen 1y ago ↗ I shrank DeepSeek V3 to 230GB or so from 720GB and it works still! Model uploads are at https://huggingface.co/unsloth/DeepSeek-V3-0324-GGUF
1 comment
[ 4.0 ms ] story [ 17.1 ms ] thread