Load a large language model in 4bit and train it using Google Colab and PEFT (colab.research.google.com) 3 points by ritabratamaiti 3y ago ↗ HN
[–] ritabratamaiti 3y ago ↗ From the Huggingface blog post: Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA (https://huggingface.co/blog/4bit-transformers-bitsandbytes)
1 comment
[ 4.0 ms ] story [ 11.7 ms ] thread