Show HN: LoRA can make distributed fine-tuning far faster (ericyu3.notion.site) 16 points by ericyu3 2y ago ↗ HN
[–] jbentleylong 2y ago ↗ LoRA AWS swarms are 60x 1 GPU throughput for fine-tuning?? Kind of a big find
[–] sdjksdafji 2y ago ↗ How is the model performance? I heard lora on LLM generally get inferior results comparing to no LORA finetuning [–] Tostino 2y ago ↗ Generally good as long as you target all layers.
3 comments
[ 0.25 ms ] story [ 17.1 ms ] thread