Ask HN: How do you fine-tune LLMs? 2 points by xzyaoi 1y ago ↗ HN Do you usually do full fine-tuning or LoRA (or its variants)? and why?
[–] yawnxyz 1y ago ↗ I'm curious if the how ppl fine-tune LLMs depends on why ppl fine-tune LLMs.The couple of times I've tried to fine-tune a text model I've consistently gotten way worse results (I'm not good at it), so I've just stopped trying...
1 comment
[ 3.0 ms ] story [ 9.5 ms ] threadThe couple of times I've tried to fine-tune a text model I've consistently gotten way worse results (I'm not good at it), so I've just stopped trying...