How to run Llama-2 on CPU after fine-tuning with LoRA (blog.oxen.ai)

4 points by byrneml 2y ago ↗ HN

1 comment

[ 5.9 ms ] story [ 11.3 ms ] thread

byrneml 2y ago ↗

Pretty comprehensive guide on doing weird things with LLMs on CPUs.