How to run Llama-2 on CPU after fine-tuning with LoRA (blog.oxen.ai)

4 points by byrneml 3y ago ↗ HN

1 comment

[ 2.2 ms ] story [ 9.8 ms ] thread

byrneml 3y ago ↗

Pretty comprehensive guide on doing weird things with LLMs on CPUs.