How to run Llama-2 on CPU after fine-tuning with LoRA (blog.oxen.ai)

4 points by byrneml 2y ago ↗ HN

1 comment

[ 2.8 ms ] story [ 12.5 ms ] thread

byrneml 2y ago ↗

Pretty comprehensive guide on doing weird things with LLMs on CPUs.