LAWS: A new transform operation turning LLM inference into cheap cache lookups (arxiv.org)

7 points by EGreg 4mo ago ↗ HN

2 comments

[ 0.20 ms ] story [ 13.4 ms ] thread

martianvoid 4mo ago ↗

Is there any codebase associated with this that we can check and tinker with? or is this just a promo thing?

EGreg 4mo ago ↗

Start here: https://github.com/Safebots/KV