MiniLLM: A minimal system for running LLMs on consumer-grade Nvidia GPUs (twitter.com)

31 points by volodia 3y ago ↗ HN

2 comments

[ 3.7 ms ] story [ 19.4 ms ] thread

22c 3y ago ↗

GitHub link: https://github.com/kuleshov/minillm

noonething 3y ago ↗

good luck with this, looks good so far