[–] mezark 2y ago ↗ Drop in replacement for HF's TGI server. The fastest and easiest way to inference LLMs locallyGithub: https://github.com/titanml/takeoff Docs: https://docs.titanml.co/docs/titan-takeoff/getting-started Discord: https://discord.gg/83RmHTjZgf
1 comment
[ 2.9 ms ] story [ 9.1 ms ] threadGithub: https://github.com/titanml/takeoff Docs: https://docs.titanml.co/docs/titan-takeoff/getting-started Discord: https://discord.gg/83RmHTjZgf