Free LLM balancer combines multiple local inference machines with cloud fallback (github.com) 4 points by ThomasWink1981 1mo ago ↗ HN
2 comments
[ 3.4 ms ] story [ 14.3 ms ] thread