> For the price of a Mac Studio, I could have bought 1 billion uncached Opus tokens... or 4 years of the $200/month Max plan. And that’s not counting all the hours I spent chasing the whale through git diffs, network logs, and benchmark results.
perhaps private inference cloud APIs would be a good solution.
1 comment
[ 5.9 ms ] story [ 15.2 ms ] threadperhaps private inference cloud APIs would be a good solution.