9 comments

[ 3.1 ms ] story [ 35.8 ms ] thread
(comment deleted)
I hope this moves the masses from closed models to open models.
The only reason we haven't moved yet is that there are no serverless inference providers that are has performant as Anthropic/OpenAI (would love to be corrected if I am wrong).
give deepseek a few weeks to catch up. they probably got waaay more customers than they originally anticipated.
Check out LambdaLabs Inference:

https://lambdalabs.com/inference

It's pretty quick and has the open models. They have Qwen right now, I wouldn't be surprised if they added Deepseek soon.

nice breakdown