89 comments

[ 133 ms ] story [ 830 ms ] thread
results comparable to gpt 5.6 luna but cheaper

promising!

It's always fun when Max reasoning is cheaper than High reasoning.
Kimi K3 was an interesting model only a month ago, and now we're looking at the same performance for 1/20th of the price. Wild how fast this is advancing.
Price is confounded by VC subsidies, economies of scale, and inference optimizations. I think a more interesting chart would be ARC AGI vs forwards pass flops or ARC AGI vs training tokens. Of course we don't have those numbers for the closed source models or even some of the open weight ones.
It is wild that this a log scale of cost to me!
I've been using it extensively since the release and the best summary I can give is that it's good enough to use it for (almost) everything and cheap enough that the cost are irrelevant. I'm running it in Oh My Pi with a second instance running as "advisor" and even with 5-6 active sessions (effectively 12 streams) I'm struggling to spend more than 5 bucks per day.

OpenCode Go even has double limits temporarily so for 10 USD you effectively get 140 USD of tokens to spend. It would impress me if someone could burn that amount with "normal" usage. Even when running multiple sessions.

I have a Claude Max subscription but I've barely touched it, it just feels like a step back to have to think about limits and usage even though the models are stronger.

The beauty of intelligence at this cost (even if it's not SOTA) is that it opens a whole bunch of new use cases. Test failure in CI? Have the bot automatically propose a fix, its cheap enough that you can discard it w/h issues. Test coverage too low? Auto generate tests on CI for every pull-requests! Monitoring server logs, continuous security audits and investigating every received exception now becomes possible.

I'm thinking about having it automatically filter and re-rank my social media feeds so I can steer the algorithm instead of the other way around.

Perhaps other people (with enormous budgets) were already doing all of the above but for us this is a really exciting release!

I try to use all the intelligence I can, which fable, opus and then second tier models.

I am not sure why you wouldn't want to use the SOTA models unless speed is a concern. Otherwise you are leaving quality on the table.

Hard to make big predictions, but it sure looks like at least this level of capability is going to be available in the open and relatively cheap to run.

The 'floor' has gone up: today's model a bit behind SOTA is like model releases that were blowing people's minds a few months ago. Compared to, say, DS R1, this is far out stuff.

This, Luna, and (if it's good in practice) Laguna S are also fast and light not just cheap. And, as happened before, DeepSeek's first but other open model makers likely follow.

And a small, fast model taking small steps is...fun? More like working with code.

Price is not a good meter. Active parameters per token are. Joule would be even better.
(comment deleted)
This reminds me of those pareto-style speedrun record charts when a new glitch is discovered.

[0] https://taylor.town/silver-landmines

When I see dramatic leaps like this, it tells me that the important hacks haven't yet been discovered.

Why wasn’t this run against ARC-AGI-3? Or did it fail to solve anything?
It's serviceable but, like many Chinese models, it uses a lot of tokens to get work done.
They did recently announce they're increasing prices though (got a mail yesterday I think), so not sure this analysis showing it as price outlier will last
This latest DeepSeek is almost at the "too cheap to meter" level. That's going to be a larger unlock than models like Fable/Mythos that are way too expensive to justify, IMO.

What secret sauce do they have?

I’ve been refreshing hacker news constantly for a week now waiting for v4 pro, after they stated it would follow «soon». I have learnt «soon» is a matter of definition.
I strongly recommend trying this for programming tasks.

It is strong (not Fable strong though) with a much better “persona” than Opus, and very different blindspots. If you flip between Claude and this you will find both catch the mistakes of the other before they get out of control.

On balance I actually prefer DeepSeek for programming now, because of the way it talks.

That page needs a Pareto frontier display. But wow, it absolutely demolishes.
wow. i remember when GPT-5.2 (medium) was everyone's favorite.

ARC-AGI II:

- GPT-5.2 (medium) %26.7 ($0.759)

- DSV4-Flash (max) %61.4 ($0.04)

The DeepSeek team is so strong, very impressive.

Imagine if they had GPU resources of western labs.

DeepSeek is my cheap and cheerful Chinese model of choice for API use. Has been for a while, but now it's Flash instead of Pro. Even cheaper, and now better then Pro. I feel like most of the major Chinese models are benchmaxxed, they have weird quirks every time I use them (Qwen 3.8 Max doesn't check its work and leaves stuff broken, doesn't write tests unless prompted, etc., Kimi ends up being quite expensive and rarely better than GPT Sol or Opus 5), while DeepSeek models seem to be generally as good as the benchmarks indicate: Not the best, but stronger across the board than any model within an order of magnitude of its price.
I love DeepSeek V4 Flash since the pre-0731, now even more. It is the first model that is truly too cheap to meter.

But I find it having a pretty significant problem with tool calling - no idea why, but tool calling with it is SLOW. As long as the model is reasoning, all good. But give it a bunch of tools and it becomes extremely slow.

Am I the only one experiencing this?

It's not frontier, but it's far past what we had at the beginning of the year. It's very usable. I get great instruction compliance, tool calling, and with a trivial workflows flow it has very good long-running performance as well.
so cool. does it mean it can understand the verificated code