414 comments

[ 3.8 ms ] story [ 124 ms ] thread
More details:

- https://platform.kimi.ai/docs/guide/kimi-k3-quickstart

- https://platform.kimi.ai/docs/pricing/chat-k3

Pricing is $3/$15 for 1M tokens (cache $0.3), which is extremely high for a Chinese open-weight model, but if it's truly competitive with most of the current frontier and is only behind Fable/Sol, the pricing is justified.

This is 1:1 pricing of Anthropic's Sonnet series (except Sonnet 5 which is currently on discount), and very close to 5.6 Terra pricing (Terra's input is $2.5)

I feel like the quickstart is missing something. It's referring to its tech blog for actual benchmarks, but K3 isn't mentioned on there, the last thing on that blog was K2.6, 2 releases ago.
Tokenizers also matter. Anthropics tokenizers will encode the same piece of text at a way higher token count than OpenAi, for example.

That said, Kimi is competing against GLM in my mind, and GLM 5.2 is less than 1/3 the price.

Tokenizers define the alphabet on which the language model is trained. I don't want people to get the impression it's a module which can be swapped out or modified on its own. Alphabet size is a design consideration related to correctly encoding the training data.
That's true, but it makes it difficult to compare pricing when it's based on tokens. Maybe we need a benchmark for price per a specific input, like enwiki8.
Yes, almost all work people share which seeks to measure the capabilities and differences of models needs to get more precise. We are clamoring to say something meaningful about these things.
It is kind of a shame we ended up comparing token pricing across models and providers when it doesn’t really make sense. Not sure what would be better though.
Use price per page (standard English text)? That would also help make the metric easier to visualize.

If you think a page is too vague, use a famous known writer's work as a reference.

Well isn't that what benchmarks are for? They compare total cost for a unit of work.
A better metric is price per byte. Most thinking traces, prompts, skills are in plain English, which is roughly 1 byte per character, assuming UTF-8 encoding (even code should not be much more either). As an aside, it is common to use bits-per-byte as a loss metric instead of the per token calculation, precisely because of the effect of different tokenizers.
But even that isn't the whole story because the models can produce wildly amount of thinking output as well as regular output for a similar query. Sometimes you can take a cheap model and have it think a ton or an expensive model that thinks little and get similar results. But the number of tokens generated will be wildly different.
(comment deleted)
I’ve been struggling to understand the reason for the newer apparently less efficient Anthropic token encoding. If all inputs are less efficient in this encoding, why does it exist? Has Anthropic released any information that would convincingly show it was anything other than a stealth price hike? Please don’t respond if you are speculating.
> the reason for the newer apparently less efficient Anthropic token encoding

Less efficient in token usage but per the blogs; it enables the model to perform better.

GLM is actually quite expensive in actual practice because it's not very token efficient. I've yet to find a way to run it on a monthly sub reliably for cheaper than Codex.

Neuralwatt was cheap (but slow) but they cranked their price.

Ollama monthly sub is speedy but doesn't offer a lot of quota.

Right now unless you're paying by the token, there's no cost based reason to use the open weight models for daily coding work because the monthly coding plans from Anthropic and OpenAI are a better deal.

I know GLM is relatively expensive and so is Kimi, in comparison to those DeepSeek V4 pro and flash are a godsend and are absolutely good value.
And DeepSeek V4 Flash + GLM 5.2 is a really good blend of both (fast/cheap DS + more intelligent GLM)
I use V4 flash as my personal agent. It categorizes documents, organizes my calendar, searches information etc. for pennies. Amazing model.

Not very good for programming though.

re:

> Right now unless you're paying by the token, there's no cost based reason to use the open weight models for daily coding work because the monthly coding plans from Anthropic and OpenAI are a better deal.

Maybe. I am on a $20/month Anthropic subscription this month but I also use Claude Code frequently with Deepseek v4 flash and pro, GML5.2. for simple work Deepseek v4 flash is so nice because it is fast.

What you say is true however, the US hyper-scalers are still (desperately?) subsidizing subscriptions for market share to boost there valuations.

I really want to see AI inference costs approach zero, and I think I just need to wait a few years to see that.

DeepSeek is a whole other story. It and a few others are quite economical. But they're also not nearly at the same level.

I can get by working on code strictly in GLM. I can't with DeepSeek. It makes some pretty careless mistakes and isn't a very deep thinker.

It is very useful as a general purpose model for non-coding purposes though.

I don't know, DeepseekV4 is so dirt cheap that it makes lots of sense to use over Sonnet.
Compared to the flagship models GLM is still a 1/10th the price on the task I have tested.
I'm on the Z.ai quarterly subscription plan (got in when the price was lower) and I was using it through opencode and it was like I'd only get maybe an hour of usage (if that, sometimes) before it would time out and say come back in 5 hours. Now I'm using it through their Zcode harness and I rarely hit that - they say they're giving 1.5x usage if you use it through Zcode, sometimes seems like even more than that.
I found this with kimi k2.7 as well: on paper it should be quite cheap, but it's not because it uses a lot of tokens for quite simple tasks
> I've yet to find a way to run it on a monthly sub reliably for cheaper than Codex.

Matches my experience, I got their Pro subscription and while I enjoyed the model itself a lot and while their ZCode harness is also pretty nice, it gave me less tokens for similar amounts of money that Anthropic would give me on a subscription: https://blog.kronis.dev/blog/z-ai-s-glm-5-2-is-a-great-model...

I'm yet to try out Kimi, but if their subscription were to be anywhere comparable to Anthropic/OpenAI, I might just switch over because competition is good.

DeepSeek V4 Pro is really affordable per-token but regularly kept making mistakes in the tasks I gave it. I mean I could at least afford the tokens to go over the work a 2nd, 3rd, 4th and 5th time and gradually fix most of the issues, but it was a very frustrating mode of work.

It also depends on how many tokens it needs to burn through to accomplish something.

At this point, I always look at things like Artificial Analysis' total cost to run their tests. It'll take into consideration the cost of tokens, how many tokens it burns through, and how effectively it uses caching (and the price of that caching).

If a model "costs the same" but its reasoning ends up going through a ton more tokens, it doesn't really cost the same in real world usage.

I believe Kimi is spending more on marketing than GLM (a lot of ads lately) so I guess that's part of what the higher price supposed to cover.
> That said, Kimi is competing against GLM in my mind, and GLM 5.2 is less than 1/3 the price.

Having used GLM 5.2 extensively and K3 for a few hours now, these models are nowhere near each other. 5.2 is a great model, and I use it for a lot of things, but it's noticeably below Opus 4.8 or GPT-5.5 in real-world usage.

K3 is in the same ballpark as Fable or Sol.

Yeah... it's as if vendors hawked cars and announced expected range on a tank of gas.

But some cars have a 15 gallon tank and others a 50 gallon tank.

Will be interesting to see how it stacks up pricing wise on the various inference providers.
And as a gift, you can hand over your data to the Chinese regime.
I have absolutely zero sympathy for Western model providers.

Bring on the Chinese token-dumping onslaught.

Sadly these days this seems like the least worse of the three major regimes.
You are in a bubble. They just raided independent book stores in Hong Kong.
I measure good and bad by proximity to me. China can directly hurt me the least, the US can hurt me the most.
Better than handing it over to the US regime.
Yeah a liberal democracy that outwardly promotes human rights, freedom, democracy, and liberalism is worse than the country that kills their own people, covers it up, has 0 political freedom, and 0 freedom of speech.

I used to think TDS was a myth, but I'm starting to think it's real.

F trump btw. But thinking China is better? Woooooow

and yet here you are on an american site providing data. what about youtube or reddit? I don't think you actually care in reality. otherwise you wouldn't be here to comment.
I'd much rather give my data to China because I don't live there, so there's not a whole lot they can do to me. The US, on the other hand, has a lot leverage over my life and freedom.
Or just host it yourself or on your country's cloud provider once they release the weights.
Right at this moment, there are more people in the world on the side of China than on the side of the USA. Which can translate into raw market numbers at some point. So these comments are kinda moot.
Well that is insane.

Guess the United States isn't the only country filled with idiots.

Maybe the Democracy Index can make this a little more fact-based: https://en.wikipedia.org/wiki/The_Economist_Democracy_Index

USA = Flawed democracy

China = Authoritarian

I don't really know how well they do this index, but probably better than a random HN comment.

Again, you might be against Chinese government. People aren’t the world perceive China in a better light than the USA right at this moment.
That's not what the actual data shows. The American frontier providers captured the entire market. China is getting the scraps.

https://gs.statcounter.com/ai-chatbot-market-share

That is correct, but that’s not what I’m talking about. A lot of people complain about handing their data to Chinese government. My argument is, as of today, people like China more than the US. And the American government has publicly said that they’re basically controlling all AI labs if needed. So yeah.
The thing is - as a European, I can choose between plague and cholera.

One has mostly been reliable, stayed peaceful towards us and is primarily concerned with their internal matters and the countries right next to it. They have long-term strategy and understanding of win-win situations.

The other one keeps threatening to invade/steal Greenland. Keeps waging an economic war against the entire bloc. Positions their propagandists right in our middle and does the best to influence our elections. Exports fascism and finances antidemocratic forces. Supports the genocide in that certain country. And still have their soldiers in our country, against the wishes of a majority of the population. Oh and they don't honor any treaties if they feel like it.

Easy choice.

Does that make china an angel? Hell no, they are still committed to enslaving the Uyghur people, keep threatening neighbors and are mostly han supremacists. Human rights are seen as merely a suggestion by them.

But at the time being, one is clearly more reliable than the other. Long-term, I'd like to avoid both the US and China.

But sometimes we just like to bury our heads in the sand and pretend that the sky really isn't falling. Greenland is simply a vast liability and security hole for all of Europe. It's essentially defenseless.

It may not fit the zeitgeist and might offend our Danish friends' sense of historic Viking land claims (Leif the Lucky!), but Denmark literally can't defend it. Trotting out a few dozen hardy NATO warriors would probably not keep the US from "invading" it if that's what US really wanted to do.

Meanwhile, both Russia and China are encroaching and essentially taking control of the northern sea route (both under and increasingly over the ice).

It seems like we have no interest in strengthening NATO, either. We want the USA to carry all the weight even though we know that a strengthened/expansionist Russia is obviously bad for Europe.

Selling it to the US would simply be the rational thing for everyone - but we just can't, because Trump is a bad man and the US is a bad country. We repeat this literally until we make China out to be the good country because they give us a few open models. It's so ironic.

The last time China bombed a foreign country was nearly 50 years ago.

A very inconvenient truth for the China hawks.

No, just aesthetic trivia that can be paraded around to make them look good.

Given how China behaves it should be evident that the only reason they don't apply military force is because they are not in position to. Not abusing military strength is not exactly being the paragon of virtue when your opposition could probably glass the world thrice before the day is over.

>Keeps waging an economic war against the entire bloc.

>Positions their propagandists right in our middle and does the best to influence our elections.

>Exports fascism and finances antidemocratic forces.

>Supports the genocide in that certain country.

>Oh and they don't honor any treaties if they feel like it.

I don't know how anyone can really mention any of these when trying to paint a bad picture of anyone as compared to China. It's just an obscene exercise in ignorance. I just can't make sense of discourse like this except as a result of propaganda.

I won't go through everything, but just as an example:

You are not mentioning the greenland situation - why? That's the really big one and the one that made the US much closer to "enemy" than "friend". After all, friends don't threaten to annex your territory.

Regarding propagandists and financing of antidemocratic forces: this refers to a current issue. US is deliberately financing spreading of its ideology in the EU, as they confirmed themselves. [0]

With the genocide, that discussion I'm going to stay clear of, as nobody will be convinced of the other position anyway, too heated. Shouldn't have mentioned it in the first place, as this always leads to flamewars. mb.

Regarding honoring of treaties: let's start with the budapest memorandum - I think that was the first really big one. Then, the 1967 Refugee Protocol which forbids third-country deportations. Then, the UN Framework Convention On Climate Change. Violation of the UN charter, withholding of promised funds. The Convention Against TOrture.

Then all the broken/ignored/overturned trade treaties, all the promises made and not kept - how would anything rely on their word at all anymore?

I could go on for multiple pages. Why do those not count? Why do they have to be "propaganda"?

It is unbelievably difficult being reliant on the US in any way right now. And that's what I'm talking about. Not, which is the "better" country. Reliability and ... well, utility to its partners is the basis of it all. Which right now - compared to china - is rapidly sinking. So where is that ignorance you are speaking of?

[0]: https://web.archive.org/web/20260716141817/https://www.thegu...

It's an open model, you can just wait a few days and you'll get to choose who to hand it over to, or given the resources you can run it on your own box.
I eat 1M context in a local model in about 3-4 hours.

It'd need to be exceptionally smart and error free to ever make sense.

Agreed re reasoning. I’ve seen this play out with 5x reasoning negating cost savings.
Are thinking models only the reasonable tradeoff vs using much larger non thinking ones because the cost of output tokens is below that of input tokens?
It seems the subsidized era is nearing its end and we'll see a convergence on API pricing before a pulling of subscriptions pricing.
That’s not what this indicates. This is the biggest and most expensive to serve, and most capable open weights model yet. They’re just pricing it in line with capabilities.

Kimi also offers generous subscriptions. Subs aren’t going anywhere. Think of subs like running an insurance business. There might be some users you lose money on (ones who max out their weekly quota without fail), but they’re managed such that the average subscription turns a healthy profit. There’s never been subsidies in model serving, inference is just cheaper in terms of ops TCO than people assume, and API margins are very high.

> They’re just pricing it in line with capabilities.

So... convergence?

> but they’re managed such that the average subscription turns a healthy profit.

It didn't work like that, or at least that's not how it played out. People max-out their subs all the time which is why strict and multiple limits were implemented by all providers. Also, I subscribe to z.ai and recently they dropped the quota significantly that now their sub offers less than Claude and OpenAI. It's still x5-6 what it would cost on API costs though.

> inference is just cheaper in terms of ops TCO than people assume, and API margins are very high.

API margins (at least american ones) are probably healthy. But I don't think that inference is that cheap. It would cost 300-500k to just run GLM 5.2. There are lots of other factors too: reliability (can you keep the GPUs running all time), electricity cost, sys. admin costs, location costs, etc.. I wouldn't be surprised if the API margins are quite close to operational costs.

Ah, the old "subsidized" meme always rearing its head. Yawn.
The big danger here is the gradual increase in open-weight subscription costs. I use open weight subscriptions, with lower-cost models for 80% of my tasks and GLM-5.2, Qwen 3.7-Max, Kimi-K2.6/2.7-Code for the 20% that need the most intelligence. That lets me maximize the rate-limit the subscription gives (rate limits per model are literally a price-limit-per-token/model). When new/more expensive open weights come in, providers phase out older/cheaper models. Over time we will either have to pay more, or use our subscriptions less.

And it goes without saying, but if the open weights become as expensive as SOTA models, there's no point in using open weights. If nobody pays for open weights' development, the development dies out, and we're stuck with a US-controlled duopoly again. The worst case scenario for the world is being dependent on 1 or 2 US companies for the most important technology. Prices will increase, quality will decrease, and the US's new single-party authoritarian regime will oppress the world like never before.

It’s open weight, so the price will end up being the marginal cost of hosting it.

Personally, I like that there is an option to not send data to companies that have strong financial incentives to steal it.

Also, open weight foundation models can be distilled, so they’re providing a service that the US duopoly is actively blocking. Given that app specific distillation can get > 10x improvements on inference cost (with slight improvement of quality), it’s clear that it’ll win out over time.

(comment deleted)
Im excited for the labs with more data RLHFing this (e.g. cursor). That model will be crazy.
> reasoning efficiency matters directly for how expensive a model actually is in real use

I have high hopes on this topic, given token efficiency seemed to be the primary (only?) goal of the K2.7 Code release.

Excited to see the signals that come out of the big eval/benchmark sites.

This is too expensive to be a viable model. If it were $5/1m output, it might be another story. At these prices, there's no reason to use this over GPT 5.6.
neither ClosedAI nor Misanthropic will let you use their models without them watching and storing the exchanges indefinitely. no sane company dealing with PII and/or trade secrets allows its employees to use those.
In context it seems your recommendation is to instead send those data to models within Chinese nation-network space. I’m not here to defend US frontier model companies; your accusation is probably accurate. But I doubt sending data to China is an improvement.
with open weight models, you have three other options

A) use a provider that pinky-swears not to store your data. they obviously don't give a fuck about 'distillation attacks', so they have little motivation to voluntarily monitor and store your queries. reasonable certainty of privacy.

B) rent the hardware and run the model yourself. very high certainty of privacy.

C) buy the hardware and run the model yourself. absolute certainty of privacy.

(comment deleted)
Is this really true? I was led to believe my company had an enterprise zero data retention agreement with them and it’s why we didn’t get access to Fable

Is there proof of what you’re saying or is it just a guess?

oh, I've no doubt the US government and giga corporations can get zero data retention without ten pages of fine print. the rest of us can't.
> zero data retention

Zero data retention is also "trust me dude".

There is no viable way of checking they are actually doing that.

That's assuming they don't put carve-out clauses in, like Anthropic did with Fable, which means data retention is back on the cards, no exceptions.

Also don't forget a zero data retention clause is still subject to the good old "law, or court or administrative order" contract clauses. :)

To get properly close to real zero-retention in a hosted model, you would have to use one of the verifiably private AI that runs in enclaves, e.g. Tinfoil (US) or Privatemode (Germany)[2]. Yes, still not the same as running on your own hardware, but a million lightyears ahead of "zero data retention" "trust me dude" clauses.

[1]https://tinfoil.sh/ [2]https://www.privatemode.ai/

No I know of course, I don’t trust them as far as I can throw them when all of these companies committed the largest copyright theft in human history to build the models.

I just wanted to know if that other person had proof or not, and I guess they didn’t. I would still rather have some semblance of an agreement than not have one at all — if you’re coding on a consumer plan you should just 100% assume anything you write with it will end up in the training set

Anthropic has refused to provide ZDR for Fable specifically, even on Enterprise.
Read the terms of the ZDR policy with a critical eye. You’ll find that Anthropic retains almost arbitrary rights to retain anything it wants.

https://code.claude.com/docs/en/zero-data-retention

AFAIK there’s no ZDR with Claude models accessed directly via Anthropic. You’d have to go through either Google Vertex, Azure or AWS for true ZDR (at least legally/on paper).
How do Kimi's subscriptions work? I find their price structure pretty confusing
Some official benchmark numbers posted in Chinese social media (I am sure they will publish an English blogpost later too):

https://mp.weixin.qq.com/s/V4xhEIy8xDXSMDPrPkmUAQ

Generally looks like a Sol/Fable tier model, better across the board than Opus 4.8.

It's like reading Anthropic's obituary.
This is weird and reactionary. Lots of organizations are continuing to refuse to use chinese models due to security and IP concerns. Anthropic/american models aren't going anywhere anytime soon.
Nope, but I think this is maybe the critical mass needed to finally crash the AI hype/datacenter cost problem everyones is talking about.

With Oracle being junk before this, more will follow.

Models need datacenters to run. It also need other services to do anything useful
I would assume the opposite is true — with an open-weight Fable-class model, doesn't demand for GPUs go up? Plenty of companies can now look at what Anthropic is offering — high per token costs for a very intelligent model — and do the math, and at some point it makes sense to just rent the GPU yourself and run Kimi on it if you get similar intelligence without paying Anthropic's margins (albeit with high upfront capital cost).

This would drive down Anthropic's margins, but drive up demand for datacenter and GPU capacity. It's not that people would be using fewer GPUs, they'd just shift demand from high priced token vendors to direct GPU rental.

Its a margins game. If its too cheap to run, its not worth the investment.
You can run open weight models anywhere.
If it ends up being open weights, companies will use it running in US data centers.
> Lots of organizations are continuing to refuse to use chinese models

Correction: Lots of organizations are refusing to use Anthropic Fable because they have forced opt-in data collection as part of their privacy policy, even for Enterprise.

Both things, and both reasons, can be true at the same time.

Not everyone's going to care about Anthropic requiring data collection (a similar debate plays out with regards to "pay or consent" on website tracking), just as not everyone cares about China with regards to security/IP issues (if they did, a lot more would be banned besides occasionally-Huawei).

> Lots of organizations are continuing to refuse to use chinese models due to security and IP concerns

This is such a common omission: the Chinese models are open, you can host them yourself on your premises. So privacy and independence.

it's well documented that models can be adversarially trained with essentially backdoors in response to special inputs

while I am skeptical that this is happening atm, there are probably many industries where the risk does not seem worthwhile

I feel like that's a threat that isn't super difficult to block. Unplug it from the internet, require it to go through an API intermediary to access web pages.

Maybe I just don't have any imagination.

It could generate code that's plausible but has intentional flaws, kind of like the defunct underhanded C contest [0], except through a LLM.

[0] https://en.wikipedia.org/wiki/Underhanded_C_Contest

It could, but exposing that would doom the company entirely, and AI doesn't generate code with near the quality needed to get a model to mass adoption, insert malicious underhanded code, ensure that consistently looks innocuous enough to never be noticed, and- most importantly- actually exfiltrate data without being noticed. Once it is noticed, it's game over across the board.
When the model is open weights you can even pass every token (including the chain of thought) though a fourth-party lightweight model like gpt-oss-safeguard to check that it has not become adversarial.
I suppose this is like when Anthropic was using “prompt modification, steering vectors, or parameter-efficient fine-tuning” to poison the work of people working in the LLM field, including academic researchers.
No, that was totally different. They were just doing that for your safety.
(comment deleted)
Good luck hosting 2.8T params yourself. A box capable of this at a useful performance level is at least $100k.
For several export controlled industries in the United States, even self-hosting a Chinese model is a non-starter.
Cursor will rebrand it as Composer 3.0 to assuage any such concerns, as they did with the previous Kimi models.
More likely for them to use Kimi 2.7 since Grok is now the flagship product.
This is apparently Open Weights, so no reason Amazon can't serve it alongside GLM which they already do.
Nah:

https://www.youtube.com/watch?v=LSlV206xPqM

These real world examples show it's one tier away.

(comment deleted)
These "real world" examples are nothing like the way I use LLMs from within a harness. GPT 5.6 Sol and Fable are clearly more impressive, but how does this translate to interactive agent use, or use under an agent orchestration framework?
This is a question I am going to get an answer tomorrow with evals. Extremely interesting...
Certainly for their IPO, anyway
The link has 6 well-known benchmarks where this beats Fable (out of 14 I counted). If the numbers hold up scrutiny, this is scary good.

Forget about their pricing but the companies that do have means to host such models fully on-prem are also the same companies that are paying tens of millions of $ in inference cost every month, and are by extension the biggest customers of OAI and Anthropic

Open Source >>> Closed Source [1]

I don't want to cheer against my country, but we've given up on open source. The way Anthropic and OpenAI treat their customers as adversaries is embarrassing.

I will cheer for China, for Kimi, and for z.ai until we have something in the same category.

[1] I'd even be fine with open weights, fair source, or anything that let us have direct access to the weights. Even if that came with stipulations. Don't hide the weights from us.

I am with you in the spirit of openweights but I am trying to hard-avoid bringing countries into this. The narrative of US vs China only benefits those who want regulatory capture in the US since attacking China is politically much easier than attacking open-weights, so certain groups like to repeatedly call them 'Chinese models'.
It's much more a rallying cry for open weights funding than it is for regulatory capture.

The argument on our side wins - if America or the West don't do open source, China will. And that means -- with certainty -- that China wins the market.

Every politician and VC should hear that loud and clear.

> If the numbers hold up scrutiny, this is scary good.

After using it for a few hours, I believe these benchmarks.

I think given how much benchmaxxing we're seeing - the anecdotal evidence of how competent this model is (and efficient) will depend on user's actual real-world use cases.

Given the pricing, it suggests that this model is much more efficient/competent than previous-gen OS/distilled models.

Crazy how their models always come out after the US labs and just lag the performance of top models. Almost like they are performing distillation attacks... how strange.
distillation attack? why the violent word choice? When OpenAI crawled Github was that an attack?
Distillation is not an attack. It simply a way to train a model. Not doing it when you are behind is akin to snatching defeat from the jaws of victory.
It is an attack at a sufficient level of sophisticated analysis. If you destroy the game theoretic first mover advantage, then you destroy the economic incentive to improve things.
Given that model distillation has existed since the early days of the current AI boom, and no robust defense has been demonstrated, the available evidence does not support your theory.
Does it have safety guardrails that constantly false positive like Claude does? The only obvious change I’ve seen since opus 4.6 came out is that it constantly flags my requests (no, I’m not doing biology research or security research, yes, it flags for both of those things).

Recently, they backported the blocks to Opus 4.8, so I’m reluctantly stuck on sonnet.

I probably could successfully apply to get special approval to use claude code unencumbered, but I don’t think it is ethical to support tooling that’s built so a central authority gets to decide what intellectual endeavors and knowledge work are permissible, and what are not.

I've been avidly using Fable since it was re-released and while it has been excellent at building the apps I want, the reasoning has been completely opaque.

Kim, however, has exposed the whole reasoning trace, or enough of it to matter. I'd almost forgotten how nice it is to see this. I've been able to see all of the weird twist and turns it takes and it is joyful. But also, far, far more informative and means I can debug ideas far more thoroughly. Also, at a first glance it seems to have gotten quite far on a niche hobby horse of mine that no LLM has been able to crack. I'll be testing this more for sure.

The reasoning is key as most of the time the summary provided by fable is not enough to understand the choice and correct the logic. You have to either fully trust it or go to an exhaustive code review. This with the fact that you can only use 4.8 to security review the code produce by fable are the reasons I will not renew my anthropic subscription, the current experience is way to degraded.
What will you be replacing it with, if anything?
I have severe complaints about Anthropic's product managers on this front. Their preference for hiding, obscuring, and trying to wrest control from the user are a bit harrowing. It would be wonderful to go back to Claude Code from before March. It seems like every release destroys value for me!
It's a defensive tactic to reduce the effectiveness of distillation.

Say of that what you will, but it's not because they want to wrest control from users.

It's because they don't want Chinese companies to do exactly what Moonshot (Kimi creators) and others have done.

Anthropic’s position being that it is entitled to train models on the creative works of anyone at any time, but its own slop generators’ outputs are sacred jewels that must be protected from being learned from.
also its pretty big model inference costs are high even with margins running a 2.8T model costs a lot. if they release oss may be it goes down to $10-12 per million tokens.
(comment deleted)
Half kidding feature request for HN: Mark all AI related posts so I can filter them out, when I need a pause.
definitely take the breaks when you need them. I've already had a few friends just get lost in the AI train of stuff and suffer mentally a bit.
(comment deleted)
> Among the models tested, its overall intelligence ranks second only to Claude Fable 5 and GPT-5.6 Sol.

> The full model weights of Kimi K3 will be released in the coming days. More details on the architecture, training, and evaluation will be published together with the Kimi K3 technical report.

https://platform.kimi.ai/docs/guide/kimi-k3-quickstart

They've removed the paragraph about releasing model weights.
Excited for the deepseek release this week (or at least they announced they'd release this week). Hopefully they also push even closer to SOTA.
Ohh I didn't know about it. Finally something to be excited about.
I really need to finish my automated model evaluation harness, I can't keep up with this pace
I've playing around in between with Arc-AGI-3 lately. Based on my very quick test prompt, I do not think it will achieve any meaningful score in Arc AGI 3. Not that it was expected to.
> We also further increased the sparsity of the Mixture of Experts (MoE): with the Stable LatentMoE framework, the model efficiently activates 16 out of 896 experts. Together with improvements in training methodology and data recipes, these structural advances give K3 roughly 2.5x the overall scaling efficiency of K2, converting compute into capability more effectively.

Assuming experts are uniformly distributed (I’m really not that familiar with the deep details there), that’s 2800/896*16 = 50 billion active parameters just for the active/expert part. Wild stuff, and I’m glad there’s at least some companies still publishing (and pushing, for open-weight models) total parameter count.

And: It sounds very believable that this would result in efficiency gains wrt. to compute necessary for “good”-quality inference. Does anyone know whether there currently even are any SOTA or near-SOTA models that are dense still?

No, you can't divide the entire size by the expert count. A lot of weights are constant for all tokens, so total active count is ((2800-(shared)/896)*16 + (shared))
TIL, that makes a lot of sense, and thanks for the correction.
Just to add to that, a Transformer block consists of an attention part followed by a feed forward part. MoE only modifies the feed forward part (which basically contains declarative knowledge getting injected into the residual stream).
Amazing to see an open source model already nearing the benchmarks of Fable and GPT 5.6 Sol!

Also very cool to see LatentMoE being picked up by more models (https://arxiv.org/abs/2601.18089)

Surely it's only open weights?
It's not even that right now.
And they have since removed that language…
They will release the weights by 7/27 along with support in vLLM. Stop second guessing. Source: their blog post https://mp.weixin.qq.com/s/V4xhEIy8xDXSMDPrPkmUAQ
Thanks for the link. No need to be so aggressive. The blog with that detail was not live before; and they removed that language from the original link in this post.
It also goes to show that Fable/Sol must be 4-5T in size.
[dead]
LLMs are hopelessly confused about which model they are. Ask DeepSeek V4 Flash which model it is, and it's 50/50 between "I am DeepSeek (深度求索)" and "I am part of the GPT-4 series developed by OpenAI." Ask Claude, it'll say Claude. Ask Claude in Chinese, it'll sometimes say DeepSeek.

It's incredibly funny, but I don't know whether it's related to distillation; it's probably quite rare for a distilled trace to mention which model it came from. (I'm not saying distillation doesn't happen, just that it's possibly unrelated.)

For your specific example, the internet is full of "As a large language model developed by OpenAI, I can't..." due to people pasting chatbot output without reading it. Seems reasonable for that to surface as part of the CoT for your question about model capabilities.

> In our evaluations, Kimi K3 delivers frontier-level performance. Among the models tested, its overall intelligence ranks second only to Claude Fable 5 and GPT-5.6 Sol. For the complete benchmark results, see our tech blog. The full model weights of Kimi K3 will be released in the coming days. More details on the architecture, training, and evaluation will be published together with the Kimi K3 technical report.

> K3 pushes the boundary of end-to-end knowledge work. On the GDPval-AA v2 leaderboard, Kimi K3 scores 1687. The benchmark evaluates AI models on real-world tasks across 44 occupations and 9 major industries; Kimi K3 ranks behind only Claude Fable 5 Max and GPT-5.6 Sol Max, and ahead of Claude Opus 4.8 Max at 1600.

> On AA-Briefcase, Kimi K3 scores 1527, ranking second among all models — behind only Claude Fable 5 Max and ahead of GPT-5.6 Sol Max (1495). AA-Briefcase is a private agentic knowledge-work benchmark developed by Artificial Analysis to evaluate frontier agentic capability in long-horizon knowledge work.

Really good benchmark score it seems. Maybe another DeepSeek moment right here.

> > K3 pushes the boundary of end-to-end knowledge work. On the GDPval-AA v2 leaderboard, Kimi K3 scores 1687. The benchmark evaluates AI models on real-world tasks across 44 occupations and 9 major industries; Kimi K3 ranks behind only Claude Fable 5 Max and GPT-5.6 Sol Max, and ahead of Claude Opus 4.8 Max at 1600.

This is the same benchmark where Sonnet 5 outperforms Opus 4.8 max.

Like all model releases, the benchmarks aren't going to tell the whole story. All of the open weight models come with amazing benchmark results now. It's hard to believe anything other than that the benchmarks are leaking into (or intentionally included) into training data.

Sonnet 5 does beat Opus 4.8 on several benchmarks. It just costs more and takes longer.

(On several other benchmarks, it costs more, takes longer, and does worse.)

Possible, but pay-as-you-go DeepSeek v4 Pro / MiMo v2.5 Pro (from respective vendors) are genuinely good enough as daily drivers, given the costs (especially, cache hit). Coding Plans by MiniMax ($20/mo for 1.7b tokens) and Z.ai ($30/week use for $17/mo) are also tremendous value for money.
> In our evaluations, Kimi K3 delivers frontier-level performance

What page does that come from? I'm having trouble tracking it down.

Where is this from?
That’s an interesting way to say you’re third. I’m only second to the ten other runners on my local Strava segments.
> Maybe another DeepSeek moment right here.

Surely not... What made DeepSeek disruptive was that the cost was 10X lower.

In this case, the cost is about 2X lower the Sol I think?

At 2X, you're pretty close to the error margins due to token efficiency etc...

I'd say this is "on trend" for open models catching up to frontier labs, but its not a "change in the trend" like DeepSeek was IMO.

DeepSeek didn’t really change any trends though, unless you count the stock market.

It was impressive work, but models were commoditizing and inference costs were dropping rapidly already. They were neither the first nor the last 10x optimization, from what I’ve seen.

If you know of any other 10x optimisations currently, please let me know! I'm in the market for a model that's a tenth the price of a frontier model at the same level of quality.
You do understand that the "frontier" people are usually talking about is the cost-intelligence frontier right?

By definition there is no model that is both cheaper and as intelligent or better than another on the frontier.

To be fair the stock market is a big one
It was also disruptive because it was open weight, meaning anyone and their dog could theoretically compete with the frontier labs for their inference revenue.

The frontier labs need to recoup a huge amount of cash to cover their model development costs, and justify their valuations. That’s plausible when they’re only ones capable of selling inference on these models, it a lot less plausible when models themselves become cheap commodities, and you’re just competing on your ability to provide compute. Anthropic and OpenAI can’t compete with people like AWS on that front.

cost has nothing to do with why deepseek was disruptive, the fact that it means there is zero moat around anthropic or openai is what's disruptive about it. it means in the mid-term LLMs will be commoditized and customers will flock to the cheapest inference wherever they can find it. there's no reason to stick to the "frontier" labs
It's different, but similar. If they release the weights, then we have a Fable / frontier model people can tinker with. Either way, it's still quite impressive and knocked a US company out of the top three (google). How long before China dominates the top-10 (if they don't already) or the #1 model?
Account creation with only a phone number or google account is lame.
same, precisely the reason I haven't signed up yet. GLM can be used without any account fwiw
Also, the dark pattern where it shows the interface and lets you enter a prompt/set settings, but then pops up the 'create account' dialog when you press submit is pretty annoying.
Say what you want about these Chinese models but they sure create competition and urgency in the space.
Seems to only use ≈60% as many reasoning tokens as 2.6. So the price hike is not as bad as it looks.
That's a more than 2x jump in parameter count. I know it's not a measure of quality by itself, but it will be interesting how it "scales". Bust it looks like they're gonna be competing with the big boys now, pricing also approaches Gpt 5.6 Terra
It does seem to have retained the K2 series's creative writing abilities, at least with the prompts I've tested so far.
Good that they are keeping it, Kimis way of speaking and conveying some sort of EQ is absolutely the best. The other models might be better at certain things, but nothing comes close to how good Kimi is at understanding language, emotions and reading the room in conversations.

I should maybe also mention that I have not used the later models like Opus or Fable, so my opinion might be a bit outdated.

When I remember that this site even showed Kimi having the highest score at one point https://eqbench.com

Now, will they actually release the weights? Seems like Chinese model providers are slowly closing up, like Alibaba's Qwen 3.6 which did release weights (but not the biggest parameter count ones) and none for 3.7.
In the coming days
Any updated Pareto frontier graphs? https://paraplouis.github.io/llm-pareto-frontier/ is quite out of date now.
I generally rely on LMArena for this: https://arena.ai/leaderboard/code/webdev/pareto

But it does take some days after model release before they collect enough data.

Odd that open AI models aren't on that graph but are on the rankings! Must be a data lag issue?
LMArena's "code" leaderboard is really skewed since it's a front-end JS code and design leaderboard. It generates a demo app with two models and then asks "do you prefer A or B". People can look at the code, but most of the time it's just going to be which one looks nicer.

Models that people like the design aesthetic of (Claude, GLM) tend to do better in LMArena than they do on other benchmarks. Design matters, but you look at a model like GPT-5.5 and it's behind Kimi K2.6, Sonnet 4.6, Qwen3.7 Max, and GLM-5.1 on LMArena's code leaderboard. Then you look at benchmarks like DeepSWE and GPT-5.5 blows them out of the water with only Fable and GPT-5.6 beating it.

I'm not saying that the LMArena leaderboard isn't useful, but I'm not sure how much weight I'd give it as a "code" leaderboard. I think often times it's a design comparison of simple front-end React apps rather than a coding comparison. GLM-5.2 is a very good model, but when you look at DeepSWE or Terminal-Bench v2, GPT-5.5 is well ahead.

I'm curious if they're keeping up mostly due to distillation or how that works. Does anyone outside China know?