Because a math proof is generally de-composable into smaller constituent arguments that can be independently evaluated for correctness. So you can audit a sample of these arguments for correctness without reviewing…
But the article clearly describes how this SCM is just instrumental in their goal to build and serve better models. It's not some unrelated product they hope to sell.
Post-training of LLMs often destroys calibration. The objective is no longer to predict the next token, so it doesn't matter as much whether the probability you assign to next-token "A" is correct, as long as the…
The biggest upside to using a zero-shot classification model is that it's actually zero-shot, i.e., you don't need to construct task-specific training sets. If it needs to be fine-tuned, then why not fine-tune smaller…
It's just marketing. More specifically, it's an answer for why their model can't answer questions that require reasoning.
"Reply with just the letter A, B, or C." There, I fixed your problem.
It would be great to see benchmarks for Jev that demonstrate the value of calibrated uncertainty. For example, one could set a confidence threshold over which we trust the model decision, and otherwise reject. This…
100% agree. The key issue is that users think they are getting results from a specific model configuration and they are clearly not, which is fraudulent. If OpenRouter wants to succeed as a business, they need to be…
How are you supporting the claim that GPT 5.6 is "far more token efficient" than Opus 5? Tokens equal, output is cheaper for Opus 5 ($25/1M) than GPT-5.6-Sol ($30/1M), and it seems to outperform slightly on agentic…
I think you're being overly cynical here. First, I don't see any claim that is the world's best model for agentic coding. Second, it is absolutely the best model in terms of coding performance vs. dollar, and it's raw…
A lot of people in this thread think they're being clever by pointing out that a bookstore can't sell "banned" books. But it's common for bookstores and libraries to feature titles that have been banned in some…
Automatic coding systems have way too much economic value to be considered a "fad". I don't think you need to be Nostradamus to predict that we're never going back to manual coding. Sure, the systems will evolve and…
You're describing "modularity" or "loose coupling" in code. But it rarely implies you can just delete files or directory. It usually just means that a change in one component requires minimal changes to other components…
He's most definitely talking about a white homeland [1][2] [1] https://x.com/elonmusk/status/1962406618886492245 [2] https://en.wikipedia.org/wiki/Remigration
The win is in how many weights you process per instruction and how much data you load. So it's not that individual ops are faster — it's that the packed representation lets each instruction do more useful work, and…
I still don't understand is why they don't even make an attempt to apply overlayers, when (as the author notes) there is ample secondary evidence that it would be present. It's not like there isn't already some element…
> I can only say being against this is either it’s self-interest or not able to grasp it. So we're just waving away the carbon cost, centralization of power, privacy fallout, fraud amplification, and the erosion of…
I've never heard the caveat that it can't be attributable to misinformation in the pre-training corpus. For frontier models, we don't even have access to the enormous training corpus, so we would have no way of…
Yes, as is implied by the word "improvements"
You started this by objecting to my wording ("among the most") when I said fish/chicken are the most sustainable meat options. They are, by a wide margin. Beef’s footprint is roughly 10× higher, so swapping a beef meal…
I agree it’s worth comparing beef sources! That was my point about within-category differences and harm reduction. Saying "tofu is cleaner" doesn’t make beef comparisons pointless - just like the existence of bicycles…
Hah, why don't you try implementing your 3 little functions and see how smart your "AGI" turns out. > not a particularly capable AGI Maybe the word AGI doesn't mean what you think it means...
A “sufficiently smart compiler” can’t legally skip Python’s semantics. In Python, p.x * 2 means dynamic lookup, possible descriptors, big-int overflow checks, etc. A compiler can drop that only if it proves they don’t…
It's a OpenAI researcher that's worked on some of their most successful projects, and I think the criticism in his X thread is very clear. Systems that can learn to play Atari efficiently are exploiting the fact that…
I am quite confident that an LLM will never beat a top chess engine like Stockfish. An LLM is a generalist -- it contains a lot of world knowledge, and nearly all of it is completely irrelevant to chess. Stockfish is a…
Because a math proof is generally de-composable into smaller constituent arguments that can be independently evaluated for correctness. So you can audit a sample of these arguments for correctness without reviewing…
But the article clearly describes how this SCM is just instrumental in their goal to build and serve better models. It's not some unrelated product they hope to sell.
Post-training of LLMs often destroys calibration. The objective is no longer to predict the next token, so it doesn't matter as much whether the probability you assign to next-token "A" is correct, as long as the…
The biggest upside to using a zero-shot classification model is that it's actually zero-shot, i.e., you don't need to construct task-specific training sets. If it needs to be fine-tuned, then why not fine-tune smaller…
It's just marketing. More specifically, it's an answer for why their model can't answer questions that require reasoning.
"Reply with just the letter A, B, or C." There, I fixed your problem.
It would be great to see benchmarks for Jev that demonstrate the value of calibrated uncertainty. For example, one could set a confidence threshold over which we trust the model decision, and otherwise reject. This…
100% agree. The key issue is that users think they are getting results from a specific model configuration and they are clearly not, which is fraudulent. If OpenRouter wants to succeed as a business, they need to be…
How are you supporting the claim that GPT 5.6 is "far more token efficient" than Opus 5? Tokens equal, output is cheaper for Opus 5 ($25/1M) than GPT-5.6-Sol ($30/1M), and it seems to outperform slightly on agentic…
I think you're being overly cynical here. First, I don't see any claim that is the world's best model for agentic coding. Second, it is absolutely the best model in terms of coding performance vs. dollar, and it's raw…
A lot of people in this thread think they're being clever by pointing out that a bookstore can't sell "banned" books. But it's common for bookstores and libraries to feature titles that have been banned in some…
Automatic coding systems have way too much economic value to be considered a "fad". I don't think you need to be Nostradamus to predict that we're never going back to manual coding. Sure, the systems will evolve and…
You're describing "modularity" or "loose coupling" in code. But it rarely implies you can just delete files or directory. It usually just means that a change in one component requires minimal changes to other components…
He's most definitely talking about a white homeland [1][2] [1] https://x.com/elonmusk/status/1962406618886492245 [2] https://en.wikipedia.org/wiki/Remigration
The win is in how many weights you process per instruction and how much data you load. So it's not that individual ops are faster — it's that the packed representation lets each instruction do more useful work, and…
I still don't understand is why they don't even make an attempt to apply overlayers, when (as the author notes) there is ample secondary evidence that it would be present. It's not like there isn't already some element…
> I can only say being against this is either it’s self-interest or not able to grasp it. So we're just waving away the carbon cost, centralization of power, privacy fallout, fraud amplification, and the erosion of…
I've never heard the caveat that it can't be attributable to misinformation in the pre-training corpus. For frontier models, we don't even have access to the enormous training corpus, so we would have no way of…
Yes, as is implied by the word "improvements"
You started this by objecting to my wording ("among the most") when I said fish/chicken are the most sustainable meat options. They are, by a wide margin. Beef’s footprint is roughly 10× higher, so swapping a beef meal…
I agree it’s worth comparing beef sources! That was my point about within-category differences and harm reduction. Saying "tofu is cleaner" doesn’t make beef comparisons pointless - just like the existence of bicycles…
Hah, why don't you try implementing your 3 little functions and see how smart your "AGI" turns out. > not a particularly capable AGI Maybe the word AGI doesn't mean what you think it means...
A “sufficiently smart compiler” can’t legally skip Python’s semantics. In Python, p.x * 2 means dynamic lookup, possible descriptors, big-int overflow checks, etc. A compiler can drop that only if it proves they don’t…
It's a OpenAI researcher that's worked on some of their most successful projects, and I think the criticism in his X thread is very clear. Systems that can learn to play Atari efficiently are exploiting the fact that…
I am quite confident that an LLM will never beat a top chess engine like Stockfish. An LLM is a generalist -- it contains a lot of world knowledge, and nearly all of it is completely irrelevant to chess. Stockfish is a…