Claude is very cache friendly, however there have been some inconsistencies with non anthropic endpoints that led to cache breakages
Glaciers have never been accessible to most people. The night sky has, until recently.
Yes Americans can do both, unless their boss dislikes it, but that applies the world over.
Has he made anything else interesting?
When I use it for fiction, I generally switch models 2-3 times per response. It's basically normal
Tools come with a tool description in json schema format, but yes your point stands, it is not enough for opus 4.8 which I've also noticed having tool call issues.
> Yeah, but the biggest plus for open models is that they can never be taken away. In other words, whatever capabilities they reach (even if there will never be another model), those stay forever. In theory yes, but the…
> Interleaved reasoning and function calling makes this even more dangerous. A model can call functions during the hidden reasoning phase. The reasoning may be hidden but the tool calls are not, how else would the…
Hah, I noticed the same thing writing fiction with fable. Most models seem to go into a sort of "storytelling mode" where they forget their PhD level smarts. I had a character who is doing repair on a satellite. Most…
For Claude models at least, you can tell to just manually think in the output and it works fine. I do it reguralrly because for creative writing and summarization, they seem to believe they don't need to think at all,…
None of them even expose thinking anymore. You're seeing a summary
It's pretty hard to measure because most context rot comes from related context and the model has to be able to figure which parts are truly relevant, which ones are relevant but stale, which ones to ignore etc. Each…
I don't use Claude Code. I use my own handwritten agent (formerly using Pi) and know every token that goes into it. There are zero memories to confuse it. The system prompt is 200 tokens and completely self consistent.…
I see this said often and find it insane given how many times I find opus models making basic recall mistakes at <100k tokens. Personally I consider < 60k to be the smart zone for opus. This is worse for opus 4.7 and…
What do you mean by custom format? Non-json?
What is the "house" harness for minimax? They haven't released any
If this is what we get without editors I want every thing I read to be without editors
Probably not as fast as a simple regex but static embedding models can get stupid fast e.g https://www.flowercomputer.com/news/fast-static-embedding/
It is a little ironic coming from the most prolific AI poster here
Also is this an official Microsoft dev blog? Probably not a good look back at publishing hq
You can get the best of both worlds with a small embedding model
The social section is also just selecting for introverts it asocial people But they expect a few wrong
In my experience above 60k quality noticeably drops. 30k for open source models
What's wrong with the name? The step function is a pretty well known one
Here's another: https://xcancel.com/FireworksAI_HQ/status/206010388602804673... Fireworks is processing 30T tokens a day on open models, or about 210T a week. So about 40% of gemini? I'd say that's pretty good. Two more…
Claude is very cache friendly, however there have been some inconsistencies with non anthropic endpoints that led to cache breakages
Glaciers have never been accessible to most people. The night sky has, until recently.
Yes Americans can do both, unless their boss dislikes it, but that applies the world over.
Has he made anything else interesting?
When I use it for fiction, I generally switch models 2-3 times per response. It's basically normal
Tools come with a tool description in json schema format, but yes your point stands, it is not enough for opus 4.8 which I've also noticed having tool call issues.
> Yeah, but the biggest plus for open models is that they can never be taken away. In other words, whatever capabilities they reach (even if there will never be another model), those stay forever. In theory yes, but the…
> Interleaved reasoning and function calling makes this even more dangerous. A model can call functions during the hidden reasoning phase. The reasoning may be hidden but the tool calls are not, how else would the…
Hah, I noticed the same thing writing fiction with fable. Most models seem to go into a sort of "storytelling mode" where they forget their PhD level smarts. I had a character who is doing repair on a satellite. Most…
For Claude models at least, you can tell to just manually think in the output and it works fine. I do it reguralrly because for creative writing and summarization, they seem to believe they don't need to think at all,…
None of them even expose thinking anymore. You're seeing a summary
It's pretty hard to measure because most context rot comes from related context and the model has to be able to figure which parts are truly relevant, which ones are relevant but stale, which ones to ignore etc. Each…
I don't use Claude Code. I use my own handwritten agent (formerly using Pi) and know every token that goes into it. There are zero memories to confuse it. The system prompt is 200 tokens and completely self consistent.…
I see this said often and find it insane given how many times I find opus models making basic recall mistakes at <100k tokens. Personally I consider < 60k to be the smart zone for opus. This is worse for opus 4.7 and…
What do you mean by custom format? Non-json?
What is the "house" harness for minimax? They haven't released any
If this is what we get without editors I want every thing I read to be without editors
Probably not as fast as a simple regex but static embedding models can get stupid fast e.g https://www.flowercomputer.com/news/fast-static-embedding/
It is a little ironic coming from the most prolific AI poster here
Also is this an official Microsoft dev blog? Probably not a good look back at publishing hq
You can get the best of both worlds with a small embedding model
The social section is also just selecting for introverts it asocial people But they expect a few wrong
In my experience above 60k quality noticeably drops. 30k for open source models
What's wrong with the name? The step function is a pretty well known one
Here's another: https://xcancel.com/FireworksAI_HQ/status/206010388602804673... Fireworks is processing 30T tokens a day on open models, or about 210T a week. So about 40% of gemini? I'd say that's pretty good. Two more…