I'm not sure if the page is not fully loaded for me, because there are a lot of gaps in it, but from what I can see, I still have no idea what "Ode" is. The entire page is just empty marketing without saying anything.
Adam doesn't use the second derivatives matrix, it uses second moments of the gradient, which is the diagonal of the uncentered covariance matrix, but neither of them are directly related to SVD or singular values…
Last statement is a bit sus... Muon computes matrix sign function which can be defined as setting singular values to 1, though you can also define it without SVD. Muon itself doesn't use SVD because it uses a faster…
I am sure they also use Google search and Google maps, and it gives them an even greater advantage
A better solution might be not to constrain the generation, but to remove invalid fields from the tool call in the assistant message. So on the next turn, the model receives chat history which contains it's tool call,…
You can take the output of the matrix LSTM, which is going to be matrix for each token, and compute the SVD. To get better storage, we want U and V to be the same for all tokens, so that we can operate on the diagonal S…
That's useful, but wouldn't help with this particular experiment because they orthogonalize activations, not weights
LFM 2.5 1.2B instruct, it's good at instruction following as long as the instruction is short and simple. Gemma 4 E2B is even better than LFM but I don't know if you can fit it in 3GB. Qwen 3.5 0.8B and 2B are smart but…
I can run Qwen3.6-35B-A3B at 20 TPS on my laptop with RTX 5070 Ti, with partial offloading to RAM. But the most I do is mess with it when I'm bored. I do coding by hand, but I often run autoresearch loops using free…
Just like me! I like AI because of how smart I am.
I am interested to know why people use those graph based agentic frameworks. Why not just define the behavior in python?
Or attach an LSP server with a type checker and require the model to produce strict strongly typed python code
> we would never conclude that the LLM has conjured up digital re-creations of Julius Caesar and Genghis Khan At some point the AI might become so powerful that whatever it reasons through isn't any less real than a…
I've been running stuff like this too. I ran one "benchmark" where there are 10 agents, each agent initially only knows the name of the next agent in the list, and the goal for them is that each agent has a unique order…
I use the one in Google search
Running local agents 24/7, I get that it's a powerful CPU or GPU or whatever it is, but still, isn't it going to be constantly loud and 95C hot, that can't be good for the laptop if it's like that 24/7
MCP is a way to define tools that works with many apps and has a lot of extra functionality built in, it's not the only way, but it's popular because many apps support it. You can also make tools using the opencode API…
Isn't MCP just a way to give agent tools? When you are building your own agent, you can define the tools manually, but if you're using something existing like opencode, how do you add new tools as a user? You use the…
This article was generated from the original Qwen3.7-Max release blogpost and contains nothing new https://qwen.ai/blog?id=qwen3.7
It optimized the Extend Attention operator in triton. All models were optimizing the same operator
Out of curiosity, how much does it cost to daily drive Claude like this?
Why sloptember when it's may
How does x.cos().cos() work faster than doing two cos calls separately? Like the first cos call returns a tensor either way, the only difference is that it's not assigned to a variable. But how is it even possible know…
Can you please train Qwen 3.5 like 0.8B to 9B using the same training techniques
They don't use the old model, they use EMA of the trained model weights as teacher
I'm not sure if the page is not fully loaded for me, because there are a lot of gaps in it, but from what I can see, I still have no idea what "Ode" is. The entire page is just empty marketing without saying anything.
Adam doesn't use the second derivatives matrix, it uses second moments of the gradient, which is the diagonal of the uncentered covariance matrix, but neither of them are directly related to SVD or singular values…
Last statement is a bit sus... Muon computes matrix sign function which can be defined as setting singular values to 1, though you can also define it without SVD. Muon itself doesn't use SVD because it uses a faster…
I am sure they also use Google search and Google maps, and it gives them an even greater advantage
A better solution might be not to constrain the generation, but to remove invalid fields from the tool call in the assistant message. So on the next turn, the model receives chat history which contains it's tool call,…
You can take the output of the matrix LSTM, which is going to be matrix for each token, and compute the SVD. To get better storage, we want U and V to be the same for all tokens, so that we can operate on the diagonal S…
That's useful, but wouldn't help with this particular experiment because they orthogonalize activations, not weights
LFM 2.5 1.2B instruct, it's good at instruction following as long as the instruction is short and simple. Gemma 4 E2B is even better than LFM but I don't know if you can fit it in 3GB. Qwen 3.5 0.8B and 2B are smart but…
I can run Qwen3.6-35B-A3B at 20 TPS on my laptop with RTX 5070 Ti, with partial offloading to RAM. But the most I do is mess with it when I'm bored. I do coding by hand, but I often run autoresearch loops using free…
Just like me! I like AI because of how smart I am.
I am interested to know why people use those graph based agentic frameworks. Why not just define the behavior in python?
Or attach an LSP server with a type checker and require the model to produce strict strongly typed python code
> we would never conclude that the LLM has conjured up digital re-creations of Julius Caesar and Genghis Khan At some point the AI might become so powerful that whatever it reasons through isn't any less real than a…
I've been running stuff like this too. I ran one "benchmark" where there are 10 agents, each agent initially only knows the name of the next agent in the list, and the goal for them is that each agent has a unique order…
I use the one in Google search
Running local agents 24/7, I get that it's a powerful CPU or GPU or whatever it is, but still, isn't it going to be constantly loud and 95C hot, that can't be good for the laptop if it's like that 24/7
MCP is a way to define tools that works with many apps and has a lot of extra functionality built in, it's not the only way, but it's popular because many apps support it. You can also make tools using the opencode API…
Isn't MCP just a way to give agent tools? When you are building your own agent, you can define the tools manually, but if you're using something existing like opencode, how do you add new tools as a user? You use the…
This article was generated from the original Qwen3.7-Max release blogpost and contains nothing new https://qwen.ai/blog?id=qwen3.7
It optimized the Extend Attention operator in triton. All models were optimizing the same operator
Out of curiosity, how much does it cost to daily drive Claude like this?
Why sloptember when it's may
How does x.cos().cos() work faster than doing two cos calls separately? Like the first cos call returns a tensor either way, the only difference is that it's not assigned to a variable. But how is it even possible know…
Can you please train Qwen 3.5 like 0.8B to 9B using the same training techniques
They don't use the old model, they use EMA of the trained model weights as teacher