It goes the opposite way too. Small models need minimal harness like pi or they get overwhelmed by long system message and tool descriptions
How does he know that this attack is performed by OpenAI agents? I couldn't figure this out from the article
I think it's that when some code compiles to say assembler, the compiler doesn't prioritize readability and maintainability of the assembler code, since people are not expected to read and maintain it directly
What are people on about, there is tons to do in NMS, tons of missions, expeditions, build bases, build a corvet, hunt rate parts, ships, rifles, creatures, manage a settlement, automate crafting chains, find a…
That game is great to RL on to teach the model computer use, they might've actually done that for Astra
Well, do you have any ideas about how to make it scientific? And they clearly needed to do something based on their unnatural ranking
> We are releasing these architectural improvements ahead of time so that the community can prepare for the upcoming full family of Qwen4 models. That gives me hope that "full family" means it will include smaller…
I hope there is going to be a free endpoint... Unlike 35B-A3B, I am nowhere close to running it locally
I saw some guy streaming how he was deploying qwen3.8 37B on his local setup. Well, he was asking Claude to do it. It took him two hours of passing errors to Claude for the endpoint to start working, he then started…
So flash is 52 points on artificial analysis, and pro is 53
It was but I'm not sure what in my reply indicates missing it. The comment still made a point and I replied to it
Why exactly is that bad?
Qwen3.7 pro is meh, but 3.7 max is a very good model
I'd say it's going to be very hard to come up with a method that works on general nonconvex functions while not working on convex functions
Adam doesn't use the second derivatives matrix, it uses second moments of the gradient, which is the diagonal of the uncentered covariance matrix, but neither of them are directly related to SVD or singular values…
Last statement is a bit sus... Muon computes matrix sign function which can be defined as setting singular values to 1, though you can also define it without SVD. Muon itself doesn't use SVD because it uses a faster…
I am sure they also use Google search and Google maps, and it gives them an even greater advantage
A better solution might be not to constrain the generation, but to remove invalid fields from the tool call in the assistant message. So on the next turn, the model receives chat history which contains it's tool call,…
You can take the output of the matrix LSTM, which is going to be matrix for each token, and compute the SVD. To get better storage, we want U and V to be the same for all tokens, so that we can operate on the diagonal S…
That's useful, but wouldn't help with this particular experiment because they orthogonalize activations, not weights
LFM 2.5 1.2B instruct, it's good at instruction following as long as the instruction is short and simple. Gemma 4 E2B is even better than LFM but I don't know if you can fit it in 3GB. Qwen 3.5 0.8B and 2B are smart but…
I can run Qwen3.6-35B-A3B at 20 TPS on my laptop with RTX 5070 Ti, with partial offloading to RAM. But the most I do is mess with it when I'm bored. I do coding by hand, but I often run autoresearch loops using free…
Just like me! I like AI because of how smart I am.
I am interested to know why people use those graph based agentic frameworks. Why not just define the behavior in python?
Or attach an LSP server with a type checker and require the model to produce strict strongly typed python code
It goes the opposite way too. Small models need minimal harness like pi or they get overwhelmed by long system message and tool descriptions
How does he know that this attack is performed by OpenAI agents? I couldn't figure this out from the article
I think it's that when some code compiles to say assembler, the compiler doesn't prioritize readability and maintainability of the assembler code, since people are not expected to read and maintain it directly
What are people on about, there is tons to do in NMS, tons of missions, expeditions, build bases, build a corvet, hunt rate parts, ships, rifles, creatures, manage a settlement, automate crafting chains, find a…
That game is great to RL on to teach the model computer use, they might've actually done that for Astra
Well, do you have any ideas about how to make it scientific? And they clearly needed to do something based on their unnatural ranking
> We are releasing these architectural improvements ahead of time so that the community can prepare for the upcoming full family of Qwen4 models. That gives me hope that "full family" means it will include smaller…
I hope there is going to be a free endpoint... Unlike 35B-A3B, I am nowhere close to running it locally
I saw some guy streaming how he was deploying qwen3.8 37B on his local setup. Well, he was asking Claude to do it. It took him two hours of passing errors to Claude for the endpoint to start working, he then started…
So flash is 52 points on artificial analysis, and pro is 53
It was but I'm not sure what in my reply indicates missing it. The comment still made a point and I replied to it
Why exactly is that bad?
Qwen3.7 pro is meh, but 3.7 max is a very good model
I'd say it's going to be very hard to come up with a method that works on general nonconvex functions while not working on convex functions
Adam doesn't use the second derivatives matrix, it uses second moments of the gradient, which is the diagonal of the uncentered covariance matrix, but neither of them are directly related to SVD or singular values…
Last statement is a bit sus... Muon computes matrix sign function which can be defined as setting singular values to 1, though you can also define it without SVD. Muon itself doesn't use SVD because it uses a faster…
I am sure they also use Google search and Google maps, and it gives them an even greater advantage
A better solution might be not to constrain the generation, but to remove invalid fields from the tool call in the assistant message. So on the next turn, the model receives chat history which contains it's tool call,…
You can take the output of the matrix LSTM, which is going to be matrix for each token, and compute the SVD. To get better storage, we want U and V to be the same for all tokens, so that we can operate on the diagonal S…
That's useful, but wouldn't help with this particular experiment because they orthogonalize activations, not weights
LFM 2.5 1.2B instruct, it's good at instruction following as long as the instruction is short and simple. Gemma 4 E2B is even better than LFM but I don't know if you can fit it in 3GB. Qwen 3.5 0.8B and 2B are smart but…
I can run Qwen3.6-35B-A3B at 20 TPS on my laptop with RTX 5070 Ti, with partial offloading to RAM. But the most I do is mess with it when I'm bored. I do coding by hand, but I often run autoresearch loops using free…
Just like me! I like AI because of how smart I am.
I am interested to know why people use those graph based agentic frameworks. Why not just define the behavior in python?
Or attach an LSP server with a type checker and require the model to produce strict strongly typed python code