I want to see more text-free foundation models
[dead]
If the labs weren't so aggressive with building datacenters in people's backyards, this could've been a different story. People don't like it when pipelines are built in their backyard either.
They tried that a few times and the mistakes have had consequences.
This is excellent! Very useful takeaways. Being able to properly do continuous training in production is key with robotics data being so hard to come by.
Great work showing on how brittle these GUI benchmarks can be! Love the visuals. I wonder if SFT is the problem here as opposed to the coordinate discretization; what happens with continuous action space?
This is cool. Creative ways to do external verification is the only path to solving training on LLM slop
Neat! minor nit - would be nice if the esc button took you back to the list, instead of having the click the X button
The current way benchmarks are done and are accepted by the community makes for really uninspired work. Until we're willing to break out of this rigid evaluation format prone to crazy overfitting and gaming, talent will…
Edge models will get much better after the current insane capex and organic data for pre-training is dried out. But hard to see how the best open source models will ever come close to the best closed ones.
Vice versa, the exaggeration of vitamin D is mildly worthless. Some need supplements, some don't.
I'm a fan of this direction. For me the most interesting use case for these world models isn't even training, it's verification. If this thing or some idealized version of it can actually reliably simulate state…
I want to see more text-free foundation models
[dead]
If the labs weren't so aggressive with building datacenters in people's backyards, this could've been a different story. People don't like it when pipelines are built in their backyard either.
They tried that a few times and the mistakes have had consequences.
This is excellent! Very useful takeaways. Being able to properly do continuous training in production is key with robotics data being so hard to come by.
Great work showing on how brittle these GUI benchmarks can be! Love the visuals. I wonder if SFT is the problem here as opposed to the coordinate discretization; what happens with continuous action space?
This is cool. Creative ways to do external verification is the only path to solving training on LLM slop
Neat! minor nit - would be nice if the esc button took you back to the list, instead of having the click the X button
The current way benchmarks are done and are accepted by the community makes for really uninspired work. Until we're willing to break out of this rigid evaluation format prone to crazy overfitting and gaming, talent will…
Edge models will get much better after the current insane capex and organic data for pre-training is dried out. But hard to see how the best open source models will ever come close to the best closed ones.
[dead]
Vice versa, the exaggeration of vitamin D is mildly worthless. Some need supplements, some don't.
I'm a fan of this direction. For me the most interesting use case for these world models isn't even training, it's verification. If this thing or some idealized version of it can actually reliably simulate state…