It really doesn't lol. Those laws are like Moore's law, an observation rather than something Fundamental like laws in physics The scaling has been plateauing, and half that equation is quality training data which is…
KIND OF if you've tried to get o1 to give you outputs in a specific format, it often just tells you to take a hike. It's a stubborn model, which implies a lot This is speculation, but it seems that the main benefit of…
Pending me getting an understanding of what those advances were, maybe? But making things smaller is different than making them more powerful, those are different categories of advancement. If you've noticed, models of…
The age of pre-training is basically over, I think everyone acknowledged this and it's not to do with not having a big enough cluster. The bull argument on AI is that inference time scaling will pull us to the next step…
That's the most damning thing: they have no warchest from LLM's, no vast profits to propel them to the next big thing. It HAS to be LLM's to AGI or bust if Openai even has a shot at it's foundational mission. If they…
It really doesn't lol. Those laws are like Moore's law, an observation rather than something Fundamental like laws in physics The scaling has been plateauing, and half that equation is quality training data which is…
KIND OF if you've tried to get o1 to give you outputs in a specific format, it often just tells you to take a hike. It's a stubborn model, which implies a lot This is speculation, but it seems that the main benefit of…
Pending me getting an understanding of what those advances were, maybe? But making things smaller is different than making them more powerful, those are different categories of advancement. If you've noticed, models of…
The age of pre-training is basically over, I think everyone acknowledged this and it's not to do with not having a big enough cluster. The bull argument on AI is that inference time scaling will pull us to the next step…
That's the most damning thing: they have no warchest from LLM's, no vast profits to propel them to the next big thing. It HAS to be LLM's to AGI or bust if Openai even has a shot at it's foundational mission. If they…