Karpathy also. CS231n first came out in 2015.
Given that Google is the named partner, it’s almost certainly Gemini. Also would make sense, Gemini’s (only, lol) strength is search grounded responses.
I was so excited to read this, get an inside view of how this problem must actually be much more nuanced than it seems for some reason not observable from the outside, just to read 10k words of whining and pleas for…
What you say is true, and Moonshot definitely has an agreement with Fireworks, but it still just feels wrong. It’s not the America I grew up in, where if you took, you gave back. I know that’s not a very coherent and…
The more I learn about Fireworks the more unsavory they seem as a company. I don’t care what the license says, Moonshot has been openly improving, sharing research, and providing weights for the models that make up your…
Haha this did help me generate empathy for the assistant. Neat idea.
They do have robotics, it’s just not as far along yet as you might expect looking at their progress in other domains. Look at Figure and Gemini Robotics for good examples of SOTA. They’re impressive, but not ready to be…
> Privacy preservation: an outside observer cannot determine whether any pair of reference images were taken by the same device. Image contents are not exposed to Apple or anyone else. I am curious if the PCC processing…
We’re reaching quadratic slop. Slop projects that don’t understand what they’re shipping built on top of slop projects that also don’t understand what they’re shipping. Magnificent.
Good feature but god I hate there’s a whole new keyword for a minor modification on an existing concept. Very unnecessary.
As the saying goes every 5 minutes in Silicon Valley another company reinvents ROS
Agree, I remember when even half precision made its way into C# sometime around 2020 (I didn’t know much about ML then) and I thought, well I guess that’s a worthwhile tradeoff but I can’t imagine going lower. Lo and…
Sure, then you should allow that they are also tools for transforming sequences of questions into answers. Language models are based on compression of information, using them as a knowledge base is entirely within…
Surprisingly incoherent for Anthropic and Dario (cue peanut gallery — “always has been!” No, I don’t think so. I think this is new). It seems to me like there is just no good answer to how one could possibly stop open…
They must have done the math to show even if you peg Kimi K3 generating 24 hours a day for an entire month it doesn’t exceed 10k in opex? Very interesting.
Jagged frontier is not the same as being benchmaxxed. Benchmaxxed is à la Goodhart's Law "when a measure becomes a target, it ceases to be a good measure." Jagged frontier is about how models that seem superhumanly…
Haha, this is awesome. Hadn't heard of it, thank you for the link.
If you haven’t been really running and testing these models yourself, they are all benchmaxxed. No matter how close they score to frontier on whatever metric, they always fall apart in real world tasks and their token…
Very high quality and info-dense article. Cheers.
This is really smart, like the author said, old idea but cleverly applied. In case anyone wants a summary: don’t one shot, don’t use plan mode and hand off the plan to cheap executors, ask the frontier model to explore,…
Everyone using Claude Fable to verify this proof is so funny. If you read the definition of the Jacobian Conjecture and (I am not exaggerating this) have passed a college Calc 3 class, you can just verify the proof…
Eh, Minimax M2.7 also took a similar amount of time (actually longer) between availability and weights release.
you could live (100k a year) with the interest of 0.004% of that in the bank.
Apple (and the ARM ecosystem as a whole) has never really needed massive GPU compute before, it’s always been about power efficiency and just enough GPU oomph to make UI fluid. Even historic Mac Pro workloads never…
I think we should make it illegal to not specify the quantization in the headline for these types of posts.
Karpathy also. CS231n first came out in 2015.
Given that Google is the named partner, it’s almost certainly Gemini. Also would make sense, Gemini’s (only, lol) strength is search grounded responses.
I was so excited to read this, get an inside view of how this problem must actually be much more nuanced than it seems for some reason not observable from the outside, just to read 10k words of whining and pleas for…
What you say is true, and Moonshot definitely has an agreement with Fireworks, but it still just feels wrong. It’s not the America I grew up in, where if you took, you gave back. I know that’s not a very coherent and…
The more I learn about Fireworks the more unsavory they seem as a company. I don’t care what the license says, Moonshot has been openly improving, sharing research, and providing weights for the models that make up your…
Haha this did help me generate empathy for the assistant. Neat idea.
They do have robotics, it’s just not as far along yet as you might expect looking at their progress in other domains. Look at Figure and Gemini Robotics for good examples of SOTA. They’re impressive, but not ready to be…
> Privacy preservation: an outside observer cannot determine whether any pair of reference images were taken by the same device. Image contents are not exposed to Apple or anyone else. I am curious if the PCC processing…
We’re reaching quadratic slop. Slop projects that don’t understand what they’re shipping built on top of slop projects that also don’t understand what they’re shipping. Magnificent.
Good feature but god I hate there’s a whole new keyword for a minor modification on an existing concept. Very unnecessary.
As the saying goes every 5 minutes in Silicon Valley another company reinvents ROS
Agree, I remember when even half precision made its way into C# sometime around 2020 (I didn’t know much about ML then) and I thought, well I guess that’s a worthwhile tradeoff but I can’t imagine going lower. Lo and…
Sure, then you should allow that they are also tools for transforming sequences of questions into answers. Language models are based on compression of information, using them as a knowledge base is entirely within…
Surprisingly incoherent for Anthropic and Dario (cue peanut gallery — “always has been!” No, I don’t think so. I think this is new). It seems to me like there is just no good answer to how one could possibly stop open…
They must have done the math to show even if you peg Kimi K3 generating 24 hours a day for an entire month it doesn’t exceed 10k in opex? Very interesting.
Jagged frontier is not the same as being benchmaxxed. Benchmaxxed is à la Goodhart's Law "when a measure becomes a target, it ceases to be a good measure." Jagged frontier is about how models that seem superhumanly…
Haha, this is awesome. Hadn't heard of it, thank you for the link.
If you haven’t been really running and testing these models yourself, they are all benchmaxxed. No matter how close they score to frontier on whatever metric, they always fall apart in real world tasks and their token…
Very high quality and info-dense article. Cheers.
This is really smart, like the author said, old idea but cleverly applied. In case anyone wants a summary: don’t one shot, don’t use plan mode and hand off the plan to cheap executors, ask the frontier model to explore,…
Everyone using Claude Fable to verify this proof is so funny. If you read the definition of the Jacobian Conjecture and (I am not exaggerating this) have passed a college Calc 3 class, you can just verify the proof…
Eh, Minimax M2.7 also took a similar amount of time (actually longer) between availability and weights release.
you could live (100k a year) with the interest of 0.004% of that in the bank.
Apple (and the ARM ecosystem as a whole) has never really needed massive GPU compute before, it’s always been about power efficiency and just enough GPU oomph to make UI fluid. Even historic Mac Pro workloads never…
I think we should make it illegal to not specify the quantization in the headline for these types of posts.