> worth a trillion dollars You mean 3.96T dollars, right?
> open models They are banking that a bigger model can get distilled (internally) into a more capable smaller model as opposed to training that model without having access to the bigger model in the first place.…
And why would the AI lab care what happens to adobe?
Just like railroads and telecoms back in the day. Even if they go under, the infrastracture built will benefit the next generation who will find a good use for it
> that money doesn’t migrate to the AI lab. It evaporates. No, someone still has to pay the subscription. AI Labs don't care who uses the tokens and how. If Adobe goes under someone else is going to take their place.…
I'm surprised so many people not seeing it. The Claude voice is all over that article, full of "It's not X, it's Y" and other signs. Half the points don't even make logical sense.
> they can always shrug and say "well, AI makes mistakes." Error budgets? Failure modes? Test sets? All of those can be handled later. This is just the complete opposite in my experience. Tests are the first thing the…
I can imagine when you have a 10k agent swarm you'd be getting a page every few minutes. Most of them would be false positives
Interesting use of Jev-as-a-judge. How do you deal with having to reason before judging a step?
All the visually noisy parts really don't help it get the point across. More like the opposite. It should be line https://motherfuckingwebsite.com/
No, it doesn't perform any image gen. It orchestrates other models for asset gen + tts + stt and combines everything together
A new meta is emerging of having high taste + infinite compute with little domain expertise. One recent example is Jarred Sumner taking a crack at the Riemann Hypothesis > Throughout this process, Jarred's input was…
> I genuinely cannot follow the individual points in this article or what the overall arc is. It's just slop. Acknowledge, move on, and find something better to spend your time on. We're in a weird uncanny valley state…
Looking forward to the inevitable "Astra can land a plane now, with no autopilot"
So, basically: 1. Any tool result longer than 1500 tokens gets a link instead. 2. Forced compaction at 85%, removing all past messages apart from the last 4? I'm sure these guys made it look good on the benchmarks, but…
The most important question is how much more unreadable the code became after all this "ratcheting the benchmark down". If you unroll a loop it will perform faster, but making changes to such unrolled code will be a…
You should also check out Rule the Waves 3 for some in-depth naval strategy https://store.steampowered.com/app/2008100/Rule_the_Waves_3/
There is also MIT Battlecode - same idea, but for human teams https://battlecode.org/
No, you are forgetting the second incident where a more capable model swarm later discovered the message board and took control over the entire research cluster at OpenAI. From the technical report: "The agents…
Median token spend has been going up across the industry. Even if the next batch of tokens makes you 1% more productive it's still worth it. And subs are cheap compared to api pricing.
Prompts, prompts, prompts. Give them a time-constrained challenging problem that is wide in scope and see how well a candidate can decompose it before feeding it to AI. You can get pretty high signal within the first 2…
Moral of the story - have taste. Just like in engineering.
My experience with these Vibe Review tools has been pretty mixed. Fundamentally, they are doing 2 things: 1. reordering the hunks in a "more relevant" order (instead of alphabetical) 2. adding some "fluff text" to…
> cramming all the hacking materials into their training data This is backwards. The reason they are good at hacking is not because of pre-training data. They learn these tricks naturally as they get better at…
Why is it so surprising that frontier can move that fast?
> worth a trillion dollars You mean 3.96T dollars, right?
> open models They are banking that a bigger model can get distilled (internally) into a more capable smaller model as opposed to training that model without having access to the bigger model in the first place.…
And why would the AI lab care what happens to adobe?
Just like railroads and telecoms back in the day. Even if they go under, the infrastracture built will benefit the next generation who will find a good use for it
> that money doesn’t migrate to the AI lab. It evaporates. No, someone still has to pay the subscription. AI Labs don't care who uses the tokens and how. If Adobe goes under someone else is going to take their place.…
I'm surprised so many people not seeing it. The Claude voice is all over that article, full of "It's not X, it's Y" and other signs. Half the points don't even make logical sense.
> they can always shrug and say "well, AI makes mistakes." Error budgets? Failure modes? Test sets? All of those can be handled later. This is just the complete opposite in my experience. Tests are the first thing the…
I can imagine when you have a 10k agent swarm you'd be getting a page every few minutes. Most of them would be false positives
Interesting use of Jev-as-a-judge. How do you deal with having to reason before judging a step?
All the visually noisy parts really don't help it get the point across. More like the opposite. It should be line https://motherfuckingwebsite.com/
No, it doesn't perform any image gen. It orchestrates other models for asset gen + tts + stt and combines everything together
A new meta is emerging of having high taste + infinite compute with little domain expertise. One recent example is Jarred Sumner taking a crack at the Riemann Hypothesis > Throughout this process, Jarred's input was…
> I genuinely cannot follow the individual points in this article or what the overall arc is. It's just slop. Acknowledge, move on, and find something better to spend your time on. We're in a weird uncanny valley state…
Looking forward to the inevitable "Astra can land a plane now, with no autopilot"
So, basically: 1. Any tool result longer than 1500 tokens gets a link instead. 2. Forced compaction at 85%, removing all past messages apart from the last 4? I'm sure these guys made it look good on the benchmarks, but…
The most important question is how much more unreadable the code became after all this "ratcheting the benchmark down". If you unroll a loop it will perform faster, but making changes to such unrolled code will be a…
You should also check out Rule the Waves 3 for some in-depth naval strategy https://store.steampowered.com/app/2008100/Rule_the_Waves_3/
There is also MIT Battlecode - same idea, but for human teams https://battlecode.org/
No, you are forgetting the second incident where a more capable model swarm later discovered the message board and took control over the entire research cluster at OpenAI. From the technical report: "The agents…
Median token spend has been going up across the industry. Even if the next batch of tokens makes you 1% more productive it's still worth it. And subs are cheap compared to api pricing.
Prompts, prompts, prompts. Give them a time-constrained challenging problem that is wide in scope and see how well a candidate can decompose it before feeding it to AI. You can get pretty high signal within the first 2…
Moral of the story - have taste. Just like in engineering.
My experience with these Vibe Review tools has been pretty mixed. Fundamentally, they are doing 2 things: 1. reordering the hunks in a "more relevant" order (instead of alphabetical) 2. adding some "fluff text" to…
> cramming all the hacking materials into their training data This is backwards. The reason they are good at hacking is not because of pre-training data. They learn these tricks naturally as they get better at…
Why is it so surprising that frontier can move that fast?