49 comments

[ 5.9 ms ] story [ 81.6 ms ] thread
It would be interesting to know how this occurred. I assume there may have been last-minute high-level feedback suggesting: "We can't let users see that the new model is only slightly better than the old one. Adjust the y-axis to make the improvement appear more significant."
That was quick, vibe coded, I presume?
It’s genuinely terrifying that people this incompetent have so much money and power.
Remember, we are in a post-truth era. Getting to "AGI" might even mean cooking the numbers if they have to so that hopefully no-one notices.
(comment deleted)
I'll always invest in a chart that's more pink than gray.
Can’t scroll on safari ios
Imagine being the person who made the mistake when creating the gpt-5 chart.
It's such an egregiously bad error, you almost have to wonder if Altman did it intentionally for publicity (which does seem to be working).
Impressive that this knocked GPT-5 from the top.
I think this is less chart crime than an editing mistake.
The 69.1 column has the same height as the 30.8 column. My guess is they just duplicated the 30.8 column and forgot to adjust the height to the number, which passed a cursory check because it was simply lower than the new model.

This doesn't explain the 50.0 column height though.

(comment deleted)
People interested in misleading data visualization should look into Alberto Cairo's Book: How Charts Lie
Looks like the only thing getting smarter here is the marketing team.
How else can you make stonks go up perpetually?
Aw, I really wanted this to be a tool to produce your own misleading vibecharts
Poor OpenAI workers, they worked so hard for the GPT-5 release and now discussions about the model are side by side with discussions about their badly-done graphs.

I don’t believe they intentionally fucked up the graphs, but it is nonetheless funny to see how much of an impact that has had. Talk about bad luck…

There are versions of both these charts with more plausible numbers and bar sizes in the "evaluation" section of the announcement post:

https://openai.com/index/introducing-gpt-5/

So, maybe this is just sloppiness and not intentionally misleading. But still, not a good look when the company burning through billions of dollars in cash and promising to revolutionize all human activity can't put together a decent powerpoint.

Yea I guess I won’t immediately prescribe malice but SHEESH. One of the most anticipated product launches in years and this kind of junk made it through to the public deck. Really pretty inexcusable.
This is what eating your own dog food looks like when you are selling dog food.