26 comments

[ 0.24 ms ] story [ 10.1 ms ] thread

  AI-junkie: Claude, please write an AI infra article about OpenAI buying Macs!
             Please use a non-beige background for once!

  AI-royalty: I'm sorry, non-beige requires the full token price!
I hope this means OpenAI might become a contributor to Asahi Linux, lest their hardware investment become depreciated due to planned obsolecense by Apple.
I highly doubt that a purchase this large did not come with contracts to get software working how OpenAI wants on the apple software hardware stack.

Apple wants this knowledge for their software stack too so it's not going out back into Asahi

I don't understand the economics of that, is it just because compute is very constrained and they are buying everything they can, even suboptimal machines with a lower performance per $? Or is it just an experiment and anyway 10k macs are just a blip?
Aren't they used doing this so they can generate training data for using Macs via the UI with computer use?
The tinfoil hat answer is they want to ensure fewer people can run local LLMs instead of paying OpenAI for their models.
I think they just want Apple devices to train their computer-use models in a realistic environment.
What realistic environment requires 10,000 Macs?
I mean an agent probably only uses one mac at a time. But they're obviously training tons of agents concurrently.
10000 realistic encironments
Theyre distilling tge open models. Fr
Good luck with that. Managing zillions of Macs has always been difficult, clients and servers. Stanford tried to build an Xserve cluster and failed miserably at it because the OS wasn't conducive to it, nor the hardware at the time either. :( It's not impossible but requires a lot of messy custom, fragile tooling.. and that's expensive to support.
Just to make sure we’re gonna do opening and run locally?
That went wrong.. I meant -> Just to make sure we won't be able to buy and run LLMs locally
Something else they want to price us out of?
Yep. Waiting for someone writing a paper titled "All you need is coffee" or something.
> According to The Information, OpenAI has reportedly purchased tens of thousands of Mac minis and Mac Studios in recent months for reinforcement learning and training computer-use agents.

I do hope they verified this claim and didn't just read the headline. I'm not interested in subscribing to that source to find out unfortunately.

The one good thing out of this, we may finally get the mac pro back. Hopefully a rackmount version that doesn't cost trillions.
Perhaps only billions per 2u with the current trajectory of ram pricing. /s