1 comment

[ 4.6 ms ] story [ 15.9 ms ] thread
I wrote this after spending December thinking about why o3's expensive memory usage matters. The key insight feels trivial (CS101: universal computation needs stable state + memory), but watching xAI (and now Stargate) build gigawatt facilities while o1 explicitly discards its own reasoning made me realize we've forgotten something fundamental... https://arxiv.org/abs/2412.17794