Why can't they be more consistent about releasing the Insant and Thinking models at the same time for each version number? Why all this duplicative drama?
Yall want to see instant? Check out chatjimmy.ai blow your mind. I’m not affiliated.
But the things it unlocks in a product I’m building are mind blowing. Millisecond inference even on much older models will change the whole game. Enough to run inference on every. Single. API call. Without notable disruption. This sh*t is wild.
9 comments
[ 2.2 ms ] story [ 23.0 ms ] threadI know, I know.. But they are the one's labeling them "instant". There is a real need for a refresh on the datacenter workhorse that is GPT-4.1
Also, how TF are you going to have an "instant" model release and not mention the latency characteristics at all?
But the things it unlocks in a product I’m building are mind blowing. Millisecond inference even on much older models will change the whole game. Enough to run inference on every. Single. API call. Without notable disruption. This sh*t is wild.