The conventional response to this seems to be "Lower reasoning effort".
I have already tried this.
Like you, I am seeing a 5x slowdown compared to GPT-4O. I have lowered reasoning effort all the way, set verbosity to lowest. Still not getting good results.
2 comments of 3
[ 3.1 ms ] story [ 16.7 ms ] threadI have already tried this.
Like you, I am seeing a 5x slowdown compared to GPT-4O. I have lowered reasoning effort all the way, set verbosity to lowest. Still not getting good results.
https://bsky.app/profile/rickcarlino.bsky.social/post/3lvycs...
It seems to speed up after a “cold start” though, which seems highly unlikely technically, but that’s what it feels like.