1 comment

[ 3.4 ms ] story [ 9.9 ms ] thread
Reasoning models from OpenAI forget what their past reasoning. The reasoning tokens are removed from context after the user-visible response is generated. It's not what I expected, given that memory of reasoning is the key to chain or thought's success.