HN Explorer

Ask HN: Have you noticed decreased quality in GPT-4 reasoning recently?

4 points by ammar_x ↗ HN
I noticed a significant decrease in the model reasoning abilities in the last few days, especially when it comes to writing code. Has anyone else experienced this?

Given that these models are being used in all sorts of applications all over the world, I think it's concerning that OpenAI can lobotomize a model in secret and no one can verify that and do something about it.

5 comments

[ 2.8 ms ] story [ 24.7 ms ] thread
mdp2021
> concerning

...And in fact some at Google are already projecting a future of Open Source dominance in the subfield.

(Edit: the system must have missed a post update: )

...Coincidentally, in fact, a neighbouring post is: OpenAI readies new open-source AI model - https://news.ycombinator.com/item?id=35958789

rainy59
The more they force the model into politically-fashionable responses, the further they get away from rational thought process. CodeT5+ looks promising though
skilled
As an EU user, I feel like it has been watered down a lot, both 3.5 and 4. Many queries now come with disclaimers which are pretty annoying since you can't set your own system instructions in the ChatGPT interface. Using the API is fine though since you can explicitly say that you want a specific format.
rainy59
true they could be fiddling w things as the EU AI Act moves forward
monkeydust
Wouldn't surprise me if members of EU parliament and comission were big time customers now via the OpenAI playground.