HN Explorer

Ask HN: What is your go-to prompt to prove AI can be wrong?

1 points by throwaway_887 ↗ HN
Just over-heard one of our seniors trying to explain to a new intern that AI can actually be wrong, no matter how much its answers sound very eloquent and well-structured.

I was wondering what question/prompt everyone uses to prove so to others.

I assume it depends on each person's expertise, or some people ask about a fact that is well-known as having been a victim of the mandela effect.

P.S. As a non-native speaker, I was about to pass my submission through AI to improve text clarity and understandability, but after remembering some comments about prefering the original text, I decided against it :)

4 comments

[ 2.4 ms ] story [ 18.5 ms ] thread
saidnooneever
i think the proof is in understanding how LLMs work, not a certain prompt. this because output isnt determenistic and hence a single prompt couldnt (theoretically) reliably prove anything. thats the exactly problem :')
haute_cuisine
I'm curious, why exactly output is non-deterministic? Static weights + matrix multiplication should always return the same output, right?
mejutoco
No, even with the same temperature.
al_borland
Ask an AI anything you have even a remotely decent understanding of and it becomes pretty obvious that they are often wrong. I run into this on a daily basis for questions spanning multiple topics.

It worries me that interns are needing to have this proven to them.