2 comments

[ 5.4 ms ] story [ 10.3 ms ] thread
(comment deleted)

  generative AI is non-deterministic, meaning the output is different every time, even for identical inputs
Apparently that is because they probabalistically pick each next token.

I presume some models allow a seed to be set to do pseudo-random sampling and making the output deterministic?