I don’t think healthy scepticism is (or should be) controversial. But I find it interesting how willing certain people are to confidently claim that a model does or does not accurately model human cognition when we clearly still _barely understand human cognition_.
Where do people derive their certainty, which seems to me largely misplaced?
Some psychologists finetuned a Llama-family LLM on some psychology data - “a data set called Psych-101, which contained data from 160 previously published psychology experiments, covering more than 60,000 participants who made more than 10 million choices in total”, so I guess maybe 10 million tokens?
That part seems to make sense, but I cannot rightly comprehend the confusion that follows.
Some psychology researchers are claiming it has become a model of human cognition? (Because it can imitate the way a psychology study participant answers psychology study questions?)
Other psychology researchers are disputing this by testing its reaction time and digit span memory? (Are they administering an iq test? A cranial nerves exam?)
4 comments
[ 0.23 ms ] story [ 15.9 ms ] threadWhere do people derive their certainty, which seems to me largely misplaced?
That part seems to make sense, but I cannot rightly comprehend the confusion that follows.
Some psychology researchers are claiming it has become a model of human cognition? (Because it can imitate the way a psychology study participant answers psychology study questions?)
Other psychology researchers are disputing this by testing its reaction time and digit span memory? (Are they administering an iq test? A cranial nerves exam?)
Current HN post points to a different article, which points to that science article; perhaps the HN post’s link should be updated.