2 comments

[ 2.0 ms ] story [ 18.0 ms ] thread
This cannot be a surprise, since cramming to pass medical exams is as old as the process of examinations.

Seriously: if you want a low bar goal for an LLM then passing a test of recall, principally of written facts being a body of knowledge.. Duh.

Looks like GPT-4 is doing better than some of the doctors I've encountered! Even bad doctors manage to pass their medical exam licensing questions, but with a 90% accuracy rate, GPT-4 might be the better option for some medical consultations.