For reference, this beat GPT-3.5 which scores 47%, but not GPT-4 which scored a massive 67%.
Beating out GPT-3.5 at any task with such a small model is very cool to me.
How much longer until these dumb virtual assistants (Siri, Google, Alexa) get replaced with on-device LLMs? We’ve gotta be getting close. These small, optimized models are catching up quickly in so many domains.
I wonder if learning to train Generative AIs will teach us anything about teaching humans? I mean other than the use of AI tutors. Can we determine the usefulness of text by how well it trains AI?
9 comments
[ 2.8 ms ] story [ 31.6 ms ] threadBeating out GPT-3.5 at any task with such a small model is very cool to me.
How much longer until these dumb virtual assistants (Siri, Google, Alexa) get replaced with on-device LLMs? We’ve gotta be getting close. These small, optimized models are catching up quickly in so many domains.