Fascinating how Jeremy openly and honestly says that a technique he developed and everyone uses is now not the best way to go.
I have become obsessed with smaller LLMs lately. Every time I use mistral-7B I wonder what exactly the developers did - anyone have links to good papers by the Mistral developers?
5 comments
[ 2.8 ms ] story [ 24.2 ms ] threadI have become obsessed with smaller LLMs lately. Every time I use mistral-7B I wonder what exactly the developers did - anyone have links to good papers by the Mistral developers?
More digestible announcement: https://mistral.ai/news/announcing-mistral-7b/