Generally those smaller models do well when most of the data comes from the prompt. Summarising, rephrase and change tone, categorize. Ask them a question, or to generate code and you'll get hallucinations
Gemini flash actually did far better at OCRing an image than Claude and openAI I’ve found, and the price is very attractive. Going to hack on getting it integrated into a side project this weekend
11 comments
[ 7.6 ms ] story [ 829 ms ] threadIf so I does seem people are moving to that opinion and I hope to make generational wealth in shorting Nvidia at just the right time.
While these tokens are cheap, they're not very smart. Too many hallucinations.
I struggle to imagine a use case for this model, other than maybe generating slop.