Show HN: Code to run Gemma2-2B on a Mac – a powerful model with GPT 3.5 perf (github.com)

3 points by notnotrishi 1y ago ↗ HN

I’ve used Gemma2-2B from GDM for a day, and it's a really solid model for its size from my experience. So I built a CLI app for a Mac.

2 comments

[ 2.4 ms ] story [ 12.8 ms ] thread

I tried to let it add punctuations to a list of words from asr, but it changes the words no matter how I tweak the prompt. lol.

lol mind sharing an example?

also in case you haven't already, can try with other models too by changing it from the code to see if they do better