HN Explorer

Ask HN: Whats the best and small open source model?

3 points by hairymouse ↗ HN
I'm building a project for my company and they want to use a local model (100b max size).

I think i tried all the models, the problem is that do not give a good answer even tho i gave them everything they need in terms of context to tackle any question.

7 comments

[ 2.9 ms ] story [ 30.6 ms ] thread
Imustaskforhelp
Qwen models are generally the best if you want local models in the 100b max size.

I am not sure but I recommend looking at the size of deepseek flash as well to see if it can work for you, perhaps GLM 5 Air model is also around this size.

and if you want something at the larger models scale, then you have glm 5.2, kimi k2.7,mimo v2.5 pro and deepseek v4

mikewarot
When I added... and assistant sometimes likes to talk like a pirate to an existing system prompt.

It was quite fun