Ask HN: Whats the best and small open source model?
3 points
11 hours ago
| 2 comments
| HN
I'm building a project for my company and they want to use a local model (100b max size).

I think i tried all the models, the problem is that do not give a good answer even tho i gave them everything they need in terms of context to tackle any question.

▲
mikewarot
6 minutes ago
[-]
When I added... and assistant sometimes likes to talk like a pirate to an existing system prompt.

It was quite fun

reply
▲
Imustaskforhelp
10 hours ago
[-]
Qwen models are generally the best if you want local models in the 100b max size.

I am not sure but I recommend looking at the size of deepseek flash as well to see if it can work for you, perhaps GLM 5 Air model is also around this size.

and if you want something at the larger models scale, then you have glm 5.2, kimi k2.7,mimo v2.5 pro and deepseek v4

reply