Ask HN: If I cancel Codex today whats the next best local inference agent?
7 points
7 hours ago
| 2 comments
| HN
better place to ask over /r/LocalLLaMA
bigyabai
7 hours ago
[-]
For local inference? It entirely depends on what your hardware is.
reply
verdverm
6 hours ago
[-]
OpenCode + vllm, model will depend on your hardware, but OpenCode also has a killer $10/m plan with quotas for some top tier open weight models.

I'm using qwen3.6 on a DGX spark, llama-cpp has prompt cache bugs for qwen/gemma models (among more being reported). Using my OpenCode-go sub when I want a bigger / more capable model

reply