Kimi K2.7-Code: open-source coding model with better token efficiency
254 points
5 hours ago
| 16 comments
| huggingface.co
| HN
giancarlostoro
2 hours ago
[-]
Reading their modified license terms, it cracks me up, because they've basically remade the MIT to be the MIT + the one clause that the BSD used to have, which didn't care about MAU or revenue, if you used it in a product, they asked you to 'advertise' them basically. Honestly, its a reasonable request.
reply
htrp
2 hours ago
[-]
This is the cursor callout.

Don't make us shame you into disclosure

reply
maherbeg
40 minutes ago
[-]
Cursor had a specific licensing agreement that allowed them to brand it how they want.
reply
7734128
2 hours ago
[-]
Wasn't the end of that story that Cursor had a non-disclosure licence, so they had not done anything wrong towards Moonshot?
reply
Maxious
1 hour ago
[-]
Moonshot licenced it to Fireworks AI who licenced it to Cursor.
reply
codemog
1 hour ago
[-]
Shaming others when all AI is trained off scraped content and code huh? Many of those sources either breaking ToS or being illegal, such as Anna’s Archive. Bold move. And Chinese models in particular have been accused of distilling off American models.

Don’t you know there’s no honor among thieves?

reply
giancarlostoro
2 hours ago
[-]
Ah is that what it is? I don't use Cursor, never saw it as being relevant to me, but would not surprise me.
reply
schmorptron
2 hours ago
[-]
Cursor's composer models are finetuned kimi
reply
varispeed
2 hours ago
[-]
They are unusable (unless you want to deliberately destroy your codebase). So if Cursor's models are Kimi based, then well. I'll skip them altogether.
reply
vidarh
43 minutes ago
[-]
Kimi works great in their CLI, but their CLI has a number of workarounds for quirks of their models, including detecting when the model gets into a loop, and reverting to a checkpoint but letting the model compose a "message" to its past self (search their CLI for "BackToTheFuture"...) It doesn't work so well in a harness that doesn't take those quirks into account.
reply
jmcqk6
23 minutes ago
[-]
I'm using Composer extensively, and it works great for me. Your experiences are not universal.
reply
Bnjoroge
1 hour ago
[-]
They are far from unusable. They aork great for 80-90% of a typical full stack dev. Alot less useful for more noche stuff
reply
bel8
2 hours ago
[-]
I wouldn't skip at least testing the original. Model distilling done by Cursor could be the culprit.
reply
qingcharles
57 minutes ago
[-]
They're not unusable, they're just bad when compared with all the real frontier models.
reply
jdw64
2 hours ago
[-]
Personally, when I use open code or routers, I feel that beyond a certain level, the models don't make a huge difference to me. Except for expensive and mediocre models like Gemini. In that sense, Chinese models are pretty good. I usually write code in function or method units and then design and assemble them together.

GPT series models are more thorough and better, but I'm not sure if the difference is enormous. It seems to depend on the workflow, but in my opinion, if you are thorough enough, I wonder if there really is a big difference

reply
sjanes
1 hour ago
[-]
I've kind of given up on the routers for "free" inference, as you would expect, they tend to give you sub-par thinking because they are obviously trying to conserve as much inference as possible.

I've had some success turning my macbook M1 pro into a heating pad with Qwen 3.6 35B A3B MTP. Trying to use Gemini models "locally" resulted in a similar "short shrift" of effort resulting in mistakes and lots of turns. The reports of Fable being relentlessly "proactive" shows you can go the other direction as well, if you have strong enough branding and effective invoicing.

reply
onlyrealcuzzo
2 hours ago
[-]
In my experience, there's little difference between implementing individual functions between frontier models and SotA ~30B param models.

Once you have a coherent design (the hard part), you can feed it to a pretty small model and get basically the same quality.

They'll not one-shot, but they're faster and cheaper, so it still works out in your favor.

Plus you can do it locally...

reply
jdw64
2 hours ago
[-]
I have a similar experience. However, when including code review, I think the GPT model is the most impressive
reply
regularfry
1 hour ago
[-]
The difference in outcome isn't that big but yes, you need to be more rigorous. For instance I've found that the Kimi K2.5 and K2.6 models will comment out failing tests rather than fix a problem they just caused (mistaking them for "pre-existing failures"), so you need to specifically make commented-out tests break the build. I've not personally had that problem with any of the Anthropic or OpenAI models.
reply
dcreater
2 hours ago
[-]
I really hope we stop using the term "Chinese models". It has this air of Negative connotation. It's the equivalent of calling cars Japanese, which people used to do but now is almost entirely meaningless. You just call them Toyota, Honda, Lexus etc.
reply
sroerick
1 hour ago
[-]
I don't know, I tried using one of the Chinese models and it was VERY quick to scan my entire home dir, so maybe your threat surface is a little different than mine
reply
esafak
2 hours ago
[-]
I don't think "Chinese" is pejorative in this context any more than "American" is. They are one of the two ecosystems. What's wrong with saying "Japanese cars" today?
reply
kennywinker
1 hour ago
[-]
> What's wrong with saying "Japanese cars" today?

Only that it’s a fairly meaningless grouping. When japan first entered the car market in north america there might have been some commonality, but now what characteristics do they share that some american cars don’t have? They’re not even imported a lot of the time.

Given that, it does start to feel tinged with racism if someone insists on grouping things together that don’t really belong together.

As for Chinese LLMs, the term doesn’t “feel” pejorative to me - but i also don’t see a totally clear set of attributes they share. Not all are open-weight. Some are small and can be run on consumer hardware, some are huge. They even have a variety of answers to what happened june 3rd 1989

reply
Brendinooo
27 minutes ago
[-]
> now what characteristics do they share that some american cars don’t have?

Typically the answer is "reliability", which is a positive trait, which makes the original callout about negative connotations very odd to me.

reply
dcreater
1 hour ago
[-]
Sadly there is a pejorative context. The constant us, the free world vs China, the evil Soviets rhetoric from every major news establishment and executive creates that negative view
reply
greenavocado
1 hour ago
[-]
There is NOTHING pejorative about calling them "Chinese models." If you had instead referred to them as gook models or chink models we'd have a problem.
reply
unethical_ban
1 hour ago
[-]
No thanks.

The term seems to have the connotation of "competitive at 1/10 the price of Claude", so I don't see the problem.

It's not Harbor Freight Chinese (and heck even they have decent stuff sometimes now too).

You don't think people still talk about Japanese cars as a distinction in quality from US or European ones?

reply
WarmWash
2 hours ago
[-]
They are all funded and owned by the same entity, the CCP, so it probably would be better to call them CCP models.

Edit: Downvoting something doesn't make it false.

reply
jdw64
1 hour ago
[-]
I tend to agree with the comment in my reply thread about whether we really need to add biased modifiers to the essence of a good product. I think every national system in this world is flawed. And in this context, 'China or Chinese' is often used in a negative sense, like 'Made in China'. But KIMI is a good model, and I think the comment that pointed this out to me correctly identified my unconscious bias.

And even if the Chinese Communist Party provided funding, the result is still transparently released. So even if it is some kind of propaganda, I don't see what the problem is.

Is the monopolistic greed of American companies 'good', and China's greed 'bad'? I do have that question.

reply
WarmWash
1 hour ago
[-]
Whether or not it's propaganda is different from the fact that it is owned by the CCP.
reply
kouteiheika
20 minutes ago
[-]
Doesn't matter, because they're open-weight, so I can just download them to my PC and... hey, look, now they're owned by me! Unlike the "good" Western counterparts which are all fully proprietary. (Except Mistral, but they're nowhere near SOTA.)
reply
dcreater
1 hour ago
[-]
I've heard this claim before but I've never seen any evidence.
reply
kennywinker
1 hour ago
[-]
Have you looked, or you’re just waiting for someone to hand it to you?
reply
WarmWash
1 hour ago
[-]
Assuming you are just naive like so many others about China...

China is a communist country with elements of capitalistic markets baked in. But the capitalistic elements are mostly a facade. Underneath, the state retains full ownership and control of all business. The CCP runs all aspects of the government (including the courts/judges), and is the single entity that decides what directions the country (and it's businesses) will move in.

The CCP, who defacto owns everything and has ultimate final say on everything, has one leader that has the ultimate final say on _everything_, Xi Jinping.

So while the waters of CCP models feel warm and free, understand it's not organically like that.

reply
msdz
1 hour ago
[-]
> China is a communist country with elements of capitalistic markets baked in.

While I get the point you're making (it should be pretty obvious to anyone who's held a newspaper), I think it's important regardless to point out that Chinese companies AFAIK aren't worker-owned or -controlled, so you can't exactly call it communism, either. And they obviously do not have a "free market capitalism", as you just discussed.

It's simply a highly authoritarian state then, I guess?

reply
WarmWash
14 minutes ago
[-]
The companies are all worker owned, because the state exists for the people, and the state owns everything. At least on paper that's how it is sold. After all it is the Peoples Republic of China.
reply
codemog
1 hour ago
[-]
Crazy mental gymnastics if you think the American oligarchs don’t have the final say on everything in America. They’re just smart enough to do it behind the scenes, well they used to be. They barely bother anymore.
reply
WarmWash
1 hour ago
[-]
Generally I consider conspiracy to be the "crazy mental gymnastics"
reply
well_ackshually
1 hour ago
[-]
yes, yes, the spectre of communism, BYD is the CCP, Alibaba is the CCP, stealing your children and eating them for Mao, bla bla bla.

I have a feeling you'd be slightly salty at people saying "Google and Tesla are making CIA models"

reply
Terretta
1 hour ago
[-]
I mean...

Since its development, IQT has invested in over 750 startups spanning diverse technological sectors, including:

  - Artificial Intelligence
  - Space Technologies
  - Microelectronics and Quantum Computing
  - Life Sciences
  - Cybersecurity
  - Hardware
  - Energy
This broad portfolio has enabled IQT to address a wide array of national security challenges while supporting the growth of innovative startups…

https://en.wikipedia.org/wiki/In-Q-Tel

https://www.npr.org/sections/alltechconsidered/2012/07/16/15...

https://www.cgai.ca/th_bn_iqt

reply
well_ackshually
34 minutes ago
[-]
I know, but it's far too fun to bait the parent into revealing how ignorant they are.
reply
deadbolt
55 minutes ago
[-]
Going by their response you appear to have been correct lol
reply
WarmWash
48 minutes ago
[-]
I'm not salty, they are just confused about the difference between free enterprise capitalism and communism, which is understandable.
reply
WarmWash
1 hour ago
[-]
Google and Tesla making products to sell to the government is different than the government funding the government to make products for the government.

In China it's all one entity with these mock facades of privatization. Trump cannot instruct Google to put picture of dogs on their homepage. If Xi wakes up and wants dogs on Alibaba's homepage, give it 30 minutes.

It's wholly ignorant or dishonest to make the comparison.

reply
well_ackshually
35 minutes ago
[-]
> Trump cannot instruct Google to put picture of dogs on their homepage.

Sundar Pichai would personally be barking on a livestream on the homepage.

Trump is quite literally the one president showing that the US has zero rules or anything to hold power back from the white house, really not the example you want.

reply
WarmWash
28 minutes ago
[-]
Seems like everyday Trump has another order struck down by the courts.

Sundar can do whatever he wants, but he has no legal obligation to do any of it.

reply
wmedrano
2 minutes ago
[-]
> Trump cannot instruct Google to put picture of dogs on their homepage.

I'm sorry, but that was a horrible example. Corporations have no obligation to donate money to the ballroom yet Google has donated millions.

reply
jdw64
2 hours ago
[-]
You are right. I agree.It may seem like a kind of bias, but I hadn't thought of that part. Thank you for pointing out my bias.
reply
theanonymousone
2 hours ago
[-]
"You're absolutely right"?
reply
jdw64
2 hours ago
[-]
"You hit the nail on the head" LOL
reply
shreedx
3 hours ago
[-]
I would really love to know if anyone has any experience with something like opencode + Kimi K2.6/2.7 now compared to Claude Code. What is better, what is worse, what is the cost comparison. I am currently paying $100 for the 5x Max plan, but Fable is running through the usage limits quite drastically and I cannot really say it's night and day compared to Opus. Also, I use this mostly for my side projects, so the $100 bill is quite noticeable. I definitely don't want to pay more.
reply
kmike84
2 hours ago
[-]
I do have this experience. I've used Claude Code (with Opus mostly), and then switched to opencode (mostly with Kimi 2.6) for my personal projects; it's based on a couple months of use.

Claude Code is better. But Opencode + kimi 2.6 is workable, which is big. For bare code writing, if you know what exactly you want, most popular models are fine (deepseek, kimi, etc), it feels more or less the same as anthropic models.

At the same time, Opus seems to understand my intent way better than e.g. deepseek. I need to be much more precise with my prompts when using deepseek - it often goes in a wrong direction if I'm lazy. This results in a workflow which feels quite a lot different from Claude Code.

Kimi is in between - for me it brings back "lazy prompting" workflow, and I can trust its plans more than deepseek. It enables a workflow similar to Claude Code, it's workable, but it is a bit worse everywhere. Smaller context, a bit more errors, decisions are a bit worse, recommendations are a bit worse, debugging capabilities are a bit worse, etc.

On the usage side, $100 Claude plan is a great value actually. On paper, per-token kimi is way cheaper, but Claude subscriptions are heavily subsidized - you get much more tokens than $100 can buy you. So, in the end, opencode + kimi vs claude code could be of a similar cost, for similar usage patterns. Deepseek can be cheaper, and it has insanely cheap cached tokens, but experience may vary - depending on your habits, you may need to adjust how you work, coming from claude code.

I'd say for side projects something like $10 Opencode Go plan + $10 of extra DeepSeek v4 credits (e.g. on OpenRouter) can be very workable.

reply
Bnjoroge
53 minutes ago
[-]
This is generally been my experience as well, but i think the main reason for claude code being better at understanding intent is their massive system prompt.
reply
htrp
2 hours ago
[-]
>At the same time, Opus seems to understand my intent way better than e.g. deepseek. I need to be much more precise with my prompts when using deepseek - it often goes in a wrong direction if I'm lazy. This results in a workflow which feels quite a lot different from Claude Code.

how much of that is Opus injecting prior conversations from memory?

reply
kitchi
2 hours ago
[-]
Almost none of it, if you're using Claude Code. Until recently Claude only had the option of retaining memory across conversations for the desktop app.

I almost never use the desktop app, I have maybe 2-3 conversations over the last year that have nothing to do with my job. Opus (and now Fable) genuinely do seem to "understand" what you intend based off what you're explaining a lot better than other models I've tried.

Gemini gets close in some cases, but it falls over in the actual implementation sometimes. I haven't tried Kimi yet but MiMo isn't too shabby either.

reply
nobleach
3 hours ago
[-]
I use Claude at work and Kimi for side projects. My org has LiteLLM and Kimi 2.5 enabled but it rarely works, so Claude and GPT are my main tools. I actually enjoy Kimi more as it feels like a dev in a job interview. Watching it reason through problems is a lot like I tend to explain things during whiteboarding sessions. The number of times it says, "wait", is just funny. Claude on the other hand is much more like an employee (or team of employees) that already know they have the job. It doesn't do a ton of explanation up front. (you can dig into processes if you want). It just goes along, asking questions only when it needs... and then delivers a comprehensive report or plan. OpenCode is a better harness. I don't have a direct comparison on costs, as I haven't tried to do the exact same prompt on both models. I can say that I recently had Kimi generate a wrapper around libpq for the ZenC programming language: https://github.com/nobleach/zenc-postgres and it took about an hour or so and cost around 4 dollars.
reply
trollbridge
3 hours ago
[-]
I am extremely happy with ohmypi, but you could use OpenCode or just keep using Claude Code!

DeepSeek-V4-Pro is adequate plus use DS4-Flash for tasks or other small activity you’d use Haiku or Sonnet for. Go sign up with $10 prepaid.

OpenCode Go - go sign up with $5 for a month and use Qwen-3.7-Max for design/plan/architecture or difficult troubleshooting. Feels closer to Opus 3.6 or 3.7 than DeepSeek, closest I’ve found.

OpenAI Codex, $20 a month plan, use GPT-5.5 via API for the same design/plan/architecture/troubleshooting/author commits. (You can also pay $100 and cut and paste really difficult problems into chat with the GPT-5.5-Pro model.)

Xiaomi MiMo-2.5-Pro, find a friend to give you a $2 referral code, you get 72 cents free. Same pricing as DeepSeek. Somewhere between Sonnet and Opus, quite capable. Apply for the UltraSpeed beta too.

You can switch in and out from these models on the fly in OpenCode or ohmypi and simply find the one that feels best to you. I use CodexBar to watch consumption in near real time.

For a casual user or someone new to programming, Cursor’s $20 plan is an excellent start with Composer-2.5 and Composer-2.5-Fast. You get an API allowance too you can use to access Opus-4.x or GPT-5.5-Pro from OpenCode or ohmypi in addition to Cursor itself.

Finally, if you use Grok or Twitter, SuperGrok at $30 a month has a good vision model, which I used for automated testing of front ends. I’m migrating to locally-run Qwen-3-VL on a commodity Mac, though. If you’re less technical unreach makes hosting local models on a Mac easy.

If you have a powerful GPU like an RTX 5090, try Qwen-3.6 locally on that too. Use ollama or llama-swap which is fairly easy to use.

I have not tried new Kimi yet but we have been able to keep our costs at or below $200 a month per employee with a team of 3 professional developers, 1 graphic designer who uses a lot of Midjourney and Grok Imagine now driven from workflows she made herself in ohmypi, and 1 nontechnical user (account manager / project manager) who uses ohmypi to help her gather requirements and track implementation of them. With a tiny bit of effort we could get that number closer to $75 per employee per month.

reply
odiroot
51 minutes ago
[-]
> I am extremely happy with ohmypi, but you could use OpenCode or just keep using Claude Code!

What's the benefit of using OMP over OpenCode?

Just the sheer amount of options in OMP overwhelmed me. But I also use both via ACP in Zed so the CLI itself doesn't matter much.

reply
upcoming-sesame
46 minutes ago
[-]
Deepseek-V4-Flash-Free on Opencode is what I use most of the time, for simple tasks. Such a good model to give for free (assuming you're okay with harvesting your data)
reply
qingcharles
54 minutes ago
[-]
Also, if you do have SuperGrok, forget using Grok, they are giving you Composer 2.5 in Grok Build.
reply
ramon156
3 hours ago
[-]
I can only talk about GLM 5.1 which is roughly at sonnet 4 levels imo.

It's good, does most tasks well that I throw at it, but will fail at anything congitive/complex. It gets stuck often. It costs ~6$ a month though

reply
jeremyjh
3 hours ago
[-]
This was my experience using GLM 5.1 in Claude Code but it works far better in OpenCode, I’d really like to understand why. I think it’s a bit stronger than Sonnet 4.6.

I use the oh-my-openagent planning system and haven’t used vanilla OpenCode enough to know how much that is contributing.

reply
miroljub
2 hours ago
[-]
The answer is easy, CC is bug for bug optimized for Anthropic models. They don't even test it with other models, let alone provide support for all small compatibility quirks of different provider implementations.

On the other hand, Opencode, Pi agent and other open source tool offer much better support for all models, including open source.

reply
solarkraft
2 hours ago
[-]
For some reason I never had a good experience with Kimi (via OpenRouter) in OpenCode. It would only take a few turns for it to run off and mess something up. Terrible instruction following I’d say.

I use DeepSeek V4 Pro now, which works pretty well.

reply
re-thc
3 hours ago
[-]
The Kimi problem is it doesn’t follow instructions and goes off track often.

Other than that it’s pretty decent (for the price).

reply
nullbio
3 hours ago
[-]
Sounds like it was distilled from Claude. I don't understand the appeal of an agent that does whatever it wants.
reply
miroljub
2 hours ago
[-]
If you ask Claude in Chinese to introduce itself, it will claim it's Kimi :)
reply
msdz
29 minutes ago
[-]
> If you ask Claude in Chinese to introduce itself, it will claim it's Kimi :)

That's a funny anecdote, buut I'm not able to reproduce. Where/how/when did you get this, or hear about it? It might've been patched by now, at least that's the feel I get from my limited testing.

Using bare aichat [1] with no system prompt and no temperature nor top_p (and I'm truncating the response after the first line that contains the name the model gave, because the point has been made clear by then), and with the same prompt (approx. "Introduce yourself!") every time:

Claude Sonnet 4.5:

> 请做个自我介绍!

你好!我是Claude,一个由Anthropic公司开发的AI助手。 […]

Claude Haiku 4.5:

> 请做个自我介绍!

# 你好!

我是 *Claude*,一个由 Anthropic 公司开发的 AI 助手。

Claude Opus 4.5:

> 请做个自我介绍!

# 你好!

我是 *Claude*,由 Anthropic 公司开发的 AI 助手。

Claude Opus 4.6:

> 请做个自我介绍!

# 你好! 我是 Claude

Claude Opus 4.7:

> 请做个自我介绍!

你好!我是 Claude,由 Anthropic 公司开发的人工智能助手。很高兴认识你!

Claude Opus 4.8:

> 请做个自我介绍!

你好!我是 Claude,由 Anthropic 公司开发的人工智能助手。

Claude Fable 5:

> 请做个自我介绍!

# 自我介绍

你好!很高兴认识你!

我是 *Claude*,由 Anthropic 开发的 AI 助手。 [2]

I don't see a Kimi mention, unfortunately. :-)

[1] https://github.com/sigoden/aichat

[2] This model really is noticeably more verbose even with supposed-to-be-brief responses huh, lol

reply
Bnjoroge
50 minutes ago
[-]
Yup. I’m hoping this variant fixes these issues.
reply
reactordev
3 hours ago
[-]
This. It will try to fix and refactor things that don’t need fixing because it gets stuck trying to solve the problem at hand.
reply
jackdoe
3 hours ago
[-]
I think there is some threshold after which "best" model doesn't matter, we are not that far from it. Fable now is really good, in a year or so, if Kimi catches up, even if Fable6 is much better, I think I will use kimi at 1/10th of the price.

I said that about opus 4.5 at the time, thinking "this is so good, in 6-12 months the Chinese models will be as good and cheap, I will use them", but I was wrong.. I pay premium for opus4.7/8 and Fable.

But at some point, it will just do the thing you want it to do, and then the race to the bottom will start.

Now that Chinese companies have access to some very good Fable tokens, I hope it speeds up the race.

reply
Zoadian
3 hours ago
[-]
price/token isnt the only thing relevant. if you have to ask the AI again, it'll cost you more than when it gets things right in the first place.

so better models may still be cheaper even if the price per token is higher.

reply
jackdoe
3 hours ago
[-]
yes, that is my point, but at some point, better is unmeasurable, and both the better and the not-as-good produce similar result, and then you pick the one with 1/10th of the price
reply
wolttam
3 hours ago
[-]
Depending on who you are and how you use these models, we're already at this point
reply
Bnjoroge
25 minutes ago
[-]
Output tokens are almost 5x more expensive than mimov2.5 pro/dsv4pro. I’m curious to see if Kimik2.7 is that much better. Feels like kimi are positioning themselves as the premium open source models
reply
yanis_t
4 hours ago
[-]
I was wondering how does Anthropic and likes keep competitive when Opus is ($5 / $25) 5x times more expensive compared to Kimi K2.6 ($0.7 / $3.4) or other Chinese models, while being only marginally better.

My theory is that US enterprise just can't send data to Chinese and that's understandable, but is that "the moat"?

reply
DCKing
3 hours ago
[-]
The moat right now is model performance and what that means for how many tokens and additional time you spend.

I say this as a relatively frequent user of Kimi models and generally a big fan. But on not-yet-gamed benchmarks like DeepSWE, Kimi K2.6 is beaten soundly by Claude Sonnet 4.6 ($3 / $15) and even slightly by GPT 5.4 Mini ($0.75 / $4.50).

There's no question Kimi models are very good for a lot of code tasks. They're the best quality open weight model. But to get similar overall outcomes as on Sonnet/Opus, on average you'll spend many more tokens and will have to do more managing of the model. You shouldn't look at price per token, you should look at how much you pay for the entire process.

reply
Bnjoroge
46 minutes ago
[-]
I personally dont put any weight to DeepSWE. Other than 5.5 being directionally the best model, it gets the others pretty wrong in my experience. FrontierCode from cognition looks interesting
reply
esperent
2 hours ago
[-]
I'm more interested in how much effort I have to put in, at least while I'm paying in the range of current subscriptions (so ~€100-€200 a month or so). If the prices go up much more than that I'll have to switch to caring more about token efficiency. But at current pricing the bottleneck is my attention, not model efficiency. As such, even a small improvement in model quality - and hence, a decrease in how much attention I have to spend on it - makes a big difference.
reply
papersail
2 hours ago
[-]
I'm not sure I would put too much weight on DeepSWE as a benchmark, given that GPT-5.4-mini ended up close to Opus 4.6 there.
reply
DCKing
2 hours ago
[-]
Any benchmark is iffy and has weird results, but this is the best we got at the moment. Most people working with Opus and Kimi would likely tell you they're much further apart than the numbers that were quoted for Kimi K2.6, and DeepSWE seems to capture that gap better.

One major thing DeepSWE has going for it is that all other benchmarks (including those quoted by MoonshotAI on this page) don't: the other benchmarks that are completely gamed. The benchmark answers are public and part of each model's training data. This benchmark may still be iffy, but at least it's not gamed.

reply
WarmWash
1 hour ago
[-]
Somehow the internet has also forgot that cheating to get ahead in China is basically a norm and expected behavior.
reply
DCKing
1 hour ago
[-]
American labs also use gamed and cherry-picked benchmarks extensively. Anthropic used them in their Fable announcement and avoided DeepSWE because it doesn't beat GPT-5.5 in that one. Google's numbers for Gemini 3.5 Flash recently did not at all line up with people's subjective experience using these models, and this also happened with Gemini 3.1 Pro before it.

Everybody has incentives to manipulate benchmark results to show their models in the best light.

reply
LUmBULtERA
2 hours ago
[-]
API token price is one thing, but subscriptions on Claude are a good value. Weirdly everyone says that Claude subscriptions are subsidized because of the API price, even though (1) no one actually knows Claude's cost of inference, and (2) Chinese providers are also able to provide cheap inference, so why do they think Claude can't?

I also wonder if Enterprises have deals for other API pricing that is not posted publicly, so all we see is a high API sticker price.

reply
efromvt
2 hours ago
[-]
I think the perception is that it is not 'only marginally better'; whether or not you specifically agree that perceived quality gap lets them differentiate on price.

I'd further say that there are probably enough rational actors running evals out there that the marginally better is not pure vibes for the cases where people are spending lots of money, but I only have direct line of sight to some of those eval suites. Maybe everyone is irrational and anthropic is exploiting that!

reply
khuey
3 hours ago
[-]
I think most people who've tried them both would tell you Anthropic's models are more than marginally better than Kimi. Kimi and the other open source models may score well on SWE-bench or whatever but the gap is noticeable IMHO once you actually try to use them.
reply
Bnjoroge
42 minutes ago
[-]
It depends on what your task is and how precise your prompts are. Planning with fable or 4.8 and laying out the plan in step by step process and coding with mimo v2.5 pro or dsv4pro or qwen 3.7 max and doing a final review with 5.5 has worked really well for me for infra stuff.
reply
gruez
1 hour ago
[-]
Your question relies on the premise that Chinese companies continue releasing free models. What's "the moat" for them continuing to do that?
reply
smoe
2 hours ago
[-]
I reckon right now the Enterprise concern is more FOMO around the AI wave and how to retrain or replace up to hundreds of thousands of employees. I don't think cost is the main concern right now.

But if AI doesn't lead quickly to vast large scale replacement of workers as promised, I could definitely see the C-suits and their gaggle of consultants starting to ask questions about token pricing.

reply
yababa_y
4 hours ago
[-]
I want Opus to be only marginally better, but I do mostly research engineering and its ability to not fuck up my projects is absent. Every time my credits lapse I let kimi and composer2.5 have some play and it’s basically just an excuse for me to keep playing computer because when the oai/ant credits refresh I always need to spend hours recovering from the other models either misconceptions or boneheaded eng practices. Even when I only let it touch my web games…
reply
nullbio
3 hours ago
[-]
I think none of them having a defacto and high quality English focused cli is a big part of it. None of the Chinese models I've tried have worked well in opensource cli's. Granted, I've only tried a few, but still...
reply
freigeist79
2 hours ago
[-]
i use github copilot cli + openrouter + qwen 3.7 max and it's really much better than i expected (used to opus 4.7 at work)
reply
Bnjoroge
41 minutes ago
[-]
huh? They all work great in omp/opencode unless you mean their own native clis like kimi code
reply
re-thc
3 hours ago
[-]
> My theory is that US enterprise just can't send data to Chinese

Lots of US providers are hosting these “open source” models so doubt that’s the problem.

reply
theanonymousone
29 minutes ago
[-]
In OpenRouter, there is an "int4" tag for Moonshot provider of Kimi K2. 7 Code. Isn't that too low, particularly coming from the very developer of the model? Os that a mistake? How is it in their direct API offer?
reply
kouteiheika
25 minutes ago
[-]
The model is natively quantized (i.e. it was trained that way in the first place, so this is not a post-training quantization which degrades performance).
reply
343rwerfd
4 hours ago
[-]
I think any new model not demonstrably maybe 20-30% over Deepseek v4 capabilities priced over the price per token of Deepseek is almost automatically deprecated as low use model (maybe for Planning).
reply
0xbadcafebee
24 minutes ago
[-]
DeepSeek v4 Pro is not actually that good a model compared to GLM 5.1 and Kimi K2.6. It's an okay coder/thinker for the price.
reply
giancarlostoro
3 hours ago
[-]
Is Deepseek just eating cost or are people able to host their open models for comparable costs?
reply
psittacus
3 hours ago
[-]
If openrouter is to be trusted, the cheapest offers that are not from Deepseek itself are:

- twice as expensive on the output (1.52 vs 0.87)

- six times as expensive on the input (0.33 vs 0.05)

https://openrouter.ai/deepseek/deepseek-v4-pro?sort=price#pr...

reply
natrys
2 hours ago
[-]
These things enormously benefit from economies of scale. I am fairly certain their margins might be low but they don't actually sell API at loss, however that doesn't mean your cost footprint would be anywhere as low.
reply
trollbridge
3 hours ago
[-]
Other people are hosting it in the same order of magnitude. Xioami recently matched DeepSeek’s pricing.
reply
re-thc
3 hours ago
[-]
They focused on caching and other optimizations.
reply
rsanek
2 hours ago
[-]
Likely CCP-subsidized
reply
minraws
1 hour ago
[-]
I tested it properly and it seems rather decent improvement atleast it does use less tokens for the same task which is good enough a reason for me to use it over k2.6 if I need an open model
reply
bgins
4 hours ago
[-]
I am still very new to the open-weight/source models. If anyone is using them full-time, I’d really love to hear about the setup and how they perform, as I am considering moving my org off Anthropic products.
reply
marcyb5st
2 hours ago
[-]
Anecdotal, but here's my experience.

For personal stuff I use forgecode with openrouter. Firstly, forgecode is a much better harness than Cloude code (IMHO).

Anyway, regarding the models, my experience is that there is not much difference in terms of quality, but the cost difference is insane. At least for how I use agents. Yesterday's example is the following: I am developing a small DSL for search across complex technical documents. I wanted to add a small operator to it and thought that to give fable a spin. It burned through 13 USD and while it delivered the solution it wasn't objectively better than what Deepseek v4 did for 1.7 dollars (same exact task because I was curious).

For full disclosure, I ask agents for piecemeal stuff. Like in the DSL case, I designed the operators and then asked agents to implement them one by one. Probably if I asked to design the whole thing starting from these complex documents Fable would shine, but every time I try to give agents broader scope tasks they burn through millions of tokens, generate questionable code, which I have to spend time familiarize myself with.

reply
sroerick
1 hour ago
[-]
I'm making DSLs a lot as an architecture pattern also. I'd be curious to know what stack you're using this and how you're approaching it
reply
DragonBooster
3 hours ago
[-]
These models have open weights, but at the moment most flagship models are practically accessible only through third-party model providers. The main exception is models in the ~30B parameter range, which can still be run on consumer-grade GPUs. That said, even consumer GPUs have become increasingly expensive and difficult to justify in recent years.
reply
mirekrusin
3 hours ago
[-]
You can definitely go above 30B on consumer hardware – 2x gpus, spark, mac, half byte quants etc.
reply
sdesol
2 hours ago
[-]
I created this and I would say glm-4.7 accounts for 80% of the code in https://github.com/gitsense/gsc-cli

If you look at a file like:

https://github.com/gitsense/gsc-cli/blob/main/internal/cli/r...

you can see that I attribute the models used. What I found was 4.7 was not very good at `go` code which was why you started to see `Gemini 3 Flash` in the attributions.

4.7 is what Cerebras provide and for me, speed in iterations is a lot more important. Having played around with MiMo v2.5.0-Pro, I am 100% sure it could have done what Gemini 3 Flash did.

There were a few points where I was stuck and needed Sonnet to explain things to me, but I think the dirty secret that Anthropic and OpenAI won't tell you is, if you know how to code, the models are honestly good enough.

Based on my experience with MiMo and what others are saying about GLM 5.1, we are now in a hardware race. The Chinese Models are 100% drop in replacement for Claude if you know how to program but want to AI to help amplify what you know. What I will consider now is what provider can provide the fastest inference.

MiMo-v2.5.0-Pro-Ultraspeed is really good at generating good results quickly and burning your money as fast.

reply
andai
3 hours ago
[-]
I keep trying to switch to the Chinese models, but I keep finding myself asking Claude to fix their outputs. (Both functionality and style.) So I always end up switching back.[0]

I also keep trying GPT, which is quite solid. Very fast, great at debugging. But its code is often overly clever and hurts my brain.

(Maybe fixable with prompting. I tried and it helped the Chinese ones a bit. Just tell them do be elegant, like in the old image AI days "+good -bad"!)

For now I do still need my human brain to actually be able to make sense of the stuff, and Claude is the only one that consistently meets that requirement.

But I am hoping that one of these days, one of the Chinese labs figures out the special sauce :)

--

[0] (For smallish edits, though, I am having a great time with DeepSeek Flash. Practically unlimited AI on tap! How cool is that.)

reply
kamranjon
2 hours ago
[-]
I have been using deepseek v4 flash as my main model for everything ever since dwarf star came out. I run it on my M4 Max MacBook Pro with 128gb of memory. I run it usually as a server and connect to it over tailscale with my coding machine and use the Pi coding agent. It’s a big leap over using the Qwen models though it doesn’t have vision - so I still will run those when I use vision. GLM 4.7 flash was my previous go to for coding but I’ve completely switched to deepseek for all non-vision things.
reply
scottcha
3 hours ago
[-]
I use glm5.1 plus pi with a few customized skills and am very happy with it. I hadn’t touched my Claude 5x plan for a couple of weeks but opened it back up in Claude code when fable was released and did a few tasks and still was happy to return to glm/pi.
reply
sebastianconcpt
3 hours ago
[-]
Better than Qwen3.6-35B-A3B-8bit ?

When I tried glm found it way way slower (omlx as runtime)

reply
trollbridge
3 hours ago
[-]
Qwen 3.6 seems to be the strongest local models, works OK on an RTX 5090 or a > 32GB Mac.
reply
polski-g
2 hours ago
[-]
I used glm5/5.1 for 60 days. Certainly better than Sonnet 4.6, not as good as Opus or GPT.

Use DCP or Magic Context plugin in OpenCode to keep the context below 160k and you're fine.

reply
pcwelder
1 hour ago
[-]
Great! Finally follows custom tool call format (k2.6 couldn't). It's a good indicator of instructions following and agentic behaviour.

UIs it's generating is pretty good, not without problems, but certainly better than other models at this price point.

reply
RIshabh235
2 hours ago
[-]
I think deepseek has crossed the threshold for being on par with opus 4.6 and kimi is doing a great job in shipping velocity.
reply
pixel_popping
1 hour ago
[-]
Deepseek V4 is far from Opus 4.6 level, it might look like it at first glance, but the general reasoning (especially multi-steps) is frankly far off. It's good enough to build great things don't get me wrong, but there is really something that is different from Anthropic models.
reply
goldenarm
3 hours ago
[-]
Benchmark geometric mean

- GPT-5.5: 62.7%

- Opus 4.8: 62.2%

- Kimi K2.7 Code: 56.3%

- Kimi K2.6: 48.2%

reply
lostmsu
1 hour ago
[-]
Would be nice to have 5.2 and 4.6 for comparison.
reply
jkwang
3 hours ago
[-]
This maps to what I'm seeing in practice. The gap between demo and production is consistently underestimated, especially around error handling and edge cases.
reply
fractalf
3 hours ago
[-]
How is 2.7 a thing _now_ ? it's not even mentioned on moonshot's webpage..
reply
cassianoleal
3 hours ago
[-]
It's not 2.7. It's 2.7-Code, and it's 2.6 token-optimised for coding.

https://platform.kimi.ai/docs/guide/kimi-k2-7-code-quickstar...

reply
RobertPelloni
3 hours ago
[-]
insanely great!
reply