Inference Optimization for MiMo v2.5: Pushing Hybrid SWA Efficiency to the Limit
33 points
3 days ago
| 3 comments
| mimo.xiaomi.com
| HN
▲
LaurensBER
2 hours ago
[-]
It's really cool and interesting to see the kind of engineering that goes into Xiaomi (and Deepseeks) inference optimizations. Z.ai has also published some interesting papers although I haven't had a chance to go through them yet.

It does inspire hope that the Chinese labs seem to be so open although the sceptic in me does wonder what their end game is.

Surely, from a purely economic perspective it would be wiser to keep this proprietary and benefit from the increased API traffic?

reply
▲
trollbridge
1 minute ago
[-]
Their game? Sell me tokens instead of me buying them from an American lab for a higher price.

Publishing open weights gives me more confidence in the model, and ironically makes me less anxious about making sure I can replace the cloud usage with a local alternative. Whereas I’m very nervous right now with relying on 5.6-Sol - what if they triple the price, nerf it, etc.?

reply
▲
bee_rider
27 minutes ago
[-]
The bet could be that they’ll ultimately be able to sell hardware capable enough of running local models comfortably.
reply
▲
onlyrealcuzzo
26 minutes ago
[-]
Standard commoditize your complement.
reply
▲
ignoramous
1 hour ago
[-]
> the kind of engineering that goes into Xiaomi (and Deepseeks) inference optimizations

At Xiaomi, MiMo is now led by Luo Fuli. She is a former Alibaba & DeepSeek employee: https://newsen.pku.edu.cn/news_events/news/people/15385.html (https://archive.vn/I8Pmu) / https://e.vnexpress.net/news/tech/personalities/who-is-luo-f... (https://archive.vn/sb3B6)

Don't know if it is due to Luo, but it is striking how similar performance & pricing of the models, DeepSeek v4 Pro & MiMo v2.5 Pro, is.

reply
▲
killingtime74
1 hour ago
[-]
Will they lower the price or is this documenting past work
reply
▲
limbicsystem
1 hour ago
[-]
Their pricing is incredible on the token plan - something like 50b tokens for $60!
reply
▲
polski-g
1 hour ago
[-]
No that's not right. It's 50b credits, not tokens. What is a credit? Nobody knows.

Someone did the math a few months ago and paying API prices was the same as the monthly subscription.

reply
▲
ricardobeat
2 hours ago
[-]
Such a well written article, refreshing to read in between all the slop.

I've used Mimo extensively in the past few months, can't wait to see what v3 will bring.

reply