Laguna S 2.1
191 points
5 hours ago
| 20 comments
| poolside.ai
| HN
axus
1 minute ago
[-]
You will not, directly or indirectly: copy, modify, or create derivative works of the Site or any Product;
reply
Lwerewolf
2 hours ago
[-]
Testing it now. At the very least, competitive with DS4-Flash indeed. On my small (and per Sol's words, _very_ semantically dense) C test codebase, it found things that only gpt-5.2 managed to find back in the day, but also made a stupidly incorrect initial observation that a memfd_create()/mmap was used for IPC (funnily enough - sol missed that as well in its review, until I pointed it out). Re: the claims vs deepseek v4 - both flash and pro are expected to get a "general availability" release very soon (i.e. well-"post-trained"), so things can change in a... well, flash, as per usual in the current environment.

Anyways, keep 'em coming.

reply
ilc
2 hours ago
[-]
What harness/quant did you use for testing?
reply
Lwerewolf
2 hours ago
[-]
nvfp4 mlx, literally barebones pi.

edit: on bigger tests, got it to loop pretty easily unfortunately, probably local settings.

reply
embedding-shape
11 minutes ago
[-]
> edit: on bigger tests, got it to loop pretty easily unfortunately, probably local settings.

Been playing around for a few hours with the poolside/Laguna-S-2.1-NVFP4 + poolside/Laguna-S-2.1-DFlash-NVFP4 + vLLM, been seeing the same behaviour. Usually new model releases are plagued with issues at release though, best to wait 1-2 weeks then retry, or better yet, investigate yourself :) Personally I haven't found any obvious issues.

reply
sosodev
1 hour ago
[-]
What inference server are you using? They have a custom branch for llama.cpp, but I wouldn't be surprised at all if it still needs fixing.
reply
Lwerewolf
42 minutes ago
[-]
This: https://github.com/Blaizzy/mlx-lm/tree/pc/add-lg ...and this is what I should probably wait for (not sure why it's in vlm): https://github.com/Blaizzy/mlx-vlm/tree/pc/laguna-s-nvfp4 ...or perhaps I should've just used the gguf with the provided llama.cpp instead of trying to run the nvfp4-mlx from the get go, but where's the chaos in that :)

Running deepseek flash on something locally now, this will have to wait a bit. I still stand by my initial quick assessment - looks capable. Some people on r/localllama also reported loops. We'll see in ~10 hours. Hopefully I haven't terribly mislead people.

reply
mft_
2 hours ago
[-]
Looks impressive, and this size fits achievable home hardware.

That said, if someone would kindly quantise this down for the 64GB paupers, that would be appreciated. (I know there’s likely degradation, but some people reported good results with a 2 bit version of Qwen 3.5 122B, and this is starting from a higher point. Would be interesting to try, at least.)

Edit: someone in the process of doing so: https://huggingface.co/vcruz305/Laguna-S-2.1-GGUF

reply
yogeshp
1 hour ago
[-]
They have also published smaller 33B model called Laguna XS 2.1, its Q4 gguf is 20GB.

https://huggingface.co/poolside/Laguna-XS-2.1-GGUF/tree/main

reply
mft_
1 hour ago
[-]
Thanks for flagging. From the few benchmarks I can find, it looks there or thereabouts with Qwen 3.6-35B-A3B, or maybe a touch below. I'm interested to compare a model that is a big jump larger with pretty impressive benchmarks, but more heavily quantized to fit.
reply
verdverm
2 hours ago
[-]
The tool I've been using, llm-compressor, can quant models that do not fit in memory (use the sequential pipeline)

https://github.com/vllm-project/llm-compressor

my setup to help you on your way: https://github.com/verdverm/quantr

Though it seems these will not be needed as Poolside has published quants & dflash with their models.

reply
river_otter
2 hours ago
[-]
Hey, this model is not a joke! Exciting, we already got a usable PR of work out of it.

https://github.com/mozilla-ai/otari/pull/348

reply
mchusma
2 hours ago
[-]
Incredible. This is definitely the launch of the day. Just crushing Google's releases.

The pricing here is incredible. This is the first US release that's competitive with DeepSeek V4 Flash. Very excited about this.

reply
aubanel
44 minutes ago
[-]
Really impressive signal that this 128B model can beat DeepSeek V4 (1.6T) on most coding benchmarks!

Also, I really like Poolside's habit to compare not only to other top models in its weight class (others don't do it, looking at you Mistral), but also to the very top open-weight models, even much bigger ones like the 2.5T Kimi-K3!

reply
kamranjon
2 hours ago
[-]
Whoa whoa whoa, 118b params, 8b active MOE, long context reasoning, open weights - music to my ears. Hadn't heard of this lab before but I am very excited, will definitely try this out tomorrow - this is a real sweet spot I think in terms of model size and performance.
reply
svclaws
2 hours ago
[-]
If the numbers are legitimate then our prayers have been heard
reply
SwellJoe
3 hours ago
[-]
This is exactly the kind of model that's been needed in the middle. Realistically self-hosted, Good Enough intelligence, MoE so it's fast on limited bandwidth systems like Strix Halo and DGX Spark.

For a while there's been nothing to run on my Strix Halo that's notably better than what I can run on my dual 32GB GPU desktop (Gemma 4 or Qwen 3.6 dense models), but this seems likely to be the step up in size that actually works better than those.

reply
spelk
33 minutes ago
[-]
This is fantastic work, really impressive is an understatement. I really hope this sets a new DeepSeek-esque standard and starts another the death knell for companies continuing to cosplay as frontier labs (like Cohere).
reply
benjiro29
1 hour ago
[-]
!! Be careful when testing the model.

A lot of people are testing it, and reporting disappointed results / benchmaxxxing claim. But do not realize that thinking has a issue with the default configuration.

Important - make sure that THINKING is enabled. By default it wasn't although I was passing the flag --default-chat-template-kwargs '{"enable_thinking": true}' in vllm recipe. The generation_config.json file that is included has by default max_new_tokens as 32k which seems to be cutting off thinking altogether so increase it. At first I was very disappointed with the output I was seeing, but once thinking is enabled, the code quality seems to be MUCH better. More real world testing to be done.

https://www.reddit.com/r/LocalLLaMA/comments/1v2pg99/laguna_...

reply
voxgen
48 minutes ago
[-]
Even the official provider on OpenRouter seems to have this issue. Hope it's an easy fix for them.
reply
nshotton
33 minutes ago
[-]
Thanks for posting this, it made a huge difference tweaking the recipe.
reply
Iolaum
3 hours ago
[-]
Model Looks amazing!

Even more important, subjectively, is that this model will run very well on Strix Halo (e.g. Framework Desktop), DGX Spark kinds of devices. Looking forward to Unsloth dynamic mtp quants.

P.S. Looking at the HF release they already offer Q4_K_M and DFlash drafter for speculative decoding!

reply
verdverm
1 hour ago
[-]
I hope all models going forward come with a dflash drafter so we don't have to train one up separately.
reply
river_otter
3 hours ago
[-]
I love this. Is it possible to give a feel of how this stacks up to the good old Opus 4.5 in coding quality? For me that was the turning point where agentic coding in Claude Code etc became usable. Have we hit that threshold?
reply
megavon
2 hours ago
[-]
Having played with it for like 3 hours now....I'm probably moving from CC to this
reply
river_otter
2 hours ago
[-]
I am about 1 hour into using it with pi.dev. Do you have thinking on high? It is doing good but at one point i had to stop it and say 'you're overthinking this' haha
reply
megavon
1 hour ago
[-]
Yes full send mode on thinking. I have moved on from watching my agents and I don't really care how it thinks. I look at the end result and so far this thing has been blowing me away. No way this is as good as it is this small and fast. Outside Fable, this might be the best thing I've ever used.
reply
kamranjon
2 hours ago
[-]
What quant are you using?
reply
river_otter
2 hours ago
[-]
reply
fingerprinter
1 hour ago
[-]
One hour in, no more Codex for me. This thing rips.
reply
_mrinalwadhwa_
25 minutes ago
[-]
Has anyone tried it on a mac yet?
reply
megavon
3 hours ago
[-]
This is INSANE. How did they do this?
reply
eisokant
3 hours ago
[-]
"What we've done in this model is not necessarily add more intelligence, but improve the behaviors that lead to a more capable model: more verification, less taking things for granted, not declaring victory early, and being more persistent.”

+

https://poolside.ai/assets/laguna/laguna-m1-xs2-technical-re...

reply
Lwerewolf
2 hours ago
[-]
Almost like a built-in heavyweight harness.
reply
kamranjon
2 hours ago
[-]
"It went from the start of training to launch in under nine weeks..."

This is pretty impressive.

reply
docheinestages
1 hour ago
[-]
Any estimates of the performance (prompt processing and decoding tokens/s) on consumer hardware like Macbook Pro M-series?
reply
loolhahalmao
1 hour ago
[-]
happy the US has some counterweights to the Chinese labs, just need about half a dozen more.
reply
tosh
4 hours ago
[-]
open weights and

similar performance to deepseek v4, inkling at size of nemotron 3 super (!)

reply
iraldir
4 hours ago
[-]
Amazing model at this size if true, that's quite crazy!
reply
carimura
1 hour ago
[-]
Congrats Poolside team!!
reply
danr4
1 hour ago
[-]
holy shit its accelerating fast
reply