Nvidia Nemotron is also an open training source model, though a portion of its dataset remains proprietary.
Quoting lambda's comment:
> Note that the Nemotron models are generally stronger than Olmo and K2 Think V2 (according to Artificial Analysis benchmarks), and there is a lot of overlap in their datasets (lots of datasets are based on the same sources with different filtering, Olmo and K2 Think V2 both have used some Nemotron datasets).
> But yeah, Nemotron is a modern and fairly capable LLM, even the 122b is more capable than Deepseek R1 (a 671b model) on most benchmarks, and there's also the recently released 550b Ultra now.
In fact, if the frontier companies had taken their approach, it would have started much slower, but I think we would be far more advanced by 2035. Instead we have a majority of society that wants to see AI fail.
Do you talk to regular people? I work out of coffee shops routinely and literally like 90% of laptops have ChatGPT or Claude open. I was shocked at how many of my friends love the silliest of AI features (like Slack bot summarizing your day or your upcoming meetings), and a lot of decks, proposals, SOW's, etc. are (at least in part) generated with AI these days.
https://www.pewresearch.org/chart/about-a-quarter-of-u-s-adu...
It all, of course, depends on what people mean by "AI" (I think the question basically defeats itself, it's akin to asking someone about "databases", given that it covers image generation, self driving cars, TikTok feeds, drug discovery and chatbots) but AI sentiment at large is more negative than positive.
https://www.pewresearch.org/chart/americans-predict-ais-impa...
So, depending on where you sit: Sure, most people will use "AI", meaning a chatbot (probably ChatGPT: https://www.pewresearch.org/chart/americans-report-using-cha...). 90% in coffee shop land, why not.
But that does not mean that they are not weary of the consequences, and are growing more weary. I think, predictably, the better situated you are and the more your direct livelihood is at stake. That's just the animal we are.
Does that mean that we should have slowed down? Matter of opinion. My take: Absolutely not. The people who need it the most around the world will have dramatically improved lives, because of access to better medical advice or information about institutions and systems, to start things and help them in their daily lives.
Or is it just vibes?
https://gizmodo.com/people-hate-ai-even-more-than-they-hate-...
IsaacSim was (and might still be) the best robotic learning sim and I ran MLAgents.
I empathize with this but curious what would make any other country a better safehaven for your data? I personally like the EU's approach to data safeguards, but are there other locales/data protections you have in mind that would keep your data "safe".
Let's say Gemini gets to AGI by tomorrow, will my Google account access, or Gemini apps access and data be blocked if I'm not a US citizen? (Anthropic did it with a 5% better model).
If US is classifying the model access based on citizenship, that's similar to treating it as a Defense capability.
You can already imagine Anthropic working with a bunch of shady brokers to "remedy" this situation.
How about deporting people without a hearing or opportunity to present evidence about their charges. And then violating the judges order to turn the planes around.
How about systematically ignoring judicial rulings.
How about detaining people based on the color of their skin and spoken language/accent.
How about violating the emoluments clause of the constitution by accepting a personal airplane.
How about sending your son in-law, who hasn’t been appointed to any office with the advice and consent of congress as required by the constitution.
How about refusing to seat elected congress members for reasons for months.
How about singling out companies like intel for targeted trade restrictions and then demanding equity in order to lift them.
What about threatening to delay or deny a merger of a media company unless your ally is allowed to buy them.
What about refusing to enforce the TikTok ban until you can arrange a buy out to an ally.
What about a formal market with a known price for pardons and commutations.
What about stating multiple wars without congressional approval.
What about creating a fake department named Doge that withholds funds apportioned by congress and breaks contracts that have explicit obligations for payment that results in more termination fees and losses than the savings. All without congressional approval.
How about threatening to withhold federal funds from states with governors of the opposing political party but not your own? Remember the president is supposed to execute the law congress passes not make law or arbitrarily enforce it based on their own political needs or values.
Compel you to reveal your secrets, including your passwords by threatening to arrest and detain you without legal proceedings for an unspecified period.
Deny your basic human rights, particularly at the borders, especially if you aren’t a citizen.
And more.
It is a commonly accepted "fact" right now, outside the US, that the US is not to be trusted (right now), due to some orange guy, and his mates, manipulating markets, running their mouths, doing all kinds of criminal and/or infantile shit.
I'd say there is quite a bit of evidence for this all around.
Ask intel, paramount, TikTok or anthropic if they feel law will be applied equally to all companies.
Ask the blue states that had fema funding withheld when it went to red states.
Ask black families that haven’t gotten reparations when Jan 6 rioters that beat and killed cops to over turn an election will get almost $2b in reparations and then had the Supreme Court throw out their votes in Louisiana in the middle of an election to overturn the voting rights act, redraw districts, overturn their own case law and the principle that judicial review shouldn’t happen too close to an election so they could redraw the districts.
Business leaders are sucking up to curry favor. That by definition isn’t the rule of law it’s the rule of dispensation. It’s the spoils system.
If you have a counter argument you’d better make it now or you will tip your hand.
Frankly, I'm surprised there's not more urgency on the part of Europeans to reduce dependence on US tech. I don't like it. I'm an American in tech. But, the US can't be trusted, at this time. And, given how irresponsible tech leadership has been, in kowtowing to Trump, I don't see how they can reasonably be trusted, either.
I invest in startups and companies at every stage are losing contracts in Europe specifically for this risk. I can’t say who but it’s a multi front trend.
and really, the topic here is reducing a transgressive President from infringing tech activities elsewhere (used to be mainly about surveillance, but then trump happened).
I am also assembling the largest in home robotics training data set available which will be open source.
Want to help?
Stallman was correct in the 80s and is correct now about libre software
From a practical perspective, I'm not sure any servers are safe anywhere...depending on who may want your data.
I'm surprised there isn't a lot more attention to encrypted, distributed, erasure-encoded stores.
Going forward would be such open source, open data and open recipe models possibly someday even with the training being crowd sourced if not inference like the BitTorrent model.
Lastly, even Chinese models (GLM, Deepseek, MiMax) work really really good and any user would testify that they do not miss OpenAI/Anthropic/Gemini at all if they're using those Chinese models which is argument enough that with such models, no one is going to miss Chinese models as well.
i doubt they are including a lot of training data labeled with the language.
"how to say X in language Y" is a different task from saying X in language Y
My last hope for soverign AI is from Chinese open models
If you want to mix models like this, check out https://github.com/deepbluedynamics/nemesis8
Why the emphasis on sovereign? Open is good enough. No?
The training data and the Apertus LLM may contain or generate information that directly or indirectly refers to an identifiable individual (Personal Data). You process Personal Data as independent controller in accordance with applicable data protection law. SNAI will regularly provide a file with hash values for download which you can apply as an output filter to your use of our Apertus LLM. The file reflects data protection deletion requests which have been addressed to SNAI as the developer of the Apertus LLM. It allows you to remove Personal Data contained in the model output. We strongly advise downloading and applying this output filter from SNAI every six months following the release of the model.
> What most people miss IMO is that this is not a team who is doing this for the fourth time like virtually any other LLM provider and who could learn from its own past experiences. I bet if the team would do another model training they could get way better results at one fourth of the costs.
> Fully open model: open weights + open data + full training details including all data and training recipes
There are equally open, much more useful models out there: https://artificialanalysis.ai/?models=nvidia-nemotron-3-ultr...
Who confirms those requests are legit?
How many normal people do you know who use "ChatGPT"? A lot, probably.
How many even know what "Gemma" is, let alone have downloaded llama.cpp, a GGUF file from Hugginface, and run "llama-server" from a text console with all the correct command arguments? How many are thinking about this use case when speccing out their next computer? Where is the breathless marketing copy boasting x tok/s?
We are sleepwalking into slavery.
Yes, I realise this isn't "running a local model", but it's using models that can be grabbed and run locally. For my pipelines, I feel far more confidence when I use an open model (even one like GLM-5.2 that would be expensive for me to run) since I have a backup plan if the hosted/cloud option becomes unworkable for me. If that happens to me with Opus, I have zero options.
This choice is made for us. The deciding factors will be convenience and economics.
My sense is that just like Web 2.0 SaaS we are destined for servitude.
A better strategy is to play an assymetrical game IMO. Don't let your would-be master write the rules by which you play.
What do you mean by this? Do you have an example in the given context?
You would also be shocked what's possible on a 64GB Mac Studio, which isn't that unattainable.
I can see this as a future battleground but access to frontier models (which you cannot run locally) seems a lot more relevant today.
That’s a bit hyperbolic…
Of course the frontier will always be unattainable, but that's like pointing out that I couldn't buy my own Cray supercomputer.
Yep. I'm an old time Linux sysadmin, but I am COMPLETELY baffled as to what I can or cannot run on my 32GB R9700 with 128GB main CPU memory.
If I want something Claude or Codex like what do I use that would be useful? If I want a chat system, what do I use? Images--apparently ComfyUI for setup but after that what do I do?
I don't even mind spinning up something in the cloud for a bit, but I need to know how I'm going to get data up and down without racking up massive bandwidth charges.
I'd love to do some tinkering, but the field is moving so fast and so full of charlatans that cleaning the dross out is almost impossible.
The jokes write themselves.
the swiss have no gpus
I can run the 8B version of this swiss-ai model on a ten year old GPU. For the larger one, $2000 consumer hardware can run it fine. Beyond that, there are plenty of places where time on a GPU can be rented, and if the model is good, there will be hardware to run it.
There were a number of use cases where we needed to use Gemini (audio modality), and Ultra has been a VERY cost-effective alternative once we got through the nuances.
no, actually, from the docs it sounds mainly motivated by the country's unique linguistic requirements.
I think a problem with open-weight models is that while you can improve them, you are not going to create the next generation of LLMs by fine-tuning. We are at the mercy of frontier labs for access to SOTA LLMs. For example, Anthropic recently started requiring identity verification for Claude [0], same for OpenAI [1].
If one day China's distillation labs stop releasing their LLMs as open-weight, I doubt American labs will continue to release free LLM weights without that competition.
That's where fully open pipelines shine: they enable the community to create the next generation of SOTA LLMs. That is the only way LLMs truly become sovereign.
This notion that Chinese labs are merely distilling frontier models is quite an unwarranted slur. Those labs have published WAY more useful research than US labs on RL techniques, novel model architectures, training pipelines, etc. They have also hit intelligence-per-parameter densities that US labs have yet to attain.
Apart from that, merely training a model on outputs from another model, off policy and without the logits, doesn’t really work that well.
The Chinese labs know how to build frontier level models. GLM-5.2 shows that they no longer even need Nvidia chips to do it.
Chinese labs are basically just telling everyone, out in the open, what they're doing and how to do it, and the answer from American frontier labs is "Well, they couldn't possibly be getting the results they're getting without just distilling our models," and the American labs aren't even trying to do some of the stuff like DS's aggressive caching to get costs down.
it happens to all models…when the internet is increasingly generated, things happen
I disagree with this use of SOTA, and this topic is why.
Anthropic and OpenAI have “cutting-edge” models. These are beyond the state of the art but they are closed, secretive, hard to quantify.
The “state of the art” is open source, open weights models that can be inspected, studied, shared and critiqued, because that is what is meant by “the art” —- it is the knowledge and principles and evidence and materials available to all. The “state of the art” is the highest point of that.
I wish we could make this distinction and stop blessing two secretive, unverifiable loss-making companies with so much power.
(Putting that aside, I suspect — without evidence, mind you - that the endless march to solving models by making them bigger is not the solution anyway.)
Chinese's model like GLM is getting better for coding task and its cheaper. Microsoft Github copilot have to switch billing to token based. the cost of AI have increased since agent come into play. whoever can offer cheaper token to do task will win.
even Microsoft is looking into Deepseek for cheap token.
https://www.axios.com/2026/06/16/microsoft-copilot-cowork-to...
But "state of the art" implies the highest state of general availability, not just in terms of access to some product, but of use of the ideas, concepts, methodologies etc.
Anthropic and OpenAI have "cutting edge" models; the state of the art is behind the cutting edge.
The state of the art is the best open source, open weights model available. More or less by definition.
I am probably tilting at windmills here.
But the way SOTA is generally understood by other users of the language, it refers to exactly the team, technology, & techniques defining the cutting edge in any field, regardless of the whether the technology & techniques are available outside of that team...
its things you would be trained in as part of a bachelor's degree and some graduate coursework