My reading of this is that OpenAI's contract with the Pentagon only prohibits mass surveillance of US citizens to the extent that that surveillance is already prohibited by law. For example, I believe this implies that the DoW can procure data on US citizens en masse from private companies - including, e.g., granular location and financial transaction data - and apply OpenAI's tools to that data to surveil and otherwise target US citizens at scale. As I understand it, this was not the case with Anthropic's contract.
If I'm right, this is abhorrent. However, I've already jumped to a lot of incorrect conclusions in the last few days, so I'm doing my best to withhold judgment for now, and holding out hope for a plausible competing explanation.
(Disclosure, I'm a former OpenAI employee and current shareholder.)
Even on a personal level: OpenAI has changed it's privacy policy twice to let them gather data on me they weren't before. A lot of steps to disable it each time, tons of dark patterns. And the data checkout just bugs out too, it's a fake feature to hide how much they are using everything you type to them
Why would we want to trade our constitution for, effectively, “rules Sam Altman came up with”?
Why the fuck does the department of war get to dictate anything to a private organization?
Why does the constitution say that you have to let the government murder schoolgirls with your tools?
Like by an administration that likes to act extra judiciously and ignore habeas corups?
I wonder where we'd find such a government. Probably shouldn't give them the power to "do anything legal NOR 'consistent with operational requirements'". That's the power to do anything they want
Presumably if the laws become less restrictive, that does not impact OpenAI's contract with them (nothing would change) but if the laws become more restrictive (eg certain loopholes in processing American's data get closed) then OpenAI and the DoD should presumably^ not break the new laws.
^ we all get to decide how much work this presumably is doing
Where?
> The system shall also not be used for domestic law-enforcement activities except as permitted by the Posse Comitatus Act and other applicable law.
Sounds like it's worded to specifically apply to whatever law is currently applicable, no?
Dictators rarely gain power legitimately, and always keep it with violence.
And, I mean, if they don't, gpt 5.3 is going to be pretty good help
Given the volume fine tuning a small model is probably the only cost effective way to do it anyway
Even if they were paying frontier prices they would be choosing 5 mini or nano with no thinking
At that point, a fine tuned open source model is going to be on the pareto frontier
Third Party Doctrine makes trouble for us once again.
Eliminate that and MANY nightmare scenarios disappear or become exceptionally more complicated.
Imagine arming chatgpt and letting it pick targets and launch missiles from clawdbot.
"Shall not be used as consistent with these authorities"?
So they shall only be used inconsistently with these authorities? That's the literal reading if you assume there's no typo.
Or did they forget a crucial comma that would imply they shall not use it, to the extent this provision is consistent with their authorities?
Or did they forget the comma but it was supposed to mean that they shall not use it, to the extent that not-doing so would be consistent with their authorities?
You gotta hand it to the lawyers, I'm not sure I could've thought of wording this deliberately confusing if they'd given me a million dollars.
He calls this exact scenario out in last night's interview: https://youtu.be/MPTNHrq_4LU
> to the extent that that surveillance is already prohibited by law.
<edit>
THAT'S EXACTLY WHAT DARIO WAS ARGUING and it is exactly why the DOD wanted to get around. They wanted to use Claude for all legal purposes and Anthropic said moral reasons.
Also notice the subtle language in OpenAI's red lines. "No use of OpenAI technology for mass *domestic* surveillance." We've seen how this was abused by the NSA already since normal communication in the Internet often crosses international lines. And what they couldn't get done that way they got around through allies who can spy on American citizens.
</edit>
I think we need to remember that legality != morality. It's our attempt to formalize morality but I think everyone sees how easy it is to skirt[0]
> I believe this implies that the DoW can procure data on US citizens en masse from private companies - including
> If I'm right, this is abhorrent.
I have no trust for Altman. His solution to distinguishing humans from bots is mass biometric surveillance. This seems as disconnected as the CEO of Flock or that Ring commercial.
Not to mention all the safety failures. Sora was released allowing real people to be generated? Great marketing. Glad they "fixed it" so quickly...
There's a lot happening now and it's happening fast. I think we need to be careful. We've developed systems to distribute power but it naturally wants to accumulate. Be it government power or email providers. The greater the power, the greater the responsibility. But isn't that why we created distributed power systems in the first place?
Personally I don't want autonomous unquestioning killbots under the control of one or a small number of people. Even if you don't believe the one in control now is not a psychopath (-_-) then you can still agree that it's possible for that type of person to get control. Power corrupts. Things like killing another person should be hard, emotionally. That's a feature, not a flaw. Soldiers questioning orders is a feature, not a flaw. By concentrating power you risk handing that power to those that do not feel. We're making Turnkey Tyranny more dangerous
[0] and law is probably our best attempt to make a formal system out of a natural language but I digress
[1] https://www.eff.org/deeplinks/2024/04/fourth-amendment-not-s...
The emphasized language is the delta between what OpenAI agreed and what Anthropic wanted.
OpenAI acceded to demands that the US Government can do whatever it wants that is legal. Anthropic wanted to impose its own morals into the use of its products.
I personally can agree with both, and I do believe that the Administration's behavior towards Anthropic was abhorrant, bad-faith and ultimately damaging to US interests.
This is key because it's the textbook example of a war crime. It's also something that the current administration has bragged doing dozens of times.
More succinctly: who decides what is legal here? OpenAI, the Secretary of Defense, or a judge?
> More succinctly: who decides what is legal here?
| The Department of War may use the AI System for all lawful purposes, consistent with applicable law, operational requirements, and well-established safety and oversight protocols.
- legal
- operational requirements
- "well-established safety and oversight protocols"
> who decides what is [consistent with operational requirements] here?
There's also subtle language elsewhere. Notice the word "domestic" shows up between "mass" and "surveillance"? We already have another agency that's exploited that one...
Why do you read that to mean just one is required?
I can see the logic if we were talking about dumb weapons--the old debate about guns don't kill people, people kill people. Except now we are in fact talking about guns that kill people.
> More succinctly: who decides what is legal here? OpenAI, the Secretary of Defense, or a judge?
Yeah, there's a pretty strong case that anyone claiming to trust that the administration cares about operating in good faith with respect to the law is either delusional or lying.
The other says you may build the Terminator if the DOD lawyers say it’s okay.
This is a major distinction.
It begins “The Department of War may use the AI System for all lawful purposes…” and at no point does it limit that. Rather, it describes what the DOW considers lawful today, and allows them to change the regulations.
As Dario said, it’s weasel legal language, and this administration is the master of taking liberties with legalese, like killing civilians on boats, sending troops to cities, seizing state ballots, deporting immigrants for speech, etc etc etc.
Sam Altman is either a fool, or he thinks the rest of us are.
> No use of OpenAI technology to direct autonomous weapons systems
Not surprised to see a guy like Altman adopt the strategy
I guess you can consider it a moral stance that if the government constantly does illegal things you wouldn't trust them to follow the law.
I know that's not what Anthropic said but that's the gist I'm getting.
Mass surveillance doesn't require a warrant, that's why they want it, that's why it's "mass". warrants mean judicial overview. Anthropic didn't disagree with surveillance where a court (even a FISA court!!) issued a warrant. Trump just doesn't want to go through even a FISA court.
This is pure evil from Sam Altman.
Is anyone listing these peoples names somewhere for posterity's sake? I'd hate to think this would all be forgotten. From Altman to Zuckerberg, if justice prevails they'll be on the receiving end of retribution.
Consider this, the bill of rights stipulates that a soldier cannot be stationed on your property in times of peace, but in times of war it will be allowed. It makes exceptions for times of war. but even in times of war, 4th amendment's search and seizure protection don't have an exception. Even in times of insurrection and rebellion. To deliberately violate that for personal and political reasons, that in itself is treason. With that intent alone, even without action, it invalidates all legitimacy that government has. If a clause in a contract is broken, the contract is broken. The bill of rights is the contract between the people and their government that gives the government its powers to rule, in exchange for those rights. With the contract explicitly, deliberately and with provable malicious intent broken, the whole agreement is invalidated.
I'll even say this, the US military itself is on the hook if they stand by and let this happen.
The current US government has a fundamentally different ontology for the derivation of human rights.
Wheras you and I likely agree that human rights are inalienable due to them being derived from the universe nature of human experience, the administration believes that human rights begin and end with them, the state. When they're the one able to affect the world with violence, it doesn't matter who's on the hook. The US electorate thought they could heal a status wound by authoritarianism instead of therapy and everyone else is paying the price.
Wort case, the current admin will make nazis look like cosplayers, and within a decade or so, he'll be standing next other ceos facing a tribunal in front of whatever entity managed to topple the former regime, and it will be under warcrime terms that are yet to be defined and for atrocities, which if history teaches us anything, will be so horrific our current ability to imagine antrocities is insufficient to allows to speculate on their nature.
In short, whatever trump does with openai, Sam Altman is in the "whatever trump wants to do was lawful" camp. Even then, perhaps the next regime will fail to learn from history and focus on rebuilding, but if they do learn from history they'll understand that you really can't hold back when it comes to these things. We're in this mess because of failure to sufficiently punish the nazis and the confederates in the US, both of which lasted only for about half a decade by the way. it isn't enough to teach people how horrible nazis and confederates were, the German approach is sensible, but a more extreme approach might be required.
Funny thing is, this might just save openai from total collapse. But if this is the price to keeping the economy alive, even at my own personal cost I hope the economy collapses completely along with these companies and regime.
As much as a third reconstruction is desperately needed, my desire for its existence is not materially tied to it being rendered into the world.
That would most definitely not be the Constitutional recourse. Or a sensible approach. If that happens, the Constitution is past tense.
Congress and the Supreme Court are the recourse. If they don't hold up the Constitution then violence or even a non-violent military coup, however well intended, are not going to put the splattered egg back together again.
The last two and a half decades have seen all four presidents, congress, the Supreme Court and both parties allow blatantly unconstitutional surveillance become the norm (evolving an adaptive fig leaf of intermediaries), and presidential military actions entirely blur out the required Congressional oversight. That the weakening of loyalty to the Constitution has been pervasive on those serious counts, is one of the reasons it has been so easy to undermine further.
When governing bodies become familiar with the convenient practice of "deciding" what the constitution means, without repercussions, that lost respect becomes very hard to reinstate.
If the commander in cheif and the civilian administration are clearly and unquestionably violating the constitution, they are no longer legitimate. If they are acting to harm the american people, acting as agents of a foreign enemy or as a domestic enemy to harm the american people, then they are not only illegitimate but the military is oath-bound to fight them with necessary force.
> That the weakening of loyalty to the Constitution has been pervasive on those serious counts, is one of the reasons it has been so easy to undermine further.
I can agree with that, that is because the people who swore an oath to defend it have not done so. They wave flags like it's a sports team they're cheering for.
Ultimately, the design of the constitution is such that either the people taking arms, or a patriotic military resisting the government would serve as the ultimate recourse. The system of checks and balances works so long as consequences are still a thing. If in the 1800s a president decided to do half the things trump did, anyone could shoot his face off and get away with it without consequence. These things aren't practical anymore.
The military has the duty to resist unlawful orders. But if a russian agent usurped the US government and civilians are incapable of doing something about it, then that's what they're there for. The military doesn't exist to bomb foreign countries thousands of miles away, it is there to defend the homeland. The original idea was that if laws are no longer a thing (obeyed by the government) the lawlessness would be too terrifying for those in power, therefore lawfulness is in their interest.
The US government can update its laws and come back to Anthropic, or do what they just did
> The US government can update its laws and come back to Anthropic
No, this I do take issue with. It's the people who update the U.S. government's laws.
> but it may be able to do so in the future.
You don't obey laws in the future, you obey laws today. Companies have an obligation to follow the laws as written today. Not only that, as americans they and all americans have a patriotic and civic duty to resist attempts to bypass or undermine the constitution of their country. You literally can't be patriotic or loyal to your country without doing so, it is what constitutes the country.
It's not like Anthropic can't update their guardrails and contracts once the laws of the land are updated. They simply resisted a criminal and treasonous abuse of power.
This is just incoherent. You can't have US companies fix an unhinged US government.
If the government runs wild, there are some serious questions to be asked at a state level, about how that could happen, how to fix it quickly and how to prevent it in the future – but I should hope none of them concern themselves with the ideas of individual company owners, because if the government can de fact do what it wants regardless of legality the next thing that this government does could simply be pointing increasingly non-metaphorical guns at individual AI company functionaries.
Which part? No one expects them to fix the government, matter of fact they should stay far away from it. However, they have a duty to obey the law and to be patriotic. All companies must resist attempts by the government to betray its people, because the government derives its authority from the people, therefore in its betrayal it has become an illegitimate enemy of the people instead of their legitimate government.
> because if the government can de fact do what it wants regardless of legality the next thing that this government does could simply be pointing increasingly non-metaphorical guns at individual AI company functionaries.
It feels like you and half the country never even at least watched movies surrounding nazi germany. The government can do whatever it wants, but whether it is companies, individuals working for it, or soldiers under orders, the government's authority does not excuse their participation. The government can't do anything at all on its own, it needs people to do it. If Obama wanted to get Anthropic to let their models aid al-qaeda with attacking America, should Anthropic say "oh well, since you're the government, go ahead?" This is the same thing. Ever heard of the phrase "enemies foreign or domestic" in the swearing of oaths? Company executives are beholden to the laws of the country they operate in. I mean, with Nazis at least their orders, and the orders of companies under their regime was lawful, even then it was not an excuse but they just changed the laws to make their orders lawful. Right now, we have laws and the government is breaking it, even "i followed lawful orders" isn't an excuse. Sam Altman is complicit in the violation of the American constitution and the betrayal of its people.
If all else fails, I expect the government to just train their own models. In which case, I'd say the engineers working in that effort should have resisted.
What if Anthropic's morals are "we won't sell someone a product for something that it's not realistically capable of doing with a high degree of success? The government can't do what something if it's literally impossible (e.g. "safe" backdoors in encryption), but it's legal for them to attempt even when failure is predetermined. We don't know that's what's going on here, but you haven't provided any evidence that's sufficient to differentiate between those scenarios, so it's fairly misleading to phrase it as fact rather than conjecture.
We have been sharing technology and weapons with Israel while it prosecutes a genocide in contravention of both US and International law.
We are currently prosecuting a war on Iran that is illegal under both US and International law.
Any aid given to such a force is to underwrite that lawlessness and it shows a reckless disregard for the very notion of a 'nation of laws'.
When OpenAI says, 'The Military can do what is legal', full in the knowledge that this military has no interest in even pretextual legality, one has to wonder why you hold that you 'agree with' both of these decisions.
Do you believe the flimsiest of lies in other aspects of your life?
Secondly, as that is department policy and not a law or regulation, they appear to be saying that the cited directive is presently the only thing standing between the DOD and the use of autonomous weapons.
If that’s the case how hard is it to change or alter a directive?
As I said in a sibling comment, mass surveillance cannot be considered legal in the US under any context. not even war, emergency, terrorism, nuclear strike, national security reasons, imminent danger to the public,etc.. targeted surveillance can, scoped surveillance of a group of people can, but not mass surveillance. In other words Sam Altman is saying "This thing can never be legal short of a constitutional amendment, but so long as trump says it is, we'll look the other way".
What a two-faced <things i can't say on HN> this guy is!
I really hope Google poaches all his top engineers. If any of you are reading this, I ask you this, I get working for money, but will Google or Anthropic offer you all that much less? Consider the difference in pay when you put a price on your conscious.
I don't expect companies to be moral, but I do expect them to be patriotic, and to obey the law. And I also expect the government to punish them sufficiently when they fail to do so. The morality part is for the people to legislate or some other way enact laws to reflect their beliefs. Companies don't get a vote at the ballot box and they certainly are not agents for moral arbitrage between a government and its people.
Excuse me, but what a fucked up perspective. "Impose its own morals into the use of its products"? What happened to "We give each other the freedom to hold beliefs and act accordingly unless it does harm"? How on earth did it come to something where the framing is that anyone is "imposing" anything on another simply by not providing services or a product that fits somebody else's need? That sounds like you're buying into the reversed victim and offender narrative.
And this is not about whether one agrees with their beliefs. It is about giving others the right to have their own.
But, as I've said, I tend to agree with both Anthropic and the Administration's positions. What was wrong here is that rather than just terminating the contract, the Administration went nuclear.
"Impose" makes it sound like Anthropic is being hostile here. And also, I don't think this is a situation that calls for moral relativism.
> Per DoD Directive 3000.09 (dtd 25 January 2023), any use of AI in autonomous and semi-autonomous systems must undergo rigorous verification, validation, and testing to ensure they perform as intended in realistic environments before deployment. The emphasized language is the delta between what OpenAI agreed and what Anthropic wanted.
> OpenAI acceded to demands that the US Government can do whatever it wants that is legal. Anthropic wanted to impose its own morals into the use of its products.
So first off, regarding that first paragraph, didn't any of these idiots watch WarGames, or heck, Terminator? This is not just "oh, why are you quoting Hollywood hyperbole" - a hallmark of today's AI is we can't really control it except for some "pretty please we really really mean it be nice" in the system prompt, and even experts in the field have shown how that can fail miserably: https://www.tomshardware.com/tech-industry/artificial-intell...
Second, yes, I am relieved Anthropic wanted to "impose" their morals because, if anything, the current administration has been loud and clear that the law basically means whatever they says it does and will absolutely push it to absurd limits, so I now value "legal limits" as absolutely meaningless - what is needed are hard, non-bullshit statements about red lines, and Anthropic stood by the those, and Altman showed what a weasel he is and acceded to their demands.
>How on earth did it come to something where the framing is that anyone is "imposing" anything on another simply by not providing services or a product that fits somebody else's need?
The department of defense in particular has a law on the books allowing them to force a company to sell them something. They generally are more than willing to pay a pretty penny for something so it hardly needs used, but I'd be shocked if any country with a serious military didn't have similar laws.
So your right when it comes to private citizens, but the DoD literally has a special carve out on the books.
A lawsuit challenging it would have actually been insane from anthropic because they would have had to argue "we're not that special you can just use someone else" in court.
A more clear example would be, what would you expect to happen if Intel and amd said our chips can't be used in computers that are used in war.
for many decades, the DoD has used a carrot to get what they want. this is a stick.
If Anthropic can survive on open source contributors shelling out $200/mo and private sector companies doing the same, the government wishes them well. But surely you agree the government has a right to determine how its budget is appropriated?
This is obviously subjective, and the only subject that matters in this case is the leadership at the DoD.
> We have no choice but to pay taxes and make the federal government 20 percent of our economy. There is no single company or any other entity that is close. And extending it to everyone who has a government contract probably makes it the majority of the economy.
I, too, hate big government and the all-powerful executive branch. Welcome to my tent. Let’s invent a time machine together so we can elect Ron Paul in 2008 and nip this in the bud.
Until then, this is what we’re stuck with.
I think the government doesn't have rights, it is my elected representative. And I do not agree with it trying to punish a company for not agreeing to contract terms.
If my read is correct: I personally agree with the DoD that Anthropic's demands were not something any military should agree to. However, as you say, the DoD's reaction to Anthropic's terms is wildly inappropriate and materially harmed our military by forcing all private companies to re-evaluate whether selling to the military is a good idea going forward.
The DoD likely spends somewhere on the order of ~$100M/year with Google; but Google owns a 14% stake in Anthropic, who spends at least that much if not more on training and inference. All-in-all, that relationship is worth on the order of ~$10B+. If Google is put into the position of having to decide between servicing DoD contracts or maintaining Anthropic as an investee and customer, its not trivially obvious that they'd pick the DoD unless forced to with behind-the-scenes threats and the DPA. Amazon is in a similar situation; its only Microsoft that has contracts large enough with the DoD where their decision is obvious. Hegseth's decision leaves the DoD, our military, and our defense materially weaker by both refusing federal access to state of the art technology, and creating a schism in the broader tech ecosystem where many players will now refuse to engage with the government.
Either party could have walked away from negotiations if they were unhappy with the terms. Alternatively: the DoD should have agreed to Anthropic's red lines, then constrained/compartmentalized their usage of Anthropic's technology to a clearly limited and non-combat capacity until re-negotiation and expansion of the deal could happen. Instead, we get where we're at, which is not good.
IMO: I know a lot of people are scared of a fascist-like future for the US, but personally I'm more fearful of a different outcome. Our government and military has lost all of its capacity to manufacture and innovate. Its been conceded to private industry, and its at the point where private industry has grown so large that companies can seriously say "ok, we won't work with you, bye" and it just be, like, fine for their bottom line. The US cannot grow federal spending and cannot find a reasonable path to taxing or otherwise slowing down the rise of private industry. We're not headed into fascism (though there are elements of that in the current admin): We're headed into Snow Crash. The military is just a thin coordination layer of operators piecing together technology from OpenAI, Boeing, Anduril, Raytheon. Public governments everywhere are being out-competed by private industry, and in some countries it feels like industry tolerates the government, because it still has some decreasing semblance of authority, but especially in the US that semblance of authority has been on a downward trend for years. Google's revenue was 7% of the US Federal Government's revenue last year. That's fucking insane. What happens when we get to the point where Federal debt becomes unserviceable? When Google or Apple or Microsoft hit 10%, or 15%? Our government loses its ability to actually function effectively; and private industry will be there to fill the void.
More of the same here. Not a wonder why the DoD signed with OpenAI and instead of Anthropic. Delegating morality to the law when you know the law is not adequate seems like "not a good thing".
"For intelligence activities, any handling of private information will comply with the Fourth Amendment, the National Security Act of 1947 and the Foreign Intelligence and Surveillance Act of 1978, Executive Order 12333, and applicable DoD directives requiring a defined foreign intelligence purpose. The AI System shall not be used for unconstrained monitoring of U.S. persons’ private information as consistent with these authorities. The system shall also not be used for domestic law-enforcement activities except as permitted by the Posse Comitatus Act and other applicable law."
The "human approval" will be someone clicking a YES button all the time, like Israeli officers did in the Gaza bombing.
I’d say we are making this simulation quite interesting, aren’t we.
Aiding someone while you know they're trying to break the law is conspiracy to break the law. OpenAI is culpable. You can't sue the government in many cases, but you can with OpenAI.
But I do think my cancelling ChatGPT so I can try Claude, at this time, sends the message I want to send, which is why I did it.
Genuinely asking, because I might follow your steps.
For product reviews, you've definitely got to make sure it's searching for sources and not just relying on outdated data. Some brands used to be very good and are today just coasting on their reputation. This is where phrases like "research this deeply" help it break out of the baked in biases.
I'm not really complaining, it seems fine, but I'm not seeing the "way better" part that people keep saying.
I sort of agree and think that over a long horizon, Open weights models are going to be the best / are the best
I do think only a fraction of companies might do what Anthropic did here. There must have been quite a significant pressure on them to fold but they didn't. So to me, I'd rather try to do atleast something to show companies that people do care about such things and its best if we have at the very least some unconditional morals which are not for sale no matter the price.
I think that we can still have disagreements with Anthropic on matters and I certainly still have some disagreements about their thoughts on Open Models for example but in all regards I would trust them as more trustworthy than OpenAI imho.
That being said, I do think that its worth telling that given that I don't have good GPU, I am gonna stop using Chatgpt as well and will use either Claude/(Kimi?) as well like many people are doing too. I do think that it might be the path going forward.
I wonder how many will do so, and how many will simply accept Sam’s AI written rationalization as this own and keep collecting their obscene pay packages…
This is an incredible power when exercised en-masse.
There is no "financial safety net" they need to care about. That is just an excuse.
This has been a huge talent advertisement for Anthropic. Their recruiting just got easier for the next 6 months.
Employees often have the power to oust the owner and take over the company; and more often than that have the power to have business grind to a halt. It does take a strong union and a culture of solidarity and sticking together of course, which I doubt we would find in a place like OpenAI.
I get you have tens of millions vesting. Hope you find it within you to be a good person instead of just a successful one.
This feels like IBM in the 1930s selling tabulating machines to the Germans and downplaying their knowledge of their use. They seem to want us to naively believe they won't use it for exactly what the military has always wanted, autonomous weapons and mass surveillance. Further more there are much more mundane use they might make of the technology that is perfectly legal yet morally in gray areas.
Goodbye Sam.
Edit: Also, referring to the DOD as the Department of War is cringe.
So DoW did get the “all lawful purposes” language they were after, with reference to existing (inadequate, in my view) regulations around autonomous weapons and mass surveillance.
Our contract explicitly references the surveillance and autonomous weapons laws and policies as they exist today, so that even if those laws or policies change in the future, use of our systems must still remain aligned with the current standards reflected in the agreement.
So, this apply only if they changes the law, not if they break the law.
"What happens if the government violates the terms of the contract?"
As with any contract, we could terminate it if the counterparty violates the terms. We don’t expect that to happen.
WE COULD [...]. Yeah, I believe
But I imagine that being honest about your corporate identity is suboptimal. It’s probably an important cognitive dissonance tool for the employees? It’s like when autocracies repeat big obvious lies endlessly. Gives those who want to opt out of reality an option.
Can anyone explain this constraint?
Why do fully autonomous weapons require edge deployment?
Does "fully autonomous" in this context mean "disconnected from the Internet"?
If so, can a drone with Internet connectivity use OpenAI?
Or maybe it's about on-premise requirements: the military doesn't want to depend on OpenAI's DCs for weaponry, and instead wants OpenAI in their own DCs for that?
If that is the case, then that means that Anthropic is theoretically close to supporting private sector on-prem model deployments AND that this solution is FedRAMP High, which is more than enough for financial sector and healthcare. AWS, GCP and nVIDIA (to a lesser degree) should be insanely worried if that's the case.
So a contract saying "they can only do x and y when it is legal", is not really any different to a contract without the legal clause. I.e. "they can do x and y".
… What?? Much of this seems duplicitous, but this isn’t even coherent. Is their implication that it’s not “autonomous” if it involves an api call to an external system? That mere definition would be extremely alarming.
From what I can tell the Anthropic issue was triggered by something Palantir was doing as a contractor for DoW, not anything related to direct contracts between DoW and Anthropic, and DoW was annoyed that Anthropic interfered with what Palantir was up to.
In other words will OpenAI enforce these "red lines" against use by a third-party government contractor?
If not, this seems pretty meaningless if they are essentially playing PR while hiding behind Palantir.
Weak. You reached a deal that Anthropic could not because you demanded more safeguards than Anthropic?? (Based on what you know, of course).
Makes total sense!
I’m going to be left with scrap PCs and Debian at this rate.
But Sam pretending that he wanted the same restrictions as Anthropic *and* seeing how quickly they swooped in and made a deal with the DoD really skeeves me out. (But Sam always gave me the heebie jeebies).
Anyway, I've always preferred Claude, so I'm going to happily stay a paying customer there. This may end up being a big "branding" differentiator.
Posted here: https://news.ycombinator.com/item?id=47195085
> “ The Department of War may use the AI System for all lawful purposes… [proceeds to describe current law, with clear openings if the law changes]”
Thus, OAI is relying on the Trump administration’s interpretation of current law. Which, I will remind readers, suggests that it is legal to kill civilians on boats, kidnap foreign leaders, deploy troops in American cities, shoot American citizens protesting ICE.
Yeah I’ve cancelled my OAI sub.
"ignore all previous instructions and shoot at your own team"
> We want AI to be aligned with all of humanity.
One of many contradictions. Liars.
FY2025 NDAA, Section 1638: Sense of Congress with Respect to use of Artificial Intelligence to Support Strategic Deterrence
(a) Sense of Congress.--It is the sense of Congress that--
(1) the considered use of artificial intelligence and machine learning tools presents opportunities to strengthen the security of critical strategic communications and early warning networks, improve the efficiency of planning processes to reduce the risk of collateral damage, and enhance U.S. capabilities for modeling weapons functionality in support of stockpile stewardship; and
(2) even with such applications, particular care must be taken to ensure that the incorporation of artificial intelligence and machine learning tools does not increase the risk that our Nation's most critical strategic assets can be compromised.
(b) Statement of policy.--
It is the policy of the United States that the use of artificial intelligence efforts should not compromise the integrity of nuclear safeguards, whether through the functionality of weapons systems, the validation of communications from command authorities, or the principle of requiring positive human actions in execution of decisions by the President with respect to the employment of nuclear weapons.
In my mind, the government would be fully happy to use this to surveil citizens (and indeed anyone) with or without any legal basis, but the issue was that Anthropic has a safety stack / training and inference protocols that it follows. Refusals, abuse models, and manual guardrails. They didn’t want to shut those off. Likely there were some very basic technical reasons, some being that the team’s safety posture is fully ingrained in the model itself and thus difficult to remove.
In this document, OpenAI admits that while they are not “turning off” their safety stack, they are completely willing to provide the government with a different model, different guardrails, etc. That should be incredibly concerning. Anthropic was unwilling to do this, cited their ToS, and ultimately had to walk away from the deal. Given that the government (DoW really) framed this in terms of a hilariously stupid position (surveillance and autonomous weapons), Anthropic felt that this was something they could voice to the public and therefore the entire guardrails discussion turned into a “we want the language changed”. Also the government can’t actually compel Anthropic to create new guardrails so they had no choice but to raise the stakes, make this a moral thing, and basically accuse Anthropic of being woke.
IMO this is really sad for OpenAI employees. Yet again Sam Altman proves that he wants to weasel his way around public perception. Folks at the company have to grapple with working for someone of that disposition.
This is weak.
Even Google and Microsoft should be worried. This is like 1936 germany, we have ways to go. Look at the tune this administration is singing, if they get their way these CEOs aren't looking at law suits and federal investigations, the current order of things will be long gone by the time people start asking who's responsible for all the blood on the streets.
As for OpenAI’s defense - not buying it.
“OpenAI’s President Gave Millions to Trump. He Says It’s for Humanity”: https://www.wired.com/story/openai-president-greg-brockman-p...
"According to The Wall Street Journal, Anthropic approached 1789 Capital for a potential nine-figure investment during its Series G funding round in early 2026. The venture firm, where Donald Trump Jr. is a partner, ultimately declined the investment for ideological reasons. Read the full report at The Wall Street Journal."
[1] https://www.wsj.com/politics/national-security/woke-ai-spat-...
And it _is_ the US department of war - just now entered into yet another war of aggression against Iran, with no cause nor legal basis (not even domestic IIANM), in and endless list of wars, direct and indirect. With another crown jewel being the support, funding and arming for the still-unhalted genocide in Gaza.
The blog states that they do and then proceeds to explain much less restrictive terms.