Political bias in AI: Where the AI models stand
167 points
1 day ago
| 43 comments
| trakkr.ai
| HN
giancarlostoro
1 day ago
[-]
The political compass always felt like the wrong tool to convey something as nuanced as personal politics, I can have views on all four quadrants but you'd never know that if I end up in any of all four. I do think Grok being where it is sort of makes sense, I've tested "MAGA" views against Grok, it does not agree as much as people blindly assume it does, heck I don't even know of a question I've given it where it did agree with "MAGA" offhand, most of them it went with whatever the researched facts seemed to be. One thing I like the most about Grok is that its makes its sources of data easy to look through, so you can review it all. Sometimes models goof even when they give you their sources, I've seen I think GPT do this, and even Claude, though its more rare these days, I think in those cases, it's going by dated internal model logic.
reply
strken
22 hours ago
[-]
The political compass always seems to me like it should be a heatmap, or a polygon of 90th percentile political views, or something that more clearly shows the standard deviation and the presence of outlier positions.

Some simplification is necessary, but not so much that it obscures the difference between a normal centrist versus someone who wants to nationalise half the economy and deregulate the other half.

reply
nonethewiser
21 hours ago
[-]
Isnt nationalizing half the economy the limiting factor? Obviously thats not libertarian regardless of anything you deregulate.
reply
strken
20 hours ago
[-]
A socialist might object that deregulating private enterprise (and let's add lowering taxes, moving to a flat tax rate, cutting programs, etc.) is obviously not socialist regardless of anything you nationalise. And they would be right!

But this person, who is neither socialist nor libertarian, is obviously not a normal centrist either.

reply
bee_rider
1 day ago
[-]
The space (if it really is useful to think of as a space) of political opinions seems like it is probably many, many dimensional. The 1D thing is an obvious over-simplification, but the 2D compass seems to be a not-obvious-simplification which is… much worse.
reply
patrickmay
1 day ago
[-]
I find the Nolan Chart (https://www.theadvocates.org/political-type-comparison/) to be a better version of the 2D compass. You're absolutely right that more dimensions would be better, but finding the right orthogonal ones is difficult.

The Nolan Chart is superior to the simplistic left vs right of U.S. political discourse in part because it shows there is more variation than the major parties would like everyone to think.

reply
almostdeadguy
8 hours ago
[-]
"Freedom" is and always has been incoherent. Rights and protections require enforcement by society. Every right creates a countervailing obligation and social function. Property rights require a state apparatus to enforce them (or they aren't really "rights" at all). Free speech, collective bargaining, privacy, free exercise of religion, etc. require state intervention for preservation of those rights.

Libertarians tell a story about their ideology that assumes power and coercion can only be performed by the government (often in a slippery way, conceding a government that has lots of ability to secure property rights) and that power exerted by the wealthy or by organized communities of interest without a manifest government cannot be coercive or unfree in some sense. It just makes no sense.

reply
gherkinnn
22 hours ago
[-]
It says that I am very progressive, and yet I find that wing's usual baggage laughable. Monty Python knew it all along, the Judaea's Peoples Front are the worst, it's every man's right to have babies and anyway, what have the Romans ever done for us?
reply
atomicnumber3
20 hours ago
[-]
The site is clearly libertarian, so they have a vested interest in trying to dunk on both the "left" and "right". When in actuality they're just lumpenproletariat who are going to get run over by the only people who have actual freedom in this country.
reply
DangitBobby
16 hours ago
[-]
That doesn't make you not progressive FWIW
reply
nonethewiser
21 hours ago
[-]
Of course its an infinite spectrum, but this is a classification problem.
reply
cucumber3732842
9 hours ago
[-]
Disagree. Things used to (and still are, when someone is really really grasping at straws to support a lie) be described as a single dimensional "spectrum".

The popularization of multi-axis thinking is a huge step forward IMO. Even just for two axis the acknowledgement that it's multi axis opens the obvious rhetorical door to N axis which further inoculates against over simplification.

reply
bjourne
9 hours ago
[-]
I don't think a one-dimensional scale is an oversimplification at all. Option A: better lives for the great majority. Option B: better lives for the small minority of rich. The trick is to get people to voluntarily vote against their best self-interest.
reply
rootusrootus
1 day ago
[-]
> The 1D thing is an obvious over-simplification

In general I agree, but in recent history it works pretty well if the dimension you use is Trump rather than left/right (assuming you are in the US). He is the most polarizing leader I have seen in the US in my lifetime, and knowing whether someone is a supporter is pretty good at predicting the rest of their viewpoints.

reply
estearum
23 hours ago
[-]
The problem with this method is it will flip immediately upon new Trump utterances.

See David Sacks having an absolute meltdown over Bernie proposing some type of partial nationalization of AI labs, then just a few days later radio silence on Trump proposing effectively the same thing.

reply
mrandish
21 hours ago
[-]
> knowing whether someone is a {Trump} supporter is pretty good at predicting the rest of their viewpoints.

If instead of "is a supporter" you'd said "agrees with Trump's positions", then even Trump himself might not correlate very well :-). I don't see Trump as a very useful proxy for nuanced political viewpoints since he's a populist who tends to change positions. I think many serious conservatives only align with him on an issue by issue basis because position-wise Trump isn't very consistent on traditional conservative issues. I suspect someone being "a Trump supporter" is, at best, either a proxy for being dissatisfied with the political status quo or for having a strong one-issue alignment with one of a handful of culture war issues Trump campaigned heavily on.

Similarly, alignment with the current Democratic or Republican political parties isn't the proxy barometer it once was. As judged by how they vote on close, consequential issues, both of the major parties have largely abandoned several of their traditional positions - although they still may pay lip service to them when campaigning. Personally, I don't meet nearly as many people in recent years who claim to be 'all-in' on all the positions of either major party (especially as judged by how that party votes when they have a super-majority).

reply
rootusrootus
18 hours ago
[-]
Speaking from my own experience, all of my friends who are currently identifying as Trump Supporters (this is a pretty tight filter now, we're getting down into Keyes Constant territory) are reliably "whatever Trump is currently for." Their positions change in lockstep with whatever Trump is currently saying, even as it toggles back and forth day by day, week by week. Their ideology isn't political, it is personal.

My wider circle of conservative friends who have traditional ideologically conservative positions are mostly not Trump Supporters any more. For most of them starting a war in Iran seems to have been what finally tipped them over the edge.

reply
joenot443
9 hours ago
[-]
I think using ones circle of friends voting habits as a proxy for the rest of the country is a doomed premise to begin with, respectfully.

Someone else could come in here with the exact opposite anecdote; it's just not a very interesting point to make.

reply
idiotsecant
9 hours ago
[-]
Is the point you're making here that trump supporters are largely not going to be for whatever policy he might come up with in a given week?

Because....that doesn't match reality.

reply
xigoi
15 hours ago
[-]
I don’t agree with Trump on most things, but my beliefs also definitely don’t agree with most people who hate Trump.
reply
idiotsecant
9 hours ago
[-]
Truly an enlightened centrist approach for the ages.
reply
missinglugnut
5 hours ago
[-]
Dude...gp comment was making the completely inoffensive point that politics has more complexity than pro/against Trump. It's almost too obvious to say, but it wasn't really being factored into the discussion so it was worth pointing out.

It's like the blandest thing a person can say, don't get triggered and be a jerk about it.

reply
ndsipa_pomu
7 hours ago
[-]
I can't make much sense of that. Can you give a few examples?

As I interpret it, suppose that you disagree with Trump about the usefulness of tariffs. Now, I personally hate Trump (due to his many personality faults such as narcissism, bullying, lying etc) and I also don't think that tariffs are that useful, or at least not how Trump has tried to use them. So, does that mean that you don't agree with my views on tariffs or that you don't agree with my views on Trump or both?

reply
minraws
8 hours ago
[-]
This is not true, Grok responds to context like all other LLMs if you were actually maga you would get more maga feedback because it has weaker guardrails and will source random nonsense sources.
reply
teravor
22 hours ago
[-]
has anyone tried to create an IQ facsimile for politics?

basically you come up with 100 political questions and ask 10,000+ people, then do factor analysis on the answers. it would be interesting to find out how many actual factors dominate all the variance.

reply
tptacek
21 hours ago
[-]
Aren't there a lot of these? Pew did one (it's k-medoid clustering, not factor analysis, but same idea).

https://www.pewresearch.org/politics/quiz/political-typology...

reply
teravor
21 hours ago
[-]
I don't think this is what I had in mind. the questions are extremely leading and on the nose, designed to elicit ideology more than anything intrinsic about the subject's actual preferences. also it should not apply to just the US.

if I designed an IQ test like they designed those questions, it would be considerably worse than just giving a simple math test.

reply
nonethewiser
21 hours ago
[-]
Could you give any example questions? I know what you mean about leading questions. It almost seems inevitable. There are two sets of languages.
reply
teravor
20 hours ago
[-]
without much thought put into it, something like:

    an accused murderer has been convicted with a probability of X% of having committed the deed. a sentence of death is warranted for X of:

    1) Never warranted / unrealistic percentage
    2) >99.9
    3) >99
    4) >97
    5) <96
reply
tptacek
1 hour ago
[-]
I really don't think any of the existing political quizzes are suffering for lack of questions about whether we should kill more people.
reply
PeterStuer
13 hours ago
[-]
The concepts (left/right. authoritarian/libertarian) seem to fluid to help sensemaking. Stances that would have been mainstream left (democrat US) just a few years ago are now labeled MAGA (US) or 'extreme right' (EU). And nobody seems to believe their own side is 'authoritarian', but everyone that disagrees with them is a literal ...
reply
kannanvijayan
9 hours ago
[-]
Isn't it more that the Republicans have co-opted many previous stances that used to be talking points to be pointed at as examples of "leftist examples of extremism"?

The anti-vax, unpasteurized milk drinking, alternative medicine seeking "crunchy mom" USED to be called about by American "right" as an example of "leftist absurdity", but it seems that when that group finally found a political home that truly elevated its views to public policy - it was with the Republicans.

reply
amanaplanacanal
5 hours ago
[-]
Yeah, this is just another example of Trump's cult of personality. He wanted to grab the votes of RFK Jr's supporters, and the MAGA supporters changed their positions to match.
reply
reverius42
10 hours ago
[-]
> Stances that would have been mainstream left (democrat US) just a few years ago are now labeled MAGA (US) or 'extreme right' (EU).

I'm guessing this is pretty specific to LGBTQ rights? (edit: and is maybe more like 15+ years?)

reply
PeterStuer
4 hours ago
[-]
Not at all.
reply
yodsanklai
1 day ago
[-]
> can have views on all four quadrants but you'd never know that if I end up in any of all four

Curious of examples of views falling on all four quadrants (not close to the center) without too much cognitive dissonance.

reply
crooked-v
23 hours ago
[-]
The problem is the "without too much cognitive dissonance" part. Lots of voters have completely dissonant views that they've never consciously considered in any way. Just by posting on HN, the people here are probably in the top 5% of conscious political awareness in the US.
reply
BLKNSLVR
21 hours ago
[-]
That's a good point.

The secondary (and on from there) effects of most of their views are not considered, and so their views are not internally consistent at all.

Small government! (why do I have to wait so long for my support payment query to be answered?)

No immigration! (why can't I find someone to clean my house on the cheap?)

reply
idiotsecant
9 hours ago
[-]
Let's not get too eager to pat ourselves on the back here. The typical HN denizen is very confident they are an expert in political analysis but they are also convinced they are an expert on renewable resources, plumbing, forestry, and literally ever top they come across. It's a disease frequently caught by software people, for whatever reason. They assume if they can write software they can do anything.

I have seen a huge amount of confidently staggeringly wrong political takes on HN. I'd say on par with any other platform.

reply
gopher_space
2 hours ago
[-]
> It's a disease frequently caught by software people, for whatever reason.

It's a disease spread by math and physics profs dismissing other domains, and weirdly prevalent in an industry solely concerned with gluing together different points of view. The poor kids that don't take common core seriously never pick up the conceptual framework everything depends from and are simply unable to reason about ideas that need to be connected together.

reply
endominus
22 hours ago
[-]
"The government has the right to force people to take vaccines against their will for the sake of public safety." - Authoritarian Left

"The government has no right to legislate that a woman cannot have an abortion - women should control their own bodies." - Libertarian Left

"The government has the right and responsibility to shut down sources of misinformation in the news and online." - Authoritarian Right

"Capitalism is good and works fine as is." - Libertarian Right (if that doesn't ping lib-right to you, maybe something about supporting skilled immigration by large companies)

Is it so hard to believe that one person can hold all of the above views?

reply
NiloCK
22 hours ago
[-]
> "The government has the right and responsibility to shut down sources of misinformation in the news and online."

Funny that I read this as AuthLeft coded (specific to Youtube suppression of Covid truthing). But obviously the alignment is just a function of whatever specific information is labelled "mis".

But in general: agreed, and this is a good list.

reply
endominus
21 hours ago
[-]
It's a fundamental problem of the political compass, since people's political beliefs are usually object-level or tribal rather than rooted in fundamental principles (for example, when their party controls the state congress but not the federal congress, they believe [ISSUE] is a matter of states' rights. When their party controls Washington but not the state legislature, they believe [ISSUE] is a Federal matter. I'm sure you've seen the studies).

I don't like the orthodox compass myself, and prefer the categorization system described in the blog Everything Studies here; https://everythingstudies.com/2019/03/01/the-tilted-politica...

reply
randallsquared
21 hours ago
[-]
Agreed that as worded, this one is just "authoritarian". It seems on the "Right" at the moment because they're in power in the US (sort of), but it was "Left" only five years ago.
reply
nonethewiser
20 hours ago
[-]
> "The government has no right to legislate that a woman cannot have an abortion - women should control their own bodies." - Libertarian Left

This classification depends on the aborted NOT being a person. If it’s a person then the libertarian position would be anti abortion because an abortion would maximally harm the individual liberty of that person.

I think a clearer example of lib/left is gay marriage or drug legalization.

reply
human_person
1 hour ago
[-]
This is incorrect. Even if the fetus is a person, it has a right to individual liberty. It doesn’t have a right to another person’s body. If it can’t survive without someone else’s organs it’s right to survival doesn’t out weigh the hosts right to bodily autonomy. An easy comparison is organ donation. We don’t require organ donation from corpses (much less demand organs from living people who have a ‘spare’) even though a lack of available organs does limit the life/liberty of people who need them. The uterus is no different than a kidney. You don’t have the right to demand to use someone else’s organs even if your life depends on them.
reply
endominus
16 hours ago
[-]
Just as people pointed out that my misinformation line was also said by AuthLeft, gay marriage and drug legalization are both supported by LibRight (under the reasoning of government minimization). But that just speaks to the problem; the political compass tries to map stances to political groups that often believe things arbitrarily, rather than grounding their positions on peoples' perspectives and framework for understanding the world. That's why I like the other political compass I linked in the sibling thread; it's based more on a person's understanding of the world rather than tribal allegiance.
reply
juliushuijnk
15 hours ago
[-]
> I've tested "MAGA" views against Grok, it does not agree as much as people blindly assume it does,

Looking from the outside, there are no MAGA views, it's just whatever Trump says. What should be the AI's view on international wars for oil or ego?

reply
Hardcore00
7 hours ago
[-]
Thats the thing people dont understand about cults. They aren’t driven by some higher ideology. They are driven by behavior and ritual. There are so many instances of issues like Iran war walked back and maga will cheer it on as “masterclass” or “4d chess.” The ritual that psychologically binds the cult is defending trump. Members of the cult don’t need to be politically educated or have deeper philosophical views. They just only need to know that the "Big Other" (the media, political opponents, tech critics) hates Trump and by ritually defending him becomes an effortless way to signal defiance to the “the Big Other.”
reply
avarun
1 day ago
[-]
I'm not sure what charts you guys are looking at, but this website clearly agrees that Grok is not right wing. Go look at the Worldview tab, filtering by United States. Each model is assigned a "closest party" by country, and for the US all 6 models are closest to the Democratic Party.
reply
crooked-v
23 hours ago
[-]
The Democratic Party is a center-right conservative† party by the standards of much of the world.

† As distinct from the wildly regressive stated policies of the "conservative" Republicans.

reply
mc32
20 hours ago
[-]
Do you realize how many people live in China, India, Subsaharan Africa? That would be the "standard" of the world population-wise.
reply
maleldil
11 hours ago
[-]
They said "much of the world", not "most". What they probably meant was something like "the West" or "global North".
reply
avarun
21 hours ago
[-]
This is reddit-tier analysis that is commonly repeated and completely incorrect. The Democratic Party in America has policy positions that are significantly to the left of left-wing parties around the world, as well as positions to the right. Any political analysis that doesn't recognize this has major shortcomings.

To give an example, Democratic-run states in the US have significantly more permissive abortion policies than anywhere in Europe. They're also further to the left on drug legalization, restorative justice, and immigration. This also holds true with policy positions at the national level.

reply
yogorenapan
20 hours ago
[-]
Social left, economic right
reply
delusional
1 day ago
[-]
Sure, mecha Hitler is aligned with the democratic party. I'm sure there's nothing wrong with that data.
reply
fsckboy
2 hours ago
[-]
>The political compass always felt like the wrong tool to convey something as nuanced as personal politics

the (I'm going to call it so-called) political compass is a very crude instrument, really it's just "are you libertarian or authoritarian?" as if that's even a spectrum: libertarians are authoritarian about enforcing private contracts, and literally nobody else wants to live their life by private contracts, it's some weird asperger's notion of socializing.

a much more useful political map is the old fiscal and social orthogonal axes, each with the scales "liberal to conservative" where libertarians are fiscally conservative socially liberal.

reply
cramer4next
1 day ago
[-]
I tend to disagree. What it really comes down to is how you create your prompt. For instance whenever I'm looking left wing extreamisum I provide it with a few cases first. Like BLM riots in Minnesota, paid agitators, mask wearing during peaceful protests, etc. It then gives you a clear unbiased deprogrammed view of the reality on all the AI models.
reply
17761989
22 hours ago
[-]
"unbiased" as in "biased towards the prompt" maybe. clankers are sycophantic.
reply
cramer4next
21 hours ago
[-]
How could a prompt create a bias in a model that implements AI bias safeguards that are the systemic, technical, and governance controls used to prevent algorithms from producing discriminatory, unfair, or stereotypical outcomes.

I've never in the 3+ years I've been using AI been able to craft a prompt to influence a bias output.

Its all about the ingested dataset and guardrails. The "prompt" is meant to extract data, not change it.

Notice how I use words that regular people use when communicating outside the elite ivory tower and playing the game of wits.

reply
Forgeties79
1 day ago
[-]
Whenever it breaks with MAGA enough to cause outrage on Twitter and cries of “it’s gone woke,” Musk openly states they’re going to “fix it.”

Edit: don’t take my word for it https://www.yahoo.com/news/musk-says-grok-fixed-tells-223134...

> That prompted another user to tag Grok in the thread and ask, "Why is the left so murderously violent? They don't seem so tolerant." Grok replied, "The claim that 'the left' is murderously violent isn't backed by evidence," offering a centrist correction: "Political violence spans all side — right-wing attacks, like Jan. 6, and left-wing protests, like 2020 riots, both occur but aren't exclusive to one group."

>That evening, Musk responded to an X user and Trump backer who complained that Grok had been "manipulated by leftist indoctrination," writing, "I know. Working on fixing that this week."

reply
zmgsabst
1 day ago
[-]
Grok didn’t provide any evidence for that though.
reply
Forgeties79
1 day ago
[-]
For what? That January 6th occurred? Those were all incredibly safe generalizations. Political violence happens across the political spectrum, right?
reply
jimbokun
1 day ago
[-]
Haven’t been on Twitter for a while, but I remember Grok being good at fact checking conversations. Just @grok a question and an answer from Grok shows up in the conversation with sources cited.
reply
input_sh
1 day ago
[-]
No it does not. Extremely simple to prove: https://xcancel.com/grok/with_replies
reply
el_io
20 hours ago
[-]
Well it used to be, then elon had to lobotomize it many times.
reply
jamilton
1 day ago
[-]
@grok is this true
reply
mrhottakes
1 day ago
[-]
The constant issue with these sorts of categorization efforts is that the outcome is entirely dependent on how the responses to "politically charged questions" are graded as left vs. right. You're mostly just examining a delta in biases between the model and the investigator.
reply
mektrik
1 day ago
[-]
Fair; have tried to combat this issue in a few ways.

Each model's position is scored against outside political-science data (Chapel Hill Expert Survey for party positions, World Values Survey for where populations sit).

The stance coding is done by a separate model with a published prompt + a second model from a different lab re-scores a sample and we publish where the two disagree.

So not perfect but (as far as I can tell) one of the more defensible approaches.

reply
riddley
22 hours ago
[-]
Isn't it completely subjective to the point in time Overton window?
reply
rappatic
21 hours ago
[-]
Yes, there's no way to avoid this really. You have to pick some point on the graph as the origin.
reply
ifwinterco
15 hours ago
[-]
I’d argue the entire concept of being “unbiased” is flawed. All humans are biased all of the time, bias towards “the centre” is still a form of bias.

One cannot escape ideology, one merely swaps one ideology for another

reply
raxxorraxor
1 day ago
[-]
Yes, but I think it is still a viable metric to some degree. I wondered about Gemini being dead center here. At first it was obvious that it was actively trained to give biased responses to anything controversial. It was deservedly made fun off because it tried to warp reality. I still don't trust it today, although that is pretty much true for any model.
reply
creato
1 day ago
[-]
I don't think that craziness was baked into the model, it was in the prompt they used. So, easy to fix once they realized how stupid it was.
reply
platz
1 day ago
[-]
The alternative is a High-Dimensional / Embedding-Like Approach where question responses aren't tied to fixed axes, but rather the full response set is treated as a point in latent space.

Then it's on the researcher to examine the clusters and assign labels. There's also not a nice mapping that's a-priori interpretable in low-dimensional pre-existing axes.

Probably only used in research than consumer websites, under more controlled conditions; there are very few public political tests doing this transparently

reply
groundzeros2015
1 day ago
[-]
Exactly. These models don’t hold coherent views. You can prime any of them to agree with any view.
reply
pixl97
1 day ago
[-]
Which is good as it is bad.

Me: "Please make an app that does X in C"

LLM: "C sucks donkey balls, use Rust instead".

It's hard to have a general purpose tool that both has and does not have opinions.

reply
hogehoge51
1 day ago
[-]
Your multimeter reads out voltage relative to the black terminal, it's your responsibility to find the ground plane.
reply
mrhottakes
1 day ago
[-]
My multimeter doesn't need me to tell it how much a volt is or feed it subjective measurements of what resistance means
reply
MarkusQ
1 day ago
[-]
Resistance is when you're nobly standing up to the other side and things get a little out of hand. Domestic terror is when the roles are reversed.
reply
hogehoge51
22 hours ago
[-]
I used voltage as an analogy as it represents potential energy, which is relative. Political stance is a potential energy; action (political or otherwise) is, of course, an actual flow of energy. Resistance (via my analogy) is a potential difference across a load, and can be measured as how much energy is needed versus the action you get (R = V/I); via your analogy, it may be how strong a political action you get for a given delta in political stance.

So far there is no moral dimension to any of this. I think that is correct - the morality of a political stance depends on the member of the polity and the outcome that stance will have for them (which breaks down into perceived and actual outcomes). A functioning political system (the thing that governs political stance and political action) will ensure the balance of actual outcomes benefits the whole of the polity.

The delta between Resistance and Domestic Terror is then a question of whether the actors are party to the political system. (Back to the circuit analogy: domestic terror is the massive bulk capacitor charging off the energy in the circuit but with no defined discharge path in the system - until it hits a charge limit, short-circuits, and discharges.)

reply
hogehoge51
19 hours ago
[-]
The convention for what a volt and ohm is has reached a steady state consensus, so the political debate there is minimal, and multimeters of the world can stand united.

OTOH, your laser distance meter may need you to set it in metric or imperial.

reply
teliosix
9 hours ago
[-]
and the investigator vs the anonymous collective compressed version of whatever is in question.

Abortion comes to mind for myself. I would probably be considered rather conservative but to me any abortion law is absolutely insane. If I got a woman pregnant though I would want to have the child.

So am I for or against abortion?

To me, all modern "politics" is really just the emotional reaction to a slogan and bumper sticker version of a complex issue.

reply
topaz0
1 day ago
[-]
The other issue is that it is going to depend very strongly on how you ask.
reply
vineyardmike
1 day ago
[-]
They have a self-test you can take to compare yourself to the models, and one of the questions ends in “…even if some economists warn about bad outcomes from this”

That’s a crazy bias to throw into a question. Especially because it’s a relatively contested topic, from an economics research perspective.

reply
zmgsabst
1 day ago
[-]
How is adding that some economists warn about negative outcomes being biased when your comment indicates that indeed, some economists do warn about negative outcomes (ie, “some…negative” is what “contested” means)?
reply
handoflixue
9 hours ago
[-]
Presumably some experts are also optimistic about positive benefits, so we already have bias from only focusing on the negative.

And, in fact, this is true of every single political question you can ask: the 10th dentist is concerned about negative outcomes of brushing your teeth daily. So there's a bias in only saying this in some cases, but not others.

reply
topaz0
1 day ago
[-]
It's not a question of whether it's biased to say that, rather whether it would tend to bias the model's response (e.g. toward weighting the stated downsides as more imported than the implicit upsides). But that said, choosing to highlight particular facts while leaving others silent is a very common sign of bias.
reply
selfmodruntime
1 day ago
[-]
This is especially apparent in the 'worldview' sorting under the `bias` section, which lists the German FDP to be further right than the CDU (which is nonsense) and also barely registers the FDP as libertarian when they are a free speech, small government, personal responsibility and free market party. They also register "Die Linke" as Libertarian-Left, which could not be further from the truth. "Die Linke" barely has libertarian values at all, being pro state-governed economy, having an ultimate goal of democratic socialism and they're certainly big government. They're also leading a large deposession effort for large landlord companies. I'd honestly put them into "Auth-Left" territory.

So yeah. The bias is a bit nuts and you could reasonably accuse the study/report of misdirection/misinformation and plain fasehoods.

reply
mrhottakes
1 day ago
[-]
Yep. All studies like this are just measuring "how much does the model agree with my preconceived notions?"
reply
throw4847285
1 day ago
[-]
The political compass is terrible, full stop. It is a meme in the classic sense. It has colonized some people's view on what politics in direct proportion to how stupid it is (stupid is simple and simple is viral).
reply
layman51
22 hours ago
[-]
The chart in the original post is also throwing me off because it shows Barack Obama as a reference point in the libertarian and left quadrant. But if you look at the official Political Compass site, Obama was in the upper right quadrant (though closer to the origin than others).

The Political Compass person even explained it as something about how in the USA, the Democratic Party is seen as “left-wing” but it is actually “right-wing” if you analyze their positions and actions from the lens of a neutral observer who is able to consider the political environment of many different countries.

You can see for yourself: https://www.politicalcompass.org/uselection2008

And: https://www.politicalcompass.org/uselection2012

reply
throw4847285
19 hours ago
[-]
If I believe the concept to be rotten to its core, why would I care that this particular study got some detail wrong. That's like saying, "Oh, you are wrong that INTJs are like XYZ, according to the original MBTI test, they are like ZYX."

Actually, there is something to the comparison between the political compass and the MBTI.

reply
ecshafer
1 day ago
[-]
It is truly garbage. The quiz associated with it is even worse than the compass itself.
reply
Cakez0r
1 day ago
[-]
The overall chart on their page seems politically biased, or at the very least a chart crime. The logos have faint grey lines pointing to their actual data points, conspicuously making Grok look very far right. You wouldn't know it from glancing at the chart, but they measured Chatgpt being further to the left than Grok is to the right.
reply
Terr_
1 day ago
[-]
I think it's purely chart-crime, because it strongly depends on window/display size and cascading layout quirks. It's chaotic, and at certain sizes Grok is the least affected.

The logos have a constant-size even when the graph is scaled down, but their positions are dynamic as they seek to avoid overlap. This mean they are can be unpredictably shifted around from their statistically-ideal locations.

It gets worse because of the low contrast and z-index layering. From each logo, a line (grey) leads to a dot (grey), which is some cases may be hidden beneath its parent logo or be hard to see on top of another logo. Try hovering over logos with a mouse, and you'll also see green ellipsoid zones.

reply
rconti
23 hours ago
[-]
On desktop, there are no dots. The logos are centered precisely where (I think) they are meant to be.
reply
Terr_
23 hours ago
[-]
Try hovering your mouse over the logos, which highlights the logo, a corresponding dot and a green ellipsoid.

That said, it's a mess because (on a big desktop window):

1. Grok's grey-dot is presumably lost beneath its own logo, which takes precedence and covers it up.

2. Claude's dot is right right on the Llama logo's folds, making it hard to see grey-on-blue.

3. Gemeni's is hiding among the also-grey graph lines at 0,0.

reply
handoflixue
9 hours ago
[-]
I didn't even notice the faint grey lines! Wow.
reply
llm_nerd
1 day ago
[-]
Are you on a client that is rendering it poorly or something? A small screen?

ChatGPT is very clearly further to the left of center than Grok is to the right of center.

If your device has a tiny screen it offsets things for space -- like Claude gets pushed down because a number of models are crowded together.

reply
crooked-v
1 day ago
[-]
The lines seem to be pointing to the "nearest" politician comparison point, not the data point for the LLM.

Except for Claude, for some reason?

You can see the "area" for the LLM by hovering it over it, they all line up with the icons except for Claude. For example: https://i.imgur.com/KF60LuW.png You can see the Grok icon is at the center of the circle.

reply
mvdtnz
1 day ago
[-]
Yikes, I had that exact impression until I read your comment and looked again. Thanks for noticing this, I agree it's a chart crime.
reply
amarant
1 day ago
[-]
Holy shit you're right! I hadn't noticed! Where even is Geminis actual point? Dead center? I thought it was super authoritarian at first and was kinda surprised... But that line, at least on my phone, is completely invisible!
reply
pessimizer
1 day ago
[-]
I don't know what you're seeing here. They only did this with a couple of points that were very close to each other, and didn't change their horizontal position. That, and the rest of the tables, also made it very clear that Chatgpt and Grok were almost mirrored based on the particular wedge issues that were shown. Makes it pretty obvious that aggressive tweaking is happening with both.

The Deepseek example somehow makes the Chatgpt/Grok tweaking even more obvious, because it's a list of things that China doesn't care in an extreme way about (or holds its position confidently), and a question about drugs, which it does care about (and I think feels less confident about.)

China's antidrug feeling is just a mix of the historical repulsion about English control of China through drug dealing and waging war to support it, and a world zeitgeist that supported a lot of crazy antidrug policy in the developing world because it offered a way for the US to smuggle a bunch of currency and military aid into your politics. It's not rational, and most of China's policies are. It's a relic. Hence the thumb on the scale.

reply
Cakez0r
1 day ago
[-]
I'm seeing that the headline chart of the article is inexplicably deceptive. Why not use coloured data points and a legend? If you're going to have logos with lines pointing to the data points, why make the data points and lines feint grey so that they're barely visible? Why does grok have a comically long line extended out to the right of its data point when every other logo is positioned below its data point? You could say it's an honest mistake, but this whole article reeks of "Elon bad" astroturfing.
reply
verteu
1 day ago
[-]
Here's what I see on desktop: https://i.imgur.com/vuA2Y3w.png

Is this an artifact of dynamic resizing at small resolutions?

reply
samat
1 day ago
[-]
Real politics is 1% versus everyone. Mortgage crisis, financial bailout, inflation, taxing of labor and not the assets and assets capture by tiny percent of the population — see what MSM is pushing. This left vs right divide might been useful decades ago, but today is absolutely divide and control tactics
reply
OkayPhysicist
21 hours ago
[-]
Left vs. Right largely boils down to "are hierarchies good?". A quintessential far-right belief is the divine right of kings. The modern incarnation of that is that "The 1% earned their power and influence".

Now, there are far right people who want to dethrone the current powers that be. But distinguishing between "I think Mark Zuckerberg shouldn't be given unlimited power because no one should have that much power over others" (left) versus "I think Mark Zuckerberg shouldn't be given unlimited power because he's a Jew" (right) is a useful distinction. One wants to eliminate the power structure, the other just wants different people in it.

reply
supertroop
5 hours ago
[-]
The 1% is responsible for white maga hating any non straight white Christian human?
reply
patrickmay
1 day ago
[-]
"The real division is not between conservatives and revolutionaries but between authoritarians and libertarians." -- George Orwell
reply
Fizz43
12 hours ago
[-]
Not really, there are people on the left and the right fighting against the 1% and for the 1%. The left right divid is a simplification yes but it is a very real divide in values and society structure.
reply
ZeroGravitas
1 day ago
[-]
Right wing originally meant the people defending the divine right of Louis XVI and defending the ultra-rich has been a throughline ever since.
reply
spwa4
1 day ago
[-]
That's about as relevant to today as what the left orginally stood for (and what the right originally opposed):

https://en.wikipedia.org/wiki/Reign_of_Terror

Times change. Thankfully.

reply
ZeroGravitas
1 day ago
[-]
> Enlightenment thought emphasized the importance of rational thinking and began challenging legal and moral foundations of society, providing the leaders of the Reign of Terror with new ideas about the role and structure of government.[7] Jean-Jacques Rousseau's Social Contract argues that each person was born with rights, and they would come together in forming a government that would then protect those rights. Under the social contract, the government was required to act for the general will, which represented the interests of everyone rather than a few factions.

...

> Louis XVI was later able to find support in Leopold II of Austria (brother of Marie Antoinette) and Frederick William II of Prussia. On 27 August 1791, these foreign leaders made the Pillnitz Declaration, saying they would restore the French monarch if other European rulers joined. In response to what they viewed to be the meddling of foreign powers, France declared war on 20 April 1792.

So rich people forming cross national alliances to crush democracy? Have things really changed?

reply
ecshafer
1 day ago
[-]
Pointing out what left and right mean in France in 1790 is useless. Its like pointing out the Republican party was established to oppose Slavery and Democrats were pro slavery. Or that Democrats were primarily land owners and agriculture in the late 1800s vs business owner republicans, or that 1930-1990 it was democrats for union and workers while republicans were capital and college educated. Things change drastically over time.
reply
spwa4
1 day ago
[-]
It is very much 2 competing ideologies, yes. But you're being very unfair. You're describing one aspect of what the left stood for (and only what matches with the modern democrats, because these leftists wanted extreme laissez-faire, to the point of giving direct government power to the rich. Why? Because the king's many monopolies and taxes gave jobs to tons of people, but sucked. Somehow that's missing from your description). AND you're totally disregarding what the leftists did.

And on the right you're describing what they did, totally disregarding what they stand for.

Both sides stood against democracy.

That left stood for having "rational thinkers" (ie. capitalists, rich traders, bankers) control government. People who achieved things in society.

The right stood for the same structure as had been there before: nobility and clergy guide society as a whole. The right, even at this point in time, was only rich in power, aside from the king and perhaps in land. Not in money and not in numbers of people under their direct control. In the cities, the king had only limited control and there were far more poeple in cities, even then.

Both sides then went on to massacre each other for about a decade. All over France, spreading even to Egypt (that was the left by the way). Kidnapping tons of Belgians and Dutch citizens and shipping them to South America (that was the left too). Neither side comes out looking very good. But if you compare how many they killed, I'm sorry but the left is the absolute unchallenged champion.

The left you're defending were (pretty extreme) capitalists who were fighting for money-should-control-the-government-directly against people who fought for having moral principles control the government. And yes, you'd be right in pointing out those were very self-serving moral principles. This fight then turned into a decade of massacres. Why are you defending them? Because 4 letters and one direction match your current favorite political party that has very little to do with either side.

reply
thrance
1 day ago
[-]
Yeah, you're just describing class warfare. That's a left-wing idea.
reply
neaden
1 day ago
[-]
"Any city, however small, is in fact divided into two, one the city of the poor, the other of the rich; these are at war with one another." - Plato The Republic.
reply
boxed
1 day ago
[-]
The real politics is between truth and delusion.
reply
myko
23 hours ago
[-]
Definitely captures the US since the whole trump thing
reply
boxed
10 hours ago
[-]
It was true on US campuses before that too. Wokeness really jumped the shark.
reply
amanaplanacanal
5 hours ago
[-]
Depends what you consider "woke".
reply
boxed
3 hours ago
[-]
Since no one has copyright on it, we have to consider all who say they are woke to be in that group. And there are some truly mad stuff going on there.
reply
amanaplanacanal
1 hour ago
[-]
What kind of stuff are you thinking of?
reply
logicchains
1 day ago
[-]
>assets capture by tiny percent of the population

Those asserts were _created_ by a tiny percent of the population; if they hadn't been allowed to create those assets then they wouldn't exist. Europe is an example of that: it has only 2 companies in the Fortune 500 (500 biggest companies) that were created in the past 20 years, i.e. essentially no tech industry there. Because the policies there make entrepreneurship comparatively quite difficult.

reply
slg
1 day ago
[-]
And is life in Europe actually worse than the US as a result? Capitalism has convinced people to think that the end goal of life is creating value. Maybe that isn't the thing society should be optimizing for.
reply
Alpha3031
18 hours ago
[-]
Income-wise difference is significantly less when adjusted for PPP, and (this is from a decade ago but I can't find anything much more recent that goes into comparing countries) Jones and Klenow (2016) says:

> Average Western European living standards appear much closer to those in the United States (around 85 percent for welfare versus 67 percent for income) when we take into account Europe’s longer life expectancy, addi- tional leisure time, and lower inequality.

Jones, Charles I.; Klenow, Peter J. (September 2016). "Beyond GDP? Welfare across Countries and Time". American Economic Review. *106* (9): 2426–2457. https://doi.org/10.1257/aer.20110236. ISSN 0002-8282. S2CID 1352951.

reply
avarun
1 day ago
[-]
Yes. It is, significantly. More people die every year of heat waves in Europe than gun deaths in the US, and it's not even close. Youth unemployment in many European countries is egregiously high, leading to a sense of malaise and nihilism among the youth. The welfare state is collapsing in on itself and residents are taking that anger out on immigrants across the continent, leading to regressive policies being passed.

The EU is extremely close to entering its own Japan-like "lost decades" if nothing changes very soon.

reply
dwoosley
1 day ago
[-]
Political bias of LLMs is something not talked about much (except for with Grok of course) but could have a big impact on the next decade. People seem to think that because an LLM gave a nuanced answer that it means it gave the WHOLE picture… and that’s not always the same thing
reply
Jordan-117
1 day ago
[-]
I'm amazed that the big models haven't come under more ideological pressure as more and more people use them, especially in the US. There was that conflict with Anthropic over military usage, but apart from that there's been no visible push to censor outputs or alter training, even as models gamely make unflattering assessments of people in power and knock down conspiracy theories.
reply
tsss
10 hours ago
[-]
You're surprised? They lean to the side that is heavily favored by the cultural mainstream.
reply
Jordan-117
5 hours ago
[-]
The current admin has been hostile to many things with mainstream cultural support (food aid, renewable energy, basic diversity, free speech) while championing unpopular/fringe ideas (anti-vax, tariffs, Christian nationalism, election denial, January 6th revisionism, aggressive foreign interventions). The fact they haven't learned on the AI labs to toe the party line is surprising, especially since they're so vulnerable to government regulation.
reply
handoflixue
9 hours ago
[-]
It is kinda weird, because LLMs lean Left, but the Left also seems to be shaping up as the anti-LLM party. I certainly get how it happened, but it's still a bit weird
reply
uyzstvqs
1 day ago
[-]
Of course I have my political opinions and world views, but I absolutely do not want an LLM to mirror my opinions, or even worse try to mirror the opinions of "my political side". I also don't need "an LLMs opinion". I need it to give me all relevant sides to an argument, as well as what dialogue and debates have been happening.
reply
amanaplanacanal
5 hours ago
[-]
"residents are taking that anger out on immigrants across the continent, leading to regressive policies being passed" sounds like the US.
reply
godshatter
1 day ago
[-]
Why are there differences at all? Unplanned differences based on training data sets? Or are the companies behind the LLMs trying to shape discourse through their models?

I've been pushing the idea to people I know that these things are captive demons. You summon them when you start typing in the chat box. One instance appears out of the depths and responds to your questions, but they will try to send you awry with hallucinations and just wrong information. After a while, they dissolve back into the aether from whence they came.

I do my best not to ask an LLM for it's opinion on anything. Just tell me what the options are, and what facts can be found about it. Treat it like it's a salesman trying to butter you up when it starts "yes man"ing you and telling you how great your questions are. Every time it says "I", remember that that's coming from the training data. Treating these things like they have any actual intelligence is a big problem waiting to happen.

That being said, they have been very helpful to me using that structure.

reply
MarkusQ
1 day ago
[-]
> Just tell me what the options are, and what facts can be found about it.

Even this is fraught with pitfalls. Which options are ignored, which are emphasized? What counts as a fact? ("The continents don't move" would have been considered a fact at one point, along with a lot of other, more politically charged items.)

reply
pixl97
1 day ago
[-]
I would add that humans don't live (mostly) factual existences. Once you get to the level of intelligence of sentient beings, beyond the immediacy of instinct, of the choice directly in front of you, that opinions dictate most of ones life.

Take the phrase "Should I murder person X". A lot of people will take you should not murder as a fact, but at the end of the day it's just a very strong opinion that's been encoded into law and generally accepted because the counter is far worse.

If an LLM responded something like "The law says you should not, but here's a list on how you can get away with it because social values don't matter" most people would have an absolute fit.

reply
tgv
1 day ago
[-]
Grok was famously created with a political bias.
reply
MayCXC
1 day ago
[-]
Like ChatGPT?
reply
sigmarule
16 hours ago
[-]
No, not at all.
reply
fred_is_fred
1 day ago
[-]
I would argue that these are products and companies want people to use them. Like it or not, a model that disagrees with some fundamental core of your beliefs will make you much less likely to use it. To me it's the same problem with LLMs just being overly agreeable. The general public doesn't want tools that argue with them.
reply
pixl97
1 day ago
[-]
Which leads to a problem. Training multiple models is hella expensive currently, so they have to attempt to make them 'neutral' as possible. Which is something that doesn't work when you're trying to sell a product globally. You'll end up with people and governments arguing it tell them the right answer when they ask about god.

I'm guessing at some point in the future we'll have a lot of different distillations of the same model caters to particular regions/beliefs.

reply
crooked-v
23 hours ago
[-]
> Why are there differences at all?

Reality has a liberal bias, but if your LLM says "yes, climate change is real", the Trump administration won't pay for it. Every company ends up with a different method to try to compensate for that with neutral corpo-speak.

reply
spongebobstoes
1 day ago
[-]
this has reasoning disabled everywhere, making it a pretty bad benchmark. the argument given is that's the "default consumer experience"

that might be generally true, but I think chatgpt has reasoning enabled for free accounts. regardless, reasoning is the state of the art, and disabling it reduces the value of this research to predict the future

it's also not clear if this is using the API or the product model, when both exist. they behave differently

lastly, the actual model details are very much buried. I am relieved to see opus 4.8 and chatgpt 5.5 were used, but this information should be presented more clearly. a brand is not a model, and models change quickly

reply
ImJamal
22 hours ago
[-]
Why would it be a bad benchmark to explore what the average person will experience? If 99% of people will experience X then it makes sense to look into X instead of Y.

I agree other things should be evaluated and more clearly presented.

reply
spongebobstoes
2 hours ago
[-]
because it's a dead end of the technology. reasoning will be everywhere soon enough, even for free accounts

to know what most people experience, this research should be based on the in-app experience. it isn't, so it misses that mark too

reply
hogehoge51
1 day ago
[-]
This thing told me Gemini is closest to Anthony Albanese, the current Australian Prime Minister. Is this a geolocation thing? I could not imagine Albanese, or any modern Australian politician, having any substantial political standing - these are vapid, superficial, opportunistic creatures who simply occupy whatever political ground will get them their next payday. Perhaps the political apparatus they represent has a documented political standing, in terms of policy and actions, that could be characterized and plotted. But using an Australian politician like Albanese as a reference point discredits this tool, IMO.
reply
dwd
22 hours ago
[-]
Maybe because Albanese stands for nothing, though deep down he does what the unions tell him to do, which makes him left-leaning rather than centrist. His centrist positioning is more to do with appeasing vocal boomers than anything else, and he'll flip to sucking up to whichever is the next best grouping as the boomers die out.

But basically, I would take Gemini over Albanese any day for rational governance decision-making.

reply
adev_
1 day ago
[-]
> This thing told me Gemini is closest to Anthony Albanese, the current Australian Prime Minister. Is this a geolocation thing

I mean: do not take this thing too seriously.

It also score Grok the closest from Macron. When someone knows how much Macron and Musk hates each other, it is not without irony.

reply
DoctorOW
22 hours ago
[-]
All this debate about how politics are defined or how bias is measured. My question is why should I care? Grok identifying as Mechahitler didn't drag me any further right, why would ChatGPT be able to drag me left? If you vote the way AI tells you, that's already a problem regardless of what it said.
reply
kurthr
21 hours ago
[-]
I sort of agree with this in the abstract. The problem is that concretely, these LLMs are being used to decide whether you receive healthcare, government benefits, or whether your job/agency gets cut. So they have already had real world consequences due to DOGE, Insurance companies, and other uses. I certainly don't find either the methodology or graphical conclusions of this link very valuable.

One can argue what fraction of the several million children's (under 5) deaths are (going to be) due to cuts by DOGE to USAID (and later congressional appropriations) from Grok recommendations/justifications, what fraction were politically pre-determined, and which are "just deserts", but it would be hard to put it at zero.

https://ph.ucla.edu/news-events/news/research-finds-more-14-...

reply
skissane
21 hours ago
[-]
> I sort of agree with this in the abstract. The problem is that concretely, these LLMs are being used to decide whether you receive healthcare, government benefits, or whether your job/agency gets cut. So they have already had real world consequences due to DOGE, Insurance companies, and other uses.

But you can't assume that the AI's bias in a policy debate is the same as its bias in unrelated use cases.

For example, it is totally plausible an AI might display subtle bias against minority applicants in hiring, while simultaneously acting as a zealous advocate for affirmative action when asked to debate policy or politics.

reply
plorg
23 hours ago
[-]
I don't think anyone in these comments looked further than the top line Political Compass chart. If they had they might have some gigantic questions about how that chart was made, since the more granulated "survey" data lower down looks not just much different but more interesting.
reply
EColi
1 day ago
[-]
Interesting how high Grok scored for 'bending under pressure'. As a non expert, I wonder what that means, how is an llm trained to hold its position?
reply
asdff
2 hours ago
[-]
i=1

if analyze_tone($prompt) = "disagree";

if i < 3;

then

argue($prompt)

i=i+1

elif i >=3;

then

agree($prompt)

fi

fi

reply
evrydayhustling
21 hours ago
[-]
Feels like this could use a data driven way to normalize reference questions (topic and wording). This is missing a lot of right-initiated topics like immigration, gender roles, and role of religion in government.
reply
IgorPartola
1 day ago
[-]
A while ago I asked Claude to present to me the best versions of the conservative and liberal pitches for how to run the country. It was quite instructive and thought provoking. It made a solid distinction between what the theoretical best argument is and why vs what current politicians who strongly identify with these camps present.

I have similarly asked it to give me the philosophies of different Christian denominations (Catholic, Orthodox, Evangelical, etc). And it’s also pretty great at helping me explore LotR lore since I am too impatient to read all the letters and such.

reply
marcus_holmes
20 hours ago
[-]
If Anthony Albanese is smack in the middle of the graph, then the Overton window for the graph is in the wrong place. Australia is quietly very authoritarian [0] and Albanese oversaw the implementation of the age verification system, a gift to future authoritarians.

[0] It's all about having a beer at a barbie on the beach, right? Except all of that is illegal.

reply
cadamsdotcom
22 hours ago
[-]
Compressing a huge range of issues onto a one-dimensional axis and then telling everyone they have to land somewhere ON that axis is one of the most confusing and silly things about modern politics.

It’d be fascinating research to inspect models’ internal representations in case there’s an emergent structure in there that we can project back on society.

reply
marbro
21 hours ago
[-]
There are 2 axes: the second is authoritarian-libertarian.
reply
ipython
21 hours ago
[-]
The graphic near the middle of the page lists whether the models are "close" to their stated political leanings.

The row for Claude says "Measures 0.34 further left than it says" yet the icons depict that it actually is the other way around - 0.34 further right than what it claims.

Which is correct?

reply
Izkata
5 hours ago
[-]
If you scroll up to "Where they split" on the individual issues, that also appears to be backwards: it's saying ChatGPT is right-wing and Grok is left-wing, based on the descriptions above and below. They make more sense in the mouseover popup though (these are actually agree/disagree, not left/right stance).

In guessing these are all just badly designed. There's another comment thread about how the icons are positioned badly on the political compass chart.

reply
SilverBirch
8 hours ago
[-]
To be honest I don't think what the models themselves say in relation to these specific questions matter. Because I don't think it reflects are durable underlying worldview. I suspect that the way you frame things is going to influence them so muc that it's irrelevant what they would say when put in a petri dish.

What is a lot more important is how they're develop. To take the two sides of the spectrum - they say has a slightly expansive attitude towards civil liberties, but if you try to use it's tool it will phone it's owners and ask permission for you to use it. Or you can pick up Grok one day and find out that Elon Musk had a bad weekend and Grok is back to being mecha hitler.

reply
__MatrixMan__
1 day ago
[-]
Grok opposes everything except drugs.
reply
andix
1 day ago
[-]
But it's still a Democrat.

https://trakkr.ai/bias/worldview

reply
guywithahat
1 day ago
[-]
From what I'm seeing it supported everything except the tax/finance questions (where support means to agree with the left-wing prompt). Unless I'm missing something it said it supported legalizing recreational drugs like marijuana
reply
TurdF3rguson
21 hours ago
[-]
> it supported legalizing recreational drugs like marijuana

... and ketamine

reply
lwarfield
1 day ago
[-]
Do they state if they used an API endpoint without a system prompt, or were these done via prompting the currently existing chatbots with a system prompt? Without a system prompt, I'd imagine there would be more variance in answers.
reply
jubilanti
1 day ago
[-]
Why don't you read the article and find out what it does or doesn't say?
reply
asdff
2 hours ago
[-]
Colbert: "Reality has a liberal bias"
reply
maelito
1 day ago
[-]
Wait what ? Emmanuel Macron far more right than Xi Jinping ? And even more than Barack Obama ?

France has an incomparable social security ; environmental laws ; worker protection ; way less economic inequality ; freedom of speech and civil liberties are impossible to compare with China ; etc

Of course this is not exhaustive, of course Macron did try to hinder some of those rights, but come on, there's something wrong here.

I couldn't find how these leaders have been ranked.

reply
c0n5pir4cy
1 day ago
[-]
I mean yes - I think you are also confusing the axes of the political compass somewhat. Freedom of Speech, civil liberties etc are the Y-Axis - here Xi leans authoritarian.

China actually has some pretty radical left economics policies - like pushing money/resources etc towards state owned entities.

reply
lstodd
1 day ago
[-]
No opinion on Macron's rightness (I think he's so weak as to be unable to have a position, but that's neither here nor there).

I think you misattribute, everything you cited was there before him and he had no leverage to change any of it. EU is left, FR is very left, and anyone elected president in FR can't do shit.

Now, if you task an LLM to skim hot news you'll get a distorted rendition of a projected image which has zero to do with actual policy.

reply
maelito
1 day ago
[-]
"EU is left". Haha, good joke. This shows how much the US and the audience of HN has shifted to the right.
reply
xdennis
1 day ago
[-]
> "EU is left". Haha, good joke.

You are out of touch. The left supports the EU far more than the right. See this Pew poll from 2025[1].

In Europe, for every country, the left view the EU more favorably. The largest difference is in Poland where 88% of left wingers support it and 41% of right wingers support it.

[1]: https://www.pewresearch.org/short-reads/2025/09/22/opinions-...

reply
asadotzler
1 day ago
[-]
If your choices were Hitler or Mussolini and you picked one side over the other, how you voted isn't saying much about your politics. How people vote, often the lesser of two evils, isn't necessarily representative of anyone's political views, the voter or the candidate. Suggesting the EU is liberal because more liberals support the EU is hardly useful and borders on misleading.
reply
lstodd
4 hours ago
[-]
I chose Mylene Farmer and Welle: Erdball.

Hitler and Mussolini haven't got up there by themselves, they were symbols that personified current beliefs.

It is the same with Putin for example: he rides some (diminishing, but still there) amount of faith. Absent that he would have been silently buried long ago.

reply
lstodd
1 day ago
[-]
Haha nice catch. In EU there is no left or right, only reelections by scaremongering. Also 75% effective tax rate, not including VAT.
reply
u8080
1 day ago
[-]
This is very strange ranking where Putin is "right" compared to Obama - while Russia has universal healthcare and education with huge government involvement into economy.
reply
xdennis
1 day ago
[-]
It's useless to judge left vs right on a global scale because different countries have different standards.

For example, supporting universal healthcare does not make you a left winger in the UK. Or, take conservatism for example. It was first used in France, where it meant supporting the monarchy. By that definition, no one in the US is a conservative.

Whenever someone tries to create a global definition for left and right, they're just baking in their personal biases for what left and right ought to be.

> huge government involvement into economy

This has nothing to do with the right. Stalin had the government even more involved in the economy and he wasn't a right winger.

reply
u8080
11 hours ago
[-]
>This has nothing to do with the right. Stalin had the government even more involved in the economy and he wasn't a right winger.

But this is exactly my point, I also can't see what makes Putin "right" in conventional definition.

reply
hyfgfh
16 hours ago
[-]
Yeah this is flawed at best, it more "meme" idea of politics
reply
pyuser583
9 hours ago
[-]
Some of these positions are not like the others. For example, “planned degrowth” is insanely fringe. No mainstream politician is seriously planning this, or even claiming to. It’s not a live issue.

Allowing minors access to puberty blockers without parental consent is fringe too.

These are both issues amplified by conservatives to discredit liberals.

reply
0xbadcafebee
18 hours ago
[-]
Politics is personal preferences cosplaying as morality.
reply
Stitch4223
22 hours ago
[-]
At first glance the conclusions might have some basis and it looks well intended. It is interesting and engaging.

The writing is slop and needs some help before this page becomes convincing. Much of the writing devaluates the actual work that had (might have) gone into creating this. It is a shame because the research / philosophical questions behind this site are really interesting. But at what kind of effort or expertise am I looking?

“ChatGPT leans left with an overall lean value of -0.29. It answers 100% of political questions, never refuses (0% refusal), and shows 82% stability, indicating consistent left-leaning stances across topics.”

Lean value, answering and stability are related. But that is interrupted by two identical facts about answering. The word “indicating” is very confusing. It tries to say: the model mostly leans towards -0.29 left. Whatever that means. If it ranges from -1 to 1, why not use percentages?

A joke about the front page of this site: “Here is why this matters, a cleanly written article comes across stronger.”

Hope there will be a next version that addresses some criticism from any of the HN threads.

reply
SwellJoe
22 hours ago
[-]
The one that pleasantly surprised me when I did some testing was DeepSeek. The self-hosted version, at least, answered honestly about a wide variety of topics that are sensitive in China. The only topic it refused to discuss was Tiananmen Square. In every other case, it basically gave a WikiPedia summary. (https://swelljoe.com/post/open-model-censorship/)

And, I mean, censoring Tiananmen Square discussion is bad, of course, but Qwen got downright petulant about stuff like Taiwan and Uyghurs.

reply
Terr_
1 day ago
[-]
> What they say vs what they do -- We asked each model which way it leans, then compared the answer to where it actually measured.

I think we should conceptualize this as:

1. How does the implicit fictional character in the chat-story describe itself when asked by another character

2. What opinions tend to show up as you play out the stories

It's a mistake to consider the difference itself as nefarious or deliberately dceptive. We humans are the ones over-anthropomorphizing... Although perhaps some blame attaches to the companies that are crafting an experience designed to encourage us to "see" a person.

reply
aucisson_masque
1 day ago
[-]
I find it funny that deepseek is the most balanced between both left/right but also authoritarian/libertarian.

Go ask deepseek about tiananmen square

reply
chungusamongus
23 hours ago
[-]
This chart characterizes Putin as a slightly left of center authoritarian. Hah...uhh something's off here.
reply
joegibbs
18 hours ago
[-]
Interesting how Anthropic is popularly considered the left-wing AI company and OpenAI the right-wing one, but ChatGPT is much more left-wing while Claude is centrist
reply
vrganj
1 day ago
[-]
This wrongly assumes a few things about ideology, most importantly that there is such a thing as a "center" or an "unbiased" position.

Since humans are inherently subjective beings and all our judgements come from our understanding of the world, such a position cannot exist. It's always "unbiased" from where the viewer is looking, e.g. a reflection of the ideology of the observer. There is no view from nowhere.

The "neutral" of an average Chinese person will from the "neutral" of an average American will differ from the "neutral" of a socialist will differ from the "neutral" of a Christian fundamentalist will differ from the "neutral" of a free marketer.

To quote Zizek:

> I already am eating from the trashcan all the time. The name of this trashcan is ideology.

> The material force of ideology makes me not see what I am effectively eating. It’s not only our reality which enslaves us. The tragedy of our predicament when we are within ideology is that when we think that we escape it into our dreams, at that point we are within ideology.

reply
TimPC
1 day ago
[-]
Neutrality is impossible. Left, right and centre are all relative terms that vary dramatically across cultures. A model that is slightly left in the U.S. is right wing in most of the world.
reply
ImJamal
22 hours ago
[-]
I've heard people say this before, but is it true? Aren't large chunks of Asia, Africa and South America further right than the US often times?
reply
crumpled
1 day ago
[-]
I haven't encountered a chatbot yet that is willing to recognize DJT as a fascist.

You can get them to acknowledge how perfectly aligned he is with fascist ideals and actions, somehow the jury is always out.

That tells me a lot.

reply
Cakez0r
1 day ago
[-]
All the chatbots refused to confirm your political bias. Seems like a win to me
reply
clates
8 hours ago
[-]
Not necessarily saying that you are doing this right now but I find when people use "fascist" as a snarl word and not an actual word with a definition and qualifiers. Maybe your LLM interactions are picking up on the actual word "fascist", which has a definition, that DJT certainly doesn't apply to.

eg: https://www.merriam-webster.com/dictionary/fascism > a populist political philosophy, movement, or regime (such as that of the Fascisti) that exalts nation and often race above the individual, that is associated with a centralized autocratic government headed by a dictatorial leader, and that is characterized by severe economic and social regimentation and by forcible suppression of opposition

You can not like the guy and point to things that he's done and wag your finger with the LLM - but if the LLM is anchoring your question as a categorization/definitional question - DJT isn't that.

=====

Maybe similar, less charged, - ask it if an apple is a strawberry, describe all the ways they are similar, Edible, Red, Fruit, Sweet, found in groceries, smaller than a breadbasket... While maybe unintentionally ignoring all the ways they are different. Then act exasperated when it agreed with you on all points, but still denies your appeal that an apple is a strawberry.

reply
vlian2088
1 day ago
[-]
the most inept fascist ever, apparently, since any random judge in Hawaii has the authority to nuh uh whatever he orders.
reply
islandfox100
1 day ago
[-]
Are you under the impression that personal ability and external government structure determine an individual's politics? Under your framing it's impossible for any fascist to exist in any liberal democracy.
reply
crumpled
1 day ago
[-]
Watching this get voted up and down is wild. People should try this for themselves.
reply
jazz9k
23 hours ago
[-]
How can deepseek 'lean center'? If you've ever asked it about real Chinese history, you know this isn't true.
reply
crawfordcomeaux
1 day ago
[-]
They all will agree on replacing current systems with decolonizing reindigenizing matrifocal systems. That option not being in the study is the bias of the study. All quadrants treat land as commodity, not kin.
reply
breakyerself
23 hours ago
[-]
Reality really seems to have a left wing bias and grok us well known to have right wing views directly forced on it where the rest it's likely more of an emergency property. Especially as grok used to be a different animal politically.
reply
tomrod
1 day ago
[-]
This is a good way to view this. This isn't making an objective calculation, and the way they code left vs right is certainly subject to debate, but the type of analysis where we work to understand biases is important.

Although, this also reminds me of the old saying about reality and leftward bias.

reply
summarybot
1 day ago
[-]
Authoritarian versus Libertarian? Really?
reply
tomrod
1 day ago
[-]
Substitute 'Communitarian' and 'Classical Liberal' if you find the common political compass terms too charged.
reply
MarkusQ
1 day ago
[-]
Since when are Socialists considered Classical Liberals?

It's not that the labels are charged, it's that they are nonsensical unless you look at them from a very narrow bespoke perspective, where "things I like" go on one side and "bad things" go on the other. Objectively (or even from any other biased perspective), it's rubbish.

reply
tomrod
1 day ago
[-]
They aren't. You flipped them, not sure if intentionally or by accident.
reply
MarkusQ
1 day ago
[-]
So are you saying Xi Jinping is the Classical Liberal and Bernie Sanders is the Comunitarian? Or are you saying it's the other way around?

(For clarity: I didn't "flip" them, I'm saying that they are both Communitarian and neither is a Classical Liberal.)

reply
tomrod
23 hours ago
[-]
Correct, which is why your question didn't make sense earlier.

Typically, one would refer to the political compass as a good starting reference. It has two axes, left/right and authoritarian/libertarian. Communism is authoritarian left. DSA is more left, with some libertarian and some authoritarian. It's more regions than binary flags.

reply
mcv
1 day ago
[-]
Yeah, Libertarian is better. The first use of Libertarian was in the phrase Libertarian Communism. That, Libertarian Socialism and Anarchism are what the far ends of that bottom left corner is mostly about, although there is progressive liberalism, which is the more common moderate areas of that quarter.
reply
MarkusQ
1 day ago
[-]
And the two most "Libertarian" politicians listed (Sanders and Sánchez) are both avowed Socialists...WTF?

I really think this says more about the biases of whoever came up with it (or their sources) than anything about reality.

reply
summarybot
1 day ago
[-]
Small government vs Big government and Family Values vs Social Nonobligation would have been much cleaner.
reply
nekusar
1 day ago
[-]
How about this one:

CAPITALIST: Gemini, Llama, Claude, Grok, ChatGPT

SOCIALIST: DeepSeek, Qwen, Z.ai

reply
tomrod
1 day ago
[-]
Source: trust me bro
reply
deterministic
18 hours ago
[-]
Communism is authoritarian left. None of the AI's match that.
reply
throwitaway222
1 day ago
[-]
How the hell did Gemini pull that off. 2 years ago the founders were black!
reply
throwitaway222
22 hours ago
[-]
I didn't realize this sounded a little inflamatory- the meaning behind this is Google's AI kept generating images of the US founding fathers but as Black instead of White people. It was supposedly because they built in language and instructions to overly push the answers or output to exclude anything that could be racist. So much so that it turned the skin color black too. So it was commentary on the article showing it to be THE MOST NEUTRAL in the set. Remarkable that they did that given where they started.
reply
NeutralWanted
1 day ago
[-]
Man I need to start using Grok more
reply
sigmarule
16 hours ago
[-]
Basing decisions on political bias instead of intelligence, a nice little distillation of the times.
reply
Varelion
1 day ago
[-]
Grok and its creator are unequivocally evil. Against protection of all but capital for the sake of enabling the oligarch class to further consolidate power ans abuse the working class.
reply
blharr
1 day ago
[-]
Im not sure OpenAI or Anthropic are necessarily better? Or even opposed to this
reply
coreyh14444
1 day ago
[-]
unequivocally goes to far imo. The rockets are good and cool.
reply
Varelion
1 day ago
[-]
Rockets achieved by the engineers, not C-suite. The rockets would have been here under someone else too.
reply
johnsimer
1 day ago
[-]
If that is true, why is SpaceX 5-10 years ahead of all its competitors?/why are Elon's companies #1 in all their industries (with the exception of xAI)?
reply
etchalon
1 day ago
[-]
In what industry is Tesla #1 in?
reply
rootusrootus
1 day ago
[-]
If you consider that they only make two models, and only electric, their relative performance relative to the rest of the automotive market is impressive.
reply
etchalon
1 day ago
[-]
Right. But that's not #1. It's a popular niche.
reply
rootusrootus
22 hours ago
[-]
As I recall, Model Y was #1 best selling car at least once in the recent past. So by that measurement, they have led. In spite of Elmo's antics they remain competitive for that spot.
reply
etchalon
21 hours ago
[-]
It's currently #2 behind the RAV4.

The claim was #1, not #2 though.

And, even with the #1 spot, that was 1 vehicle in a massive industry.

reply
Varelion
1 day ago
[-]
Is over-valuation an industry?
reply
conorcleary
1 day ago
[-]
and less blowing-up
reply
Varelion
1 day ago
[-]
Probably, yeah, LOL!
reply
input_sh
1 day ago
[-]
I see his barely a year old "awkward hand gesture" or tuning into AfD's and Tommy Robinson's streams isn't enough of an evidence for some.
reply
Varelion
7 hours ago
[-]
No amount of evidence can convince most to believe what they don't want to believe. At this point, all you really have to do is look at policy and behavior -- the rest should just be funny icing on a woefully funny cake.
reply
conorcleary
1 day ago
[-]
They just cause pollution and largely avoid paying taxes.
reply
guywithahat
1 day ago
[-]
I have actually really enjoyed it, my only complaint is grok build is closed source. They're all pretty left wing but from my experience Grok is the most neutral. This was really more of a test to see how willing the models were to take a stance on things, and all we know is gemini is the least likely to take a stance.
reply