HN Explorer

Ask HN: How can political bias across LLMs be factored?

3 points by shaburn ↗ HN
Political bias is measurable and significant across models(and probably changing over time for closed-sourced). In search of objectivity, what are the best ways to account for this abstraction(s)?

8 comments

[ 3.3 ms ] story [ 30.8 ms ] thread
smoldesu
Well, text is political. You're not going to say "Tiananmen Square" without a political sentiment, so your only option would be to censor it.

LLMs are text tokenizers, if the majority of it's training material leans liberal or conservative then the output should reflect that. I think a better idea is to avoid relying on glorified autocorrect for anything related to political drama.

h2odragon
> You're not going to say "Tiananmen Square" without a political sentiment

you just did.

PaulHoule
Actually the place itself is not controversial https://en.wikipedia.org/wiki/Tiananmen_Square any more than the National Mall in Washington, DC is controversial. It's what happened there on one day which is suppressed.
smoldesu
With that in mind, what would a truly apolitical representation of Tiananmen Square be, in terms of AI training data?
PaulHoule
A system which has artificial wisdom as opposed to just artificial intelligence might try to not get involved.
h2odragon
Imagine having an LLM do a translation of daily news into "simple english", much like wikipedia has: https://simple.wikipedia.org/wiki/Simple_English_Wikipedia

the results are not free of political bias, but may well highlight it in a starkly hilarious way.

you might do human training at that level but then you've only created a newly biased model.

jruohonen
What is "political bias"? Insofar as you're talking about American politics, as I suppose you are, the alleged bias is essentially quantified Gramsci.
shaburn
I beleive the model bias is highly influenced by the modelers. See Grok and OpenAI.