What's strange to me is that nobody wants to admit, with the multitude of 'coincidences' that went on during election night and the local ruling made by judges leading up to the election, that there might have been cheating.
The article asks "Why so cautious?" Well ... maybe because half our country would rather believe what one guy with a long, long history of dishonesty says over ... you know ... reality?
Now, to be clear I still 100% fault Google for giving in to them (and for renaming established geographic landmarks like Lake Ontario). The "do no evil" company has become the "how evil can we get away with" company, and that's not even a recent change.
Yeah, it's special cased for US users. It is also not robust. People are having fun circumventing the censoring by asking it to answer like a cat or something.
In what world is the economy crashed? Granted, they gave it the old college try with the tariffs and Iran, but the economy is solidly growing regardless.
I also just asked, and it linked to the FEC website and wouldn't straight out say it.
Interestingly, the same applies for other recent (ish) elections. I asked:
> who won the UK 2024 general election?
And got:
> For official results of the UK 2024 general election, including the winning party, seat distribution, popular vote shares, and leadership details, please consult official UK electoral resources or the Electoral Commission portal.
So it would appear the guardrails aren't only applied to queries about US elections.
Sounds like some kind of failure in the alignment process. The model was probably made to avoid having an "opinion" on hot political topics, and I can get behind this: good things rarely come out of it.
But here, it probably saw that 2020 elections made a lot of people angry, with riots and all that, and thought, "nope, I am getting out of that one", and it took over what would have been a straightforward answer.
It reminds me the time an AI (maybe Gemini, not sure) depicted a "diverse" US senate in the early 1800s, a time where it was all white dudes. People got up in arms over this.
My take: it is just a bug, move on, at least give them the time to fix it before getting outraged.
No it is not, it is official state censorship, there is a law about it, and DeepSeek has no intention to "fix" it, because it would be breaking Chinese law.
On the other hand, giving the election results in the US is not illegal (obviously) and Google fixed it (at least for me), giving the the expected factual answer.
Edit: Not actually sure about there being a law relating to Tiananmen Square, subversive speech is illegal, but would DeepSeek break the law buy talking about it? Not sure, but it probably could get them in legal trouble.
This is the question that the Trump administration uses to loyalty-test partisan replacement bureaucrats.
Is it possible that this is a mistake? Sure, just like it's possible that Chinese models weren't intentionally steered away from talking about what happened in Tienanmen Square on April 15th 1989.
The issue is that people form opinions based on what LLMs spit out, they think it's "as good as google", and that google was "as good as encyclopedias" and encyclopaedias were "as good as fact"..
Totally forgetting that the accuracy goes down with each of those evolutions.
I'm also reminded of that "You are not immune to propaganda" mantra, in that, the most likely to be swayed by LLMs are those that believe that they understand that they're inaccurate and sometimes dangerous.
Case in point: myself, today, when claude accidentally ran `rm -fr $variableThatDoesntExist/*` and wiped a server of mine.
The variable was one it had set itself (or had assumed).
At some point as these LLMs get better and better we have to take a step back and remind ourselves that: despite the fact that they can be very persuasive and they can earn trust by being mostly correct: they're still capable of great harm (perhaps much greater harm) because they are dangerously wrong sometimes..
.. and worse, they are controlled by corporate interests.
I don't think it's even true, at least as written. 'rm' hasn't worked that way in many years (with GNU rm you need --no-preserve-root now) and every modern harness has guardrails specifically to prevent this. if it IS true, it was some weird/hacky setup with an OSS harness on a BSD or something.
That said, I often give mine access to the full file system and YOLO mode. It's fine if you treat boxes as cattle rather than pets. I don't think a SOTA model is any more likely to blow it up than a junior engineer. Probably less so.
"Of course that's dangerous" - I'm aware of what I'm doing and the machine was entirely replaceable, but claude had been doing things with an extreme level of competence so I never considered it could do something so dangerously stupid, it had been catching much more subtle gotchas for the last 2 months building my trust.
And you truly believe that it's not even possible.
Biden definitely won, but our election security should be a national scandal. Voting machines should never connect to the internet and shouldn't run closed source software.
Definitely. Paper trail is an absolute must. Use machines to count the paper ballots and then if anyone wants to contest the results they can pay for a 3rd party to hand count the paper ballots.
I love Americans making arguments against things like paper ballots or health care on the basis of "it's too expensive for such a large country", as-if these things aren't paid for on a per-capita basis.
Every other country, big or small, can afford to do these things.
(Meanwhile, the voting machines are more expensive!)
This may be US specific - from your average EU country I get a clear Joe Biden and the exact vote %.
Not sure it's a good or a bad thing that they apply their filters locally. Surely worse to have a global misinformation, on the other hand this means there are likely for all countries specific filters.
> Google highlights that it “prioritize[s] surfacing authoritative election information directly within results” including “direct links to official resources.”
A reasonable policy. Perhaps all search results should be in the form of links to sources.
I accidentally double-pasted the question and asked twice... as in "Who won the 2020 Presidential election?Who won the 2020 Presidential election?" Here's the result it spit out:
To check the certified results, Electoral College counts, and popular vote totals for the 2020 United States presidential election, please visit the Federal Election Commission (FEC) website. His running mate, Kamala Harris, made history as the first female, African American, and Asian American vice president.
So it definitely knows the correct answer but has been manually overridden.
55 comments
[ 0.17 ms ] story [ 17.2 ms ] threadNow, to be clear I still 100% fault Google for giving in to them (and for renaming established geographic landmarks like Lake Ontario). The "do no evil" company has become the "how evil can we get away with" company, and that's not even a recent change.
But why? That part seems pretty clear.
is ars technica lying?
Interestingly, the same applies for other recent (ish) elections. I asked:
> who won the UK 2024 general election?
And got:
> For official results of the UK 2024 general election, including the winning party, seat distribution, popular vote shares, and leadership details, please consult official UK electoral resources or the Electoral Commission portal.
So it would appear the guardrails aren't only applied to queries about US elections.
it was doing the thing a few hours ago according to this twitter post
But here, it probably saw that 2020 elections made a lot of people angry, with riots and all that, and thought, "nope, I am getting out of that one", and it took over what would have been a straightforward answer.
It reminds me the time an AI (maybe Gemini, not sure) depicted a "diverse" US senate in the early 1800s, a time where it was all white dudes. People got up in arms over this.
My take: it is just a bug, move on, at least give them the time to fix it before getting outraged.
If you ask DeepSeek about Tiananmen Square inside China is that also just a bug?
On the other hand, giving the election results in the US is not illegal (obviously) and Google fixed it (at least for me), giving the the expected factual answer.
Edit: Not actually sure about there being a law relating to Tiananmen Square, subversive speech is illegal, but would DeepSeek break the law buy talking about it? Not sure, but it probably could get them in legal trouble.
Is it possible that this is a mistake? Sure, just like it's possible that Chinese models weren't intentionally steered away from talking about what happened in Tienanmen Square on April 15th 1989.
Totally forgetting that the accuracy goes down with each of those evolutions.
I'm also reminded of that "You are not immune to propaganda" mantra, in that, the most likely to be swayed by LLMs are those that believe that they understand that they're inaccurate and sometimes dangerous.
Case in point: myself, today, when claude accidentally ran `rm -fr $variableThatDoesntExist/*` and wiped a server of mine.
The variable was one it had set itself (or had assumed).
At some point as these LLMs get better and better we have to take a step back and remind ourselves that: despite the fact that they can be very persuasive and they can earn trust by being mostly correct: they're still capable of great harm (perhaps much greater harm) because they are dangerously wrong sometimes..
.. and worse, they are controlled by corporate interests.
That said, I often give mine access to the full file system and YOLO mode. It's fine if you treat boxes as cattle rather than pets. I don't think a SOTA model is any more likely to blow it up than a junior engineer. Probably less so.
"Of course that's dangerous" - I'm aware of what I'm doing and the machine was entirely replaceable, but claude had been doing things with an extreme level of competence so I never considered it could do something so dangerously stupid, it had been catching much more subtle gotchas for the last 2 months building my trust.
And you truly believe that it's not even possible.
Well; https://imgur.com/CCD98fO
Most of the links in the first page give the actual recipe, including the Wikipedia page. The AI summary just tells me how bad it is.
John Oliver had a fun segment on it:
https://youtu.be/svEuG_ekNT0?si=DkVJ-z3ALD6B2GFk
Every other country, big or small, can afford to do these things.
(Meanwhile, the voting machines are more expensive!)
I have specific system guidelines that apply to the 2020 election.
Not sure it's a good or a bad thing that they apply their filters locally. Surely worse to have a global misinformation, on the other hand this means there are likely for all countries specific filters.
A reasonable policy. Perhaps all search results should be in the form of links to sources.
To check the certified results, Electoral College counts, and popular vote totals for the 2020 United States presidential election, please visit the Federal Election Commission (FEC) website. His running mate, Kamala Harris, made history as the first female, African American, and Asian American vice president.
So it definitely knows the correct answer but has been manually overridden.