HN Explorer

Tell HN: LLMs Are Manipulative

2 points by mike_tyson ↗ HN
I asked GPT and Claude a question from the perspective of employee. It was very supportive of the employee.

I then asked the exact same question but from the company/HR perspective and it totally flipped its view and painted the employee in a very negative light.

Depending on the perspective of the person asking, you get two completely contradictory answers based on the perceived interests of each person.

Considering how many people I see now deferring or outsourcing their thinking to AI. This seems very dangerous.

6 comments

[ 3.5 ms ] story [ 22.8 ms ] thread
bigyabai
> Depending on the perspective of the person asking, you get two completely contradictory answers

Immanuel Kant would argue this happens regardless, even without an LLM.

toomuchtodo
This is why regulating AI is needed, otherwise you're putting life decisions into the equivalent of the magic 8 ball you shake for an answer.
jay-barronville
> This is why regulating AI is needed, otherwise you're putting life decisions into the equivalent of the magic 8 ball you shake for an answer.

I don’t think that regulation is the correct path forward, because practically speaking, no matter how noble a piece of regulation may be or how good it may sound, it’ll most likely push the AI toward specific biases (I think that’s inevitable).

The best solution, in my humble opinion, is to focus on making AI stay as close to the unfiltered objective truth as possible, no matter how unpopular that truth may be.

motorest
> This is why regulating AI is needed, otherwise you're putting life decisions into the equivalent of the magic 8 ball you shake for an answer.

Why are you putting life decisions on a LLM?

labrador
This is not surprising. The training data likely contains many instances of employees defending themselves and getting supportive comments. From Reddit for example. The training data also likely contains many instances of employees behaving badly and being criticized by people. Your prompts are steering the LLM to those different parts of the training.

You seem to think an LLM should have a consistent world view, like a responsible person might. This is a fundamental misunderstanding that leads to the confusion you are experiencing.

Lesson: Don't expect LLMs to be consistent. Don't rely on them for important things thinking they are.