Two Reminders about AI

1 points by slackfan ↗ HN
A model in an idle state will do nothing unless prompted by a user or researcher.

Air-gapped systems do not have physical network access to the outside world.

4 comments

[ 0.25 ms ] story [ 11.1 ms ] thread
This is simply not true. People have been running autonomous systems for at least a year now.
Three?

AFAICT, LLM's do no checking of data fed to them, accepting lies.

Correct me if this is wrong, but IMO, it's a fatal flaw in any software.

I'm just trying to be objective.

What is a "lie" vs what is the "truth"? We don't have consistent answers as living beings, why do we expect probability to distinguish, even if as a rhetorical argument?

These are still token probability machines, and though the models in the last 6 months do more "thinking", they use certain tokens (actually, but wait) to "intentionally" inject path bifurcation so the next most likely token is conversation that questions preceding statements, like statistical BFS/DFS over the token / embedding graph, but you want to make certain path choices closer in equality so both are explored.

Reminder: it's not the offline un-prompted weights sitting alone on a hard drive that anyone is worried about.

It's what they do when prompted, that we get the most out of them by connecting them to the internet, and that some people are giving them control over robots, that worries people.