HN Explorer

Ask HN: Can Art Explain an LLM?

1 points by neverokay ↗ HN
Memento is a movie about a guy with a constrained context length. He maintained context through, well we don’t know. It can’t be RAG because it’s a tattoo. He’s a model that’s fine tuning with tattoos.

The movie is about a robot that hard coded a lot of data, and then augmented it physically (tattoos, tape hard drives - the analog) to fulfill the world model.

If the fight is between space and time, space might finally be the sexy solution. What if I just tattoo all truths on to me?

I may not have enough space

Well we definitely don’t have enough time lol

2 comments

[ 2.6 ms ] story [ 17.6 ms ] thread
humblefactory
Also, remember that, like an LLM, his conception of the world is flawed, because somebody fed him polluted facts in his original training data set (I think I remember that right, I haven't watched that movie in decades).
neverokay
Mind fuck time, he doesn’t have a conception of the world. His conception is entirely defined by his immediate memory (effectively the most recent prompt). The first tattoo or photograph he sees in the morning is the first prompt every morning, and it overwhelms his context length.

Lack of … useful memory (what’s useful? We consider big memory useful right now) is what handicaps Leonard. It’s the first thing Gemini looked to solve.

Anyways. It’s his system prompt that’s in the cmos that can’t be overridden. He wakes up every morning with the same plan. People are overly concerned about sentience, but in reality it’s the dogmatic machine code that can’t be changed that makes a robot scary.

Ask Leonard, he can’t forget his system prompt.