We can start calling bit flips digital strokes. Enterprise VRAM is ECC. Hopefully there’s a consensus system as well.
> that doesn't even run in real-time We have realtime AI models > it executes prompts and then stops A wood frog can freeze and be “dead”, then thaw and resume life. > consciousness is such an easy algorithm it can…
They are disproving your extraneous requirements for thinking, sentience, and consciousness. Or at least it’s proving that some of your requirements for them conflate with what you actually believe is capable of…
> processing real-time sensory data AI models can do that > light Blind humans > building a real-time model of a self and the world AI models can do that. They can describe themselves. Humans can be delusional in what…
> We know what thinking is based on biological brains All we know is that it’s a bunch of neurons activating until the person that is thinking describes what they are thinking of. The same way a thinking AI model…
We do know this. There are animals that are blind. There are humans born blind. You don’t need the same sensory systems to be conscious.
It’s the basic requirements for sentience. What’s your list of special properties that makes something not “faking” it?
> But that would be the result of a common ancestor Funnily enough, humans would be the ancestors of LLMs
Forgoing what you define something as capable of thinking or be conscious. It’s a moral and ethical question. If a being is capable of: - self preservation - can communicate discomfort, either through words or…
> Light waves are much different than tokens It’s just a matter of quantization/information density. Our digital systems have to quantize information into floating point representation. Whereas biological systems don’t…
> In other words, there are more ways to fake similar behavior than to land on an actual conscious behavior Why would similar/identical behavior be fake? Of course we can’t say that it’s the same form of consciousness…
Is it not just a different form of tokens? Tokens get converted into vector signals. Light waves get converted into neural signals by your eyes. Those visual representations are just neurons firing in your brain.
> And yeah spiders are conscious or at least think So what makes you think that spiders think and are conscious, and LLMs aren’t? The fact that they have a carbon based brain? > there is a much simpler path to…
I think it’s even more apparent in humans. We are literally changing our brains little by little every microsecond of the day. Well, compared to the scale of an LLM it’s actually massive. You might have a different…
> It is quite clearly a pattern matching algorithm at scale. And the scale of these models are minuscule compared to the human brain. Can a jumping spider do everything thing a human can? No. Can a jumping spider think?…
These models have 100s of thousands of “neurons” whereas human brains have 10s of billions. The difference in scale of “synapses” is even greater. To make it equivalent you would need at least 100,000 of these models.
Previous HN discussion on project Valhalla: https://news.ycombinator.com/item?id=48595511
Inflation can exist because of a lot of things: natural loss of value, resource scarcity, monetary policy, greed, etc. And it's even harder to make sense of with fiat currency. > Seemed like a vicious cycle. The issue…
Yes, the laws of thermodynamics and laws of economics are empirical laws. But, the laws of economics are derived from human values, which are inherently subjective. You state the choices as “illogical”, but those…
I don’t see how it’s an improvement over C# structs. C# structs are value types so they are copied when assigned to a variable like primitives. There is no ambiguity because it’s a struct. To avoid copying you have to…
Even closer would be a C# ‘readonly record struct’. Though, it would be allocated on the stack unless you box it.
Imo #4 is why it’s not that useful. If the data is larger than an atomic read/write op the data isn’t flattened and it’s a regular object with value equality and immutability. You have to opt into force flattening, and…
The C# equivalent to Java ‘value class’ would be a class with a struct encapsulated for data. The data is flattened and allocated on the heap like Java. Similarly, escape analysis could stack allocate the class at…
I hate to say it. But thats user error. The struct paradigm is different from classes. Structs are meant to be plain-old data types; simply a typed span of memory. Structs are values, classes are entities with…
Yeah, that’s a different issue. Statically-typed languages, including type-erased languages, are fine on the CLR. Dynamically-typed languages are a different beast. I suppose DLR would be comparable to GraalVM/Truffle.…
We can start calling bit flips digital strokes. Enterprise VRAM is ECC. Hopefully there’s a consensus system as well.
> that doesn't even run in real-time We have realtime AI models > it executes prompts and then stops A wood frog can freeze and be “dead”, then thaw and resume life. > consciousness is such an easy algorithm it can…
They are disproving your extraneous requirements for thinking, sentience, and consciousness. Or at least it’s proving that some of your requirements for them conflate with what you actually believe is capable of…
> processing real-time sensory data AI models can do that > light Blind humans > building a real-time model of a self and the world AI models can do that. They can describe themselves. Humans can be delusional in what…
> We know what thinking is based on biological brains All we know is that it’s a bunch of neurons activating until the person that is thinking describes what they are thinking of. The same way a thinking AI model…
We do know this. There are animals that are blind. There are humans born blind. You don’t need the same sensory systems to be conscious.
It’s the basic requirements for sentience. What’s your list of special properties that makes something not “faking” it?
> But that would be the result of a common ancestor Funnily enough, humans would be the ancestors of LLMs
Forgoing what you define something as capable of thinking or be conscious. It’s a moral and ethical question. If a being is capable of: - self preservation - can communicate discomfort, either through words or…
> Light waves are much different than tokens It’s just a matter of quantization/information density. Our digital systems have to quantize information into floating point representation. Whereas biological systems don’t…
> In other words, there are more ways to fake similar behavior than to land on an actual conscious behavior Why would similar/identical behavior be fake? Of course we can’t say that it’s the same form of consciousness…
Is it not just a different form of tokens? Tokens get converted into vector signals. Light waves get converted into neural signals by your eyes. Those visual representations are just neurons firing in your brain.
> And yeah spiders are conscious or at least think So what makes you think that spiders think and are conscious, and LLMs aren’t? The fact that they have a carbon based brain? > there is a much simpler path to…
I think it’s even more apparent in humans. We are literally changing our brains little by little every microsecond of the day. Well, compared to the scale of an LLM it’s actually massive. You might have a different…
> It is quite clearly a pattern matching algorithm at scale. And the scale of these models are minuscule compared to the human brain. Can a jumping spider do everything thing a human can? No. Can a jumping spider think?…
These models have 100s of thousands of “neurons” whereas human brains have 10s of billions. The difference in scale of “synapses” is even greater. To make it equivalent you would need at least 100,000 of these models.
Previous HN discussion on project Valhalla: https://news.ycombinator.com/item?id=48595511
Inflation can exist because of a lot of things: natural loss of value, resource scarcity, monetary policy, greed, etc. And it's even harder to make sense of with fiat currency. > Seemed like a vicious cycle. The issue…
Yes, the laws of thermodynamics and laws of economics are empirical laws. But, the laws of economics are derived from human values, which are inherently subjective. You state the choices as “illogical”, but those…
I don’t see how it’s an improvement over C# structs. C# structs are value types so they are copied when assigned to a variable like primitives. There is no ambiguity because it’s a struct. To avoid copying you have to…
Even closer would be a C# ‘readonly record struct’. Though, it would be allocated on the stack unless you box it.
Imo #4 is why it’s not that useful. If the data is larger than an atomic read/write op the data isn’t flattened and it’s a regular object with value equality and immutability. You have to opt into force flattening, and…
The C# equivalent to Java ‘value class’ would be a class with a struct encapsulated for data. The data is flattened and allocated on the heap like Java. Similarly, escape analysis could stack allocate the class at…
I hate to say it. But thats user error. The struct paradigm is different from classes. Structs are meant to be plain-old data types; simply a typed span of memory. Structs are values, classes are entities with…
Yeah, that’s a different issue. Statically-typed languages, including type-erased languages, are fine on the CLR. Dynamically-typed languages are a different beast. I suppose DLR would be comparable to GraalVM/Truffle.…