I think the problem with your line of reasoning is a category error, not a mistake about arithmetic. I agree that every step of an LLM’s operation reduces to Boolean logic and arithmetic. That description is correct.…
Well, then you didn't look very hard. Where do you think we got the idea for artificial neurons from?
Here’s some that were failing: https://youtu.be/rAEqP9VEhe8?si=hksqHjGtvhkYjQZI https://youtu.be/mhf2aTqx8-Y?si=ZSAjDKFyg7IZNJ-O
I think the problem with your line of reasoning is a category error, not a mistake about arithmetic. I agree that every step of an LLM’s operation reduces to Boolean logic and arithmetic. That description is correct.…
Well, then you didn't look very hard. Where do you think we got the idea for artificial neurons from?
Here’s some that were failing: https://youtu.be/rAEqP9VEhe8?si=hksqHjGtvhkYjQZI https://youtu.be/mhf2aTqx8-Y?si=ZSAjDKFyg7IZNJ-O