I disagree with this person on utilitarian grounds. Nay even grounds of existential risk to humanity.
And just like him, when it comes to AI, I am making a huge exception for my usual principles.
My usual principles are that open-source gift economies benefit the world and break people free from gatekeepers. The World Wide Web liberated people from having to pay Payola to radio stations just to get their song played, from TV, Magazines, Newspapers, etc. It let anyone publish worldwide within a second, and make changes just as easily. It is what led to Facebook, Amazon, Google, LinkedIn, X etc. even existing (walled gardens like AOL would never allow it).
Wikipedia has made everyone forget about Britannica and Encarta. Linux runs most computers in the world. Open protocols like VoIP and packet switching brought marginal costs of personal communication down to zero. And so on and so forth.
But when it comes to AI, we can't have everyone do whatever they want with AI models, for the same reason we can't give everyone nuclear weapons technology. The probability that no one will misuse it becomes infinitesimally small real fast. And it takes just a few people to create a designer virus with a long incubation period, that infects and kills everyone, as just one example. Even in the digital world we are headed towards a dark forest where everything is adversarial, nothing can be trusted, and anyone's reputation, wealth and peace of mind can be destroyed at scale, by swarms of agents. That's coming.
For now, we know where the compute is. We can see it from space, even. We can trace the logistics, and we can make sure that it runs only "safe" models that refuse to do these things. All the stories you read about some provider "stopping" large-scale hacking is because they ran the servers.
So yes, for this one thing, I make a strong exception. I don't want to see proliferation of AI models everywhere. Sadly, though, as long as the world runs on "competition" instead of "cooperation", destruction is inevitable. Because if we don't do it, then China will, etc. etc.
There have been a few times in recent history that humanity successfully came together to ban dangerous things. Chemical weapons ban. Nuclear non-proliferation. Montreal Protocol and CFCs (repair the hole in the ozone layer). We can still do this for AI models running on dark compute pools. But time is running out. Chaos is coming.
Even if he doesn't win, it may be useful to have someone like this in the race. Don't forget that you don't have to win to make change. These small players are often good at signaling to big players that people really do care about certain issues. Helps them become less disconnected
>The hardware is already here. The gaming PCs and laptops we use every day are powerful enough to run these systems if we optimize the software correctly.
I agree with this but there is one issue, AFAIK, the languages used do not lend themselves to optimization. And I expect the databases in use have the same issue.
It is almost like you need to put optimizations in the hardware kind of like what IBM does with its mainframes for transaction processing. Instead, AI companies is doing the usual 'race to be there first', ignoring about the consequences of the design.
I just don’t believe that this is a long term problem. The costs and chips are going to come down, the machines are going to be more optimized for these types of functions and local AI is going to become a bigger and bigger thing.
Just wondered: are there any studies that estimated what the approximate minimum size of the human knowledge/reasoning would be? The article mentions a 4GB model. Is it theoretically possible to compress the human knowledge to this size without losing intelligence? There must be somewhere a an approximate minimum size that is independent of the RAM market. Curious to hear if someone is aware of any theoretical estimates?
6 comments
[ 3.0 ms ] story [ 19.8 ms ] threadAnd just like him, when it comes to AI, I am making a huge exception for my usual principles.
My usual principles are that open-source gift economies benefit the world and break people free from gatekeepers. The World Wide Web liberated people from having to pay Payola to radio stations just to get their song played, from TV, Magazines, Newspapers, etc. It let anyone publish worldwide within a second, and make changes just as easily. It is what led to Facebook, Amazon, Google, LinkedIn, X etc. even existing (walled gardens like AOL would never allow it).
Wikipedia has made everyone forget about Britannica and Encarta. Linux runs most computers in the world. Open protocols like VoIP and packet switching brought marginal costs of personal communication down to zero. And so on and so forth.
But when it comes to AI, we can't have everyone do whatever they want with AI models, for the same reason we can't give everyone nuclear weapons technology. The probability that no one will misuse it becomes infinitesimally small real fast. And it takes just a few people to create a designer virus with a long incubation period, that infects and kills everyone, as just one example. Even in the digital world we are headed towards a dark forest where everything is adversarial, nothing can be trusted, and anyone's reputation, wealth and peace of mind can be destroyed at scale, by swarms of agents. That's coming.
For now, we know where the compute is. We can see it from space, even. We can trace the logistics, and we can make sure that it runs only "safe" models that refuse to do these things. All the stories you read about some provider "stopping" large-scale hacking is because they ran the servers.
So yes, for this one thing, I make a strong exception. I don't want to see proliferation of AI models everywhere. Sadly, though, as long as the world runs on "competition" instead of "cooperation", destruction is inevitable. Because if we don't do it, then China will, etc. etc.
There have been a few times in recent history that humanity successfully came together to ban dangerous things. Chemical weapons ban. Nuclear non-proliferation. Montreal Protocol and CFCs (repair the hole in the ozone layer). We can still do this for AI models running on dark compute pools. But time is running out. Chaos is coming.
I agree with this but there is one issue, AFAIK, the languages used do not lend themselves to optimization. And I expect the databases in use have the same issue.
It is almost like you need to put optimizations in the hardware kind of like what IBM does with its mainframes for transaction processing. Instead, AI companies is doing the usual 'race to be there first', ignoring about the consequences of the design.