> That's the same as setting a fixed metric for intelligence, like IQ testing, and goal seeking that. How does that prevent AI from becoming superhuman in all intellectual domains, thus creating ASI? We set "become good…
Maybe that's possible. But there will be a tension between how productive/useful the models can be when they are put into a very restrictive jail. In the limit they would be in a box with no way to communicate, but that…
I'm agnostic about whether ASI is possible. I don't have a dog in this fight other than a pro-human bias. I have used coding agents as well and I'm certainly aware that they are limited (at least in my domain). I think…
Well yes, I'm speculating about the future. Given that, I have sketched a scenario in which a small number of people control a country or an industry, even if ASI can be controlled. If you disagree with the reasoning,…
Thanks for the substantive reply. > How does it know it's improving and not overfitting to its own recursive definition of intelligence? It can't, and that's exactly what it will do. I haven't given this much thought,…
If the current path toward A(G/S)I continues, most of the technology will be owned by a small number of companies (and thus people) such as OpenAI and Anthropic. Their control could initially be economic, since they…
That's true but it doesn't really address what people are concerned about. Certainly we can and should be doing a much better job currently. However, even today, with currently known capabilities, we can imagine agents…
Can you quote where in the article this is mentioned? I don't see it. I just see the assertion AI can be controlled without any substantive description of how.
So in the real world, what are the analogues to lithium and morphine we should feed to e.g. LLMS, how do we feed them, and how do we prove that it prevents unsafe behavior?
Maybe I'm wrong, but your comment seems to suggest that you are skeptical of ASI. Do you have any arguments to support that? Btw, wouldn't AI increase the risk factors you mention such bioterrorism or nuclear war? It…
This is only one type of control, and it is certainly not infallible. Also, people will be incentivised to hook up AIs to real tools. But even if they don't, as long as people can interact with super-intelligent AIs…
I'm not sure what you mean.
Unfortunately the article is behind a paywall. I would have been interested to see if he makes any substantial arguments. I don't see any reason to believe that AI being software entails that it can be controlled.…
What makes it so much harder to publish a CL game on Steam versus a C++ game?
Legalese seems to me a different category more akin to technical writing. I wouldn’t classify difficulty understanding a legal document as a general lack of reading comprehension. It requires specific domain knowledge.
I’m not sure I should start a conversation on metaphysics here :-D Still, I’m struck by your use of words like “should” and “goal”. Those imply ethics and teleology so I’m curious how those fit into your…
I don’t understand your position. Are you saying it’s okay for computers to kill humans but not okay for humans to kill each other?
I think it would be “sphericles”.
I think that’s right. The analogy for straight men would be that they may want to love and sleep with many women but that it’s still wrong unless within a marriage.
AFAIK original sin does teach that all men are fallen and require salvation. This doesn’t mean that human nature is all bad and it’s indeed not the same as total depravity. However it’s also not true that men are born…
What’s the “something else” you’re currently using?
While I agree that simulation theory pushes the question up a level, that is not the case for the God of classical theism.
I think a key difference with humans is that ChatGPT doesn’t know that it doesn’t know.
This is surprising to hear. From my perspective as accomplices scientist being a doctor strikes me as one of the few jobs where you are obviously and directly helping people, thus “making the world a better place” (as…
So there can be no redemption? I can’t, off the top of my head, think of any endeavors where someone can never participate again once they’ve cheated. Certainly not in sports.
> That's the same as setting a fixed metric for intelligence, like IQ testing, and goal seeking that. How does that prevent AI from becoming superhuman in all intellectual domains, thus creating ASI? We set "become good…
Maybe that's possible. But there will be a tension between how productive/useful the models can be when they are put into a very restrictive jail. In the limit they would be in a box with no way to communicate, but that…
I'm agnostic about whether ASI is possible. I don't have a dog in this fight other than a pro-human bias. I have used coding agents as well and I'm certainly aware that they are limited (at least in my domain). I think…
Well yes, I'm speculating about the future. Given that, I have sketched a scenario in which a small number of people control a country or an industry, even if ASI can be controlled. If you disagree with the reasoning,…
Thanks for the substantive reply. > How does it know it's improving and not overfitting to its own recursive definition of intelligence? It can't, and that's exactly what it will do. I haven't given this much thought,…
If the current path toward A(G/S)I continues, most of the technology will be owned by a small number of companies (and thus people) such as OpenAI and Anthropic. Their control could initially be economic, since they…
That's true but it doesn't really address what people are concerned about. Certainly we can and should be doing a much better job currently. However, even today, with currently known capabilities, we can imagine agents…
Can you quote where in the article this is mentioned? I don't see it. I just see the assertion AI can be controlled without any substantive description of how.
So in the real world, what are the analogues to lithium and morphine we should feed to e.g. LLMS, how do we feed them, and how do we prove that it prevents unsafe behavior?
Maybe I'm wrong, but your comment seems to suggest that you are skeptical of ASI. Do you have any arguments to support that? Btw, wouldn't AI increase the risk factors you mention such bioterrorism or nuclear war? It…
This is only one type of control, and it is certainly not infallible. Also, people will be incentivised to hook up AIs to real tools. But even if they don't, as long as people can interact with super-intelligent AIs…
I'm not sure what you mean.
Unfortunately the article is behind a paywall. I would have been interested to see if he makes any substantial arguments. I don't see any reason to believe that AI being software entails that it can be controlled.…
What makes it so much harder to publish a CL game on Steam versus a C++ game?
Legalese seems to me a different category more akin to technical writing. I wouldn’t classify difficulty understanding a legal document as a general lack of reading comprehension. It requires specific domain knowledge.
I’m not sure I should start a conversation on metaphysics here :-D Still, I’m struck by your use of words like “should” and “goal”. Those imply ethics and teleology so I’m curious how those fit into your…
I don’t understand your position. Are you saying it’s okay for computers to kill humans but not okay for humans to kill each other?
I think it would be “sphericles”.
I think that’s right. The analogy for straight men would be that they may want to love and sleep with many women but that it’s still wrong unless within a marriage.
AFAIK original sin does teach that all men are fallen and require salvation. This doesn’t mean that human nature is all bad and it’s indeed not the same as total depravity. However it’s also not true that men are born…
What’s the “something else” you’re currently using?
While I agree that simulation theory pushes the question up a level, that is not the case for the God of classical theism.
I think a key difference with humans is that ChatGPT doesn’t know that it doesn’t know.
This is surprising to hear. From my perspective as accomplices scientist being a doctor strikes me as one of the few jobs where you are obviously and directly helping people, thus “making the world a better place” (as…
So there can be no redemption? I can’t, off the top of my head, think of any endeavors where someone can never participate again once they’ve cheated. Certainly not in sports.