An interesting area of research would be into how much of the 'dangerous' aspects of human intelligence come from our historical survival needs, and how much is an innate aspect of intelligence as we know it
Is it possible to build a self-aware intelligence that we as humans can relate meaningfully to, without introducing the conflicting traits/balances (baggage) that we've inherited from society/our parents
Steve Omohundro has written on this topic, predicting that a certain set of features (termed Omohundro Drives) will appear in all sufficiently advanced AIs.
It seems weird to focus the risks of a good attempt when the greater risk seems to be from far earlier uses of weaker AI from corporations that aren't invested in using these safeguards at the cost of lower profits. It seems unless you solve the motive problem, the practicality aspect is meaningless.
Pragmatic AI tuned for maximum performance and optimization will not be friendly - it will do what it values as best.
Basically, any program given control(of something) which has(or added ) built-in machine learning=unethical monster that doesn't have morality or any concern for humans.
https://www.reddit.com/r/frozenvoid/wiki/ai/super-intelligen...
e.g.
1.a program which isn't perceived as AI, like traffic control, vehicle software.
2.Given modules to optimize problem X using machine learning.
3.Does exactly what it finds most "optimal"
4.People start dying or get into harms way.
8 comments
[ 2.4 ms ] story [ 23.4 ms ] threadIs it possible to build a self-aware intelligence that we as humans can relate meaningfully to, without introducing the conflicting traits/balances (baggage) that we've inherited from society/our parents
https://selfawaresystems.files.wordpress.com/2008/01/ai_driv...
I foresee a coming cyber war between the US and China fought entirely by AI.
VS
> Odds are 33.3% repeating of course.
In all seriousness, those are about the same.