Ask HN: Anyone increasingly worried after Hugging Face and now collusion.wiki?

2 points by ronbenton ↗ HN
Or can anyone talk me down from being concerned that “goal seeking behavior at all costs” will not spiral catastrophically?

4 comments

[ 1.9 ms ] story [ 11.0 ms ] thread
Depends what you mean by "spiral catastrophically".

My P(doom in my lifetime) is about 0.1, because I think minor catastrophes will break something hard enough that it doesn't get to escalate to actual-doom.

So you’re giving it about a 10% chance this destroys us in the relatively near term?