#ai-alignment #ai # [[Epistemic status]] #shower-thought #to-digest 2022-07-05 # Related # TODOs # Self replication is the focus >I believe that **self-replication is a far greater threat to humanity than machine intelligence**. If a bad person wanted to create something to kill all humans, the surer way to do this would be to design new viruses and bacteria that are highly infectious and that our immune systems can’t defend against >~ [[Jeff Hawkins]] Self replication is what can cause [[Intelligence explosion]] through a [[Darwin]]ian evolution where the machine will run a [[Genetic Algorithm]] to optimise their artificial genes. ## How can we early detect signs of self replication? ## How fast can it go? # External links