#ai #ai-alignment # [[Epistemic status]] #shower-thought #to-digest 2022-07-05 # Related - [[The exponential growth of intelligence]] - [[Computing/Intelligence/Superintelligence]] - [[Computing/Intelligence/Artificial universal intelligence]] - [[Computing/Intelligence/Alignment/Pessimistic vs optimistic AI]] # Intelligence explosion >The intelligence explosion adherents sometimes talk about “superhuman intelligence,” which is when machines surpass human performance in every way and on every task. Think about what that implies. A superhuman intelligent machine could expertly fly every type of airplane, operate every type of machine, and write software in every programming language. It would speak every language, know the history of every culture in the world, and understand the architecture in every city. The list of things that humans can do collectively is so large that no machine can surpass human performance in every field. >~ [[Jeff Hawkins]]  The intelligence explosion adherents sometimes talk about “superhuman intelligence” as a concept that would be realized in the future, when artificial general intelligence (AGI) surpasses human intelligence. This superhuman intelligence would have the potential to solve complex problems that are beyond the capabilities of humans, and could even be capable of redesigning itself to become more powerful. This idea has been explored in science fiction, and the potential implications of a superhuman intelligence have been discussed extensively in philosophical and ethical circles. While the concept of superhuman intelligence is exciting for some, it also presents a challenge for humanity as a whole, as it could potentially lead to a future that is far different from our current reality.