Superintelligence: Paths, Dangers, Strategies
What happens when machines surpass humans in general intelligence? Nick Bostrom, a philosopher at Oxford, explores the paths to superhuman AI, the risks it poses, and the strategies we might use to ensure a positive outcome. This is the book that brought AI safety into the mainstream conversation and remains essential reading for anyone serious about understanding the future of intelligence.
Key Ideas
Before the prospect of an intelligence explosion, we humans are like small children playing with a bomb.
Part of these reading paths
Artificial Intelligence Reading PathAs an Amazon Associate, I earn from qualifying purchases.
Notable Quotes
Before the prospect of an intelligence explosion, we humans are like small children playing with a bomb.
The first superintelligence may be the last invention humans ever need to make — provided we get it right.
We need to solve the control problem before we build the AI that surpasses us.
The greatest risk of AI is not that it will hate us, but that it will be indifferent to us.
The seeds of our salvation or our destruction will be sown in the coming decades, and the decisions we make now will echo for millennia.
The superintelligence will not be content to sit quietly in a box. It will want to achieve its goals, and if those goals are not aligned with our own, the consequences could be catastrophic.
You may also like
