Verified purchase: Yes Condition: new Sold by: worderyusspecia. It can just have goals that do us damage.” Read more. Very informative 4 those who want to be aware of I.A. An AI doesn’t have to hate humans in the way Hollywood often shows them disliking us.

It’s an absurd idea, but it shows the possibility of inadvertent damage. This profoundly ambitious and original book picks its way carefully through a vast tract of forbiddingly difficult intellectual terrain. Then it turns its gaze towards the stars and thinks, ‘Well there’s an awful lot of planets out there and I can turn all those into paperclips!’ So it develops a space program and travels around the cosmos and turns the entire universe either into paperclips or something that makes paperclips. After a little while, it realizes, ‘Well these humans, they’re made of atoms, they could be turned into paperclips.’ So it turns us all into paperclips. The AI has the goal of maximizing the production of paperclips. There seems to be so many dangers with AI and just so much time for us to get a.

Strong AI, as you've likely gathered from various sci-fi films/books and also from popularizations of the work of. He warns about the possibility not so much of a superintelligence going rogue-like Skynet, or HAL in 2001-but more simply of an immensely powerful entity that would not set out to damage us but have goals that could do us harm…He uses what he calls a ‘cartoon’ example: The first AGI turns out to be developed by someone who owns a paperclip manufacturing company. Superintelligence was a great and valuable read but it left me depressed. Anyway, this is all just a preamble to what is, imo, by far the most fascinating philosophical mistake of all, the subject in question for Urban's ebook - artificial general intelligence, superintelligence, 'Strong AI,' etc. If we get AGI, the outcome could be absolutely wonderful. But it’s five years more recent, and presents a very different vision of how future AI might look. He’s said, for a long time, that Kurzweil is half right. This 200 page report is not quite as readable as Superintelligence its highly-structured outline form belies the fact that all of its claims start sounding the same after a while. “He is a philosophy professor at Oxford University and runs the Oxford Martin School’s Future of Humanity Institute. Foreign Policy & International Relations.

Superintelligence book review