Stuart Armstrong

What happens when machines become smarter than us? Forget images of Terminators and Cylons: artificial intelligences (AIs) will achieve power through their intelligence, not brute strength. Just as humans shape the world in ways beyond the understanding of chimpanzees, AIs will shape our world, transforming it--whether slowly or blindingly fast--into whatever they are programmed to prefer. The future could be filled with joy, art, compassion, and beings living worthwhile and wonderful lives--but only if we're able to precisely define what a "good" world is, and skilled enough to describe it perfectly to a computer program. Philosophers have tried for thousands of years to define the ideal world, with little to show for it. The prospect of artificial intelligence gives this project a new urgency. Our values are fragile: miss a single piece of the puzzle, and the whole system collapses into a world empty of worth. And then comes the daunting task of encoding the entire system of human values for an AI: explaining them to a mind that is alien to us, defining every ambiguous term, clarifying every edge case. AIs, like computers, will do what we say--which is not necessarily what we mean. Though an understanding of the problem is only beginning to spread, researchers from fields ranging from philosophy to computer science to economics are working together to conceive and test new approaches. The problem of AI safety isn't easy, but it is solvable. Are we up to the challenge?

The Rise of Machine Intelligence

Smarter Than Us (Print)

James Miller

Victor Callaghan

Roman Yampolskiy

This volume contains a selection of authoritative essays exploring the central questions raised by the conjectured technological singularity. In informed yet jargon-free contributions written by active research scientists, philosophers and sociologists, it goes beyond philosophical discussion to provide a detailed account of the risks that the singularity poses to human society and, perhaps most usefully, the possible actions that society and technologists can take to manage the journey to any singularity in a way that ensures a positive rather than a negative impact on society. The discussions provide perspectives that cover technological, political and business issues. The aim is to bring clarity and rigor to the debate in a way that will inform and stimulate both experts and interested general readers.

Stuart Armstrong

Books

Your next favorite book is out there