Philip E. Tetlock

How Good Is It? How Can We Know?

Expert Political Judgment

Dan Gardner

NEW YORK TIMES BESTSELLER • NAMED ONE OF THE BEST BOOKS OF THE YEAR BY THE ECONOMIST “The most important book on decision making since Daniel Kahneman's Thinking, Fast and Slow.”—Jason Zweig, The Wall Street Journal Everyone would benefit from seeing further into the future, whether buying stocks, crafting policy, launching a new product, or simply planning the week’s meals. Unfortunately, people tend to be terrible forecasters. As Wharton professor Philip Tetlock showed in a landmark 2005 study, even experts’ predictions are only slightly better than chance. However, an important and underreported conclusion of that study was that some experts do have real foresight, and Tetlock has spent the past decade trying to figure out why. What makes some people so good? And can this talent be taught? In Superforecasting, Tetlock and coauthor Dan Gardner offer a masterwork on prediction, drawing on decades of research and the results of a massive, government-funded forecasting tournament. The Good Judgment Project involves tens of thousands of ordinary people—including a Brooklyn filmmaker, a retired pipe installer, and a former ballroom dancer—who set out to forecast global events. Some of the volunteers have turned out to be astonishingly good. They’ve beaten other benchmarks, competitors, and prediction markets. They’ve even beaten the collective judgment of intelligence analysts with access to classified information. They are "superforecasters." In this groundbreaking and accessible book, Tetlock and Gardner show us how we can learn from this elite group. Weaving together stories of forecasting successes (the raid on Osama bin Laden’s compound) and failures (the Bay of Pigs) and interviews with a range of high-level decision makers, from David Petraeus to Robert Rubin, they show that good forecasting doesn’t require powerful computers or arcane methods. It involves gathering evidence from a variety of sources, thinking probabilistically, working in teams, keeping score, and being willing to admit error and change course. Superforecasting offers the first demonstrably effective way to improve our ability to predict the future—whether in business, finance, politics, international affairs, or daily life—and is destined to become a modern classic.

The Art and Science of Prediction

Superforecasting

Since its original publication, Expert Political Judgment by New York Times bestselling author Philip Tetlock has established itself as a contemporary classic in the literature on evaluating expert opinion. Tetlock first discusses arguments about whether the world is too complex for people to find the tools to understand political phenomena, let alone predict the future. He evaluates predictions from experts in different fields, comparing them to predictions by well-informed laity or those based on simple extrapolation from current trends. He goes on to analyze which styles of thinking are more successful in forecasting. Classifying thinking styles using Isaiah Berlin's prototypes of the fox and the hedgehog, Tetlock contends that the fox--the thinker who knows many little things, draws from an eclectic array of traditions, and is better able to improvise in response to changing events--is more successful in predicting the future than the hedgehog, who knows one big thing, toils devotedly within one tradition, and imposes formulaic solutions on ill-defined problems. He notes a perversely inverse relationship between the best scientific indicators of good judgement and the qualities that the media most prizes in pundits--the single-minded determination required to prevail in ideological combat. Clearly written and impeccably researched, the book fills a huge void in the literature on evaluating expert opinion. It will appeal across many academic disciplines as well as to corporations seeking to develop standards for judging expert decision-making. Now with a new preface in which Tetlock discusses the latest research in the field, the book explores what constitutes good judgment in predicting future events and looks at why experts are often wrong in their forecasts.

How Good Is It? How Can We Know? - New Edition

NEW YORK TIMES BESTSELLER WINNER OF THE CMI MANAGEMENT FUTURES BOOK OF THE YEAR AWARD What if we could improve our ability to predict the future? Everything we do involves forecasts about how the future will unfold. Whether buying a new house or changing job, designing a new product or getting married, our decisions are governed by implicit predictions of how things are likely to turn out. The problem is, we're not very good at it. In a landmark, twenty-year study, Wharton professor Philip Tetlock showed that the average expert was only slightly better at predicting the future than a layperson using random guesswork. Tetlock's latest project - an unprecedented, government-funded forecasting tournament involving over a million individual predictions - has since shown that there are, however, some people with real, demonstrable foresight. These are ordinary people, from former ballroom dancers to retired computer programmers, who have an extraordinary ability to predict the future with a degree of accuracy 60% greater than average. They are superforecasters. In Superforecasting, Tetlock and his co-author Dan Gardner offer a fascinating insight into what we can learn from this elite group. They show the methods used by these superforecasters which enable them to outperform even professional intelligence analysts with access to classified data. And they offer practical advice on how we can all use these methods for our own benefit - whether in business, in international affairs, or in everyday life.

Todas as nossas decisões envolvem prognósticos sobre o futuro - agimos com base em previsões implícitas do que provavelmente vai acontecer. O problemaé que costumamos errar muito mais do que acertar. Em um estudo que durou vinte anos, o psicólogo e cientista social Philip Tetlock demonstrou que, ao prever o futuro, um especialista é apenas um pouco melhor do que um leigo. No entanto, com base nos resultados de uma pesquisa inovadora, Tetlock provou que alguns indivíduos têm uma extraordinária habilidade de previsão 60% mais precisa que a média. Superprevisões revela os segredos desse grupo de elite e oferece conselhos práticos sobre como podemos usá-los em benefício próprio.

Superprevisões

Paul M. Sniderman

Joseph F. Fletcher

Peter H. Russell

Why do citizens in pluralist democracies disagree collectively about the very values they agree on individually? This provocative book highlights the inescapable conflicts of rights and values at the heart of democratic politics. Based on interviews with thousands of citizens and political decision makers, the book focuses on modern Canadian politics, investigating why a country so fortunate in its history and circumstances is on the brink of dissolution. Taking advantage of new techniques of computer-assisted interviewing, the authors explore the politics of a wide array of issues, from freedom of expression to public funding of religious schools to government wiretapping to antihate legislation, analyzing not only why citizens take the positions they do but also how easily they can be talked out of them. In the process, the authors challenge a number of commonly held assumptions about democratic politics. They show, for example, that political elites do not constitute a special bulwark protecting civil liberties; that arguments over political rights are as deeply driven by commitment to the master values of democratic politics as by failure to understand them; and that consensus on the rights of groups is inherently more fragile than on the rights of individuals.

Liberty, Equality, and Legitimacy in Pluralist Democracy

The Clash of Rights

Harvard Business Review

Paul J. H. Schoemaker

Robert S. Kaplan

Condoleezza Rice

Is your business playing it safe—or taking the right risks? If you read nothing else on managing risk, read these 10 articles. We've combed through hundreds of Harvard Business Review articles and selected the most important ones to help your company make smart decisions and thrive, even when the future is unclear. This book will inspire you to: Avoid the most common errors in risk management Understand the three distinct categories of risk and tailor your risk-management processes accordingly Embrace uncertainty as a key element of breakthrough innovation Adopt best practices for mitigating political threats Upgrade your organization's forecasting capabilities to gain a competitive edge Detect and neutralize cyberattacks originating inside your company This collection of articles includes "Managing Risks: A New Framework," by Robert S. Kaplan and Anette Mikes; "How to Build Risk into Your Business Model," by Karan Girotra and Serguei Netessine; "The Six Mistakes Executives Make in Risk Management," by Nassim N. Taleb, Daniel G. Goldstein, and Mark W. Spitznagel; "From Superstorms to Factory Fires: Managing Unpredictable Supply-Chain Disruptions," by David Simchi-Levi, William Schmidt, and Yehua Wei; "Is It Real? Can We Win? Is It Worth Doing?: Managing Risk and Reward in an Innovation Portfolio," by George S. Day; “Superforecasting: How to Upgrade Your Company's Judgment," by Paul J. H. Schoemaker and Philip E. Tetlock; "Managing 21st-Century Political Risk," by Condoleezza Rice and Amy Zegart; "How to Scandal-Proof Your Company," by Paul Healy and George Serafeim; "Beating the Odds When You Launch a New Venture," by Clark Gilbert and Matthew Eyring; "The Danger from Within," by David M. Upton and Sadie Creese; and "Future-Proof Your Climate Strategy," by Joseph E. Aldy and Gianfranco Gianfrate.

HBR's 10 Must Reads on Managing Risk (with bonus article "Managing 21st-Century Political Risk" by Condoleezza Rice and Amy Zegart)

Umění a věda předpovídání budoucnosti

Superprognózy

Aaron Belkin

Political scientists often ask themselves what might have been if history had unfolded differently: if Stalin had been ousted as General Party Secretary or if the United States had not dropped the bomb on Japan. Although scholars sometimes scoff at applying hypothetical reasoning to world politics, the contributors to this volume--including James Fearon, Richard Lebow, Margaret Levi, Bruce Russett, and Barry Weingast--find such counterfactual conjectures not only useful, but necessary for drawing causal inferences from historical data. Given the importance of counterfactuals, it is perhaps surprising that we lack standards for evaluating them. To fill this gap, Philip Tetlock and Aaron Belkin propose a set of criteria for distinguishing plausible from implausible counterfactual conjectures across a wide range of applications. The contributors to this volume make use of these and other criteria to evaluate counterfactuals that emerge in diverse methodological contexts including comparative case studies, game theory, and statistical analysis. Taken together, these essays go a long way toward establishing a more nuanced and rigorous framework for assessing counterfactual arguments about world politics in particular and about the social sciences more broadly.

Logical, Methodological, and Psychological Perspectives

Counterfactual Thought Experiments in World Politics

Der Psychologe und Politikwissenschaftler Philip Tetlock gibt in seinem leichtverständlichen Wissenschafts-Sachbuch ›Superforecasting. Die Kunst der richtigen Prognose‹ eine Anleitung für treffsichere Prognosen in einer unsicheren Zeit. »Superforecaster« sind Menschen, denen erstaunlich gute Vorhersagen in allen Bereichen gelingen – bessere als den Experten. Was macht sie so besonders? In einem großangelegten Forschungsprojekt ist Philip Tetlock dieser Frage nachgegangen und hat das Erfolgsgeheimnis der Superprognostiker gelüftet. Anhand anschaulicher und unterhaltsamer Beispiele zeigt er, wie wir alle bessere Prognosen für unser Leben machen können – denn wenn wir darüber nachdenken, eine neue Stelle zu suchen, zu heiraten, ein Haus zu kaufen, Geld zu investieren, ein Produkt auf den Markt zu bringen oder uns zur Ruhe zu setzen, dann hängen unsere Entscheidungen davon ab, was wir von der Zukunft erwarten. Ein wichtiges und nützliches Buch, um sich in einer immer komplexeren Welt besser zurechtzufinden.

Philip E. Tetlock

Books

Your next favorite book is out there