Recipe for Failure

Why Copenhagen will be a bust, and other prophecies from the foreign-policy world's leading predictioneer.

BY BRUCE BUENO DE MESQUITA | NOVEMBER/DECEMBER 2009

The phone call about India got me thinking that maybe war and peace decisions really aren't that different from everyday political confrontations. Sure, the stakes are higher -- people get killed in wars -- but then any politician seeking office sees the personal political stakes as pretty darn high. Intrigued, I grabbed a yellow pad and listed everyone I thought would try to influence the selection of India's next government. For each of those people (political party leaders, members of India's parliament, and some members of critical state governments), I also estimated how much clout they had, what their preference was between the various plausible candidates for prime minister, and how much they cared about trying to shape that choice. With just one page of my yellow pad filled with numbers, I had all the information the computer needed to predict what would happen, so I plugged it in and awaited the results.

My "expertise" had led me to believe that longtime parliamentary leader Jagjivan Ram would be India's next prime minister. He was a popular and prominent politician who was better liked than his main rivals for the prime minister's job. I was confident that he was truly unbeatable. He had paid his political dues and it seemed like his time had come. Many other India watchers thought the same thing. Imagine my surprise then when my computer program, written by me and fed only with my data, predicted an entirely different result. It forecast that Charan Singh would become prime minister, that he would include someone named Y. B. Chavan in his cabinet, and that they would gain support-albeit briefly-from Indira Gandhi, then the recently ousted prime minister. The model also predicted that the new Indian government would be incapable of governing and so would soon fall.

I found myself forced to choose between my personal opinion -- that Ram would win -- and the logic and data behind my model. In the end, I chose science over punditry. When I relayed my findings to the State Department official, he was taken aback. He noted that no one else was suggesting this result and that it seemed strange at best. When I told him I'd used a computer program based on a model of decision-making that I was designing, he just laughed and urged me not to repeat that to anyone.

Related

No Will, No Way

Bueno de Mesquita projects a decline in global willingness to regulate greenhouse gases.

A few weeks later, Charan Singh became the prime minister with Y. B. Chavan as his deputy prime minister and support from Indira Gandhi. And a few months after that, Singh's government unraveled, Gandhi withdrew her backing, and a new election was called, just as the computer model had forecast. This got me pretty excited. But had I just gotten lucky, or was I onto something?

I set out to push my model by testing it against wide-ranging questions about politics and economics. I applied it to prospective leadership changes in the Soviet Union, questions of economic reform in Mexico and Brazil, and budgetary decisions in Italy. The model worked so well that it eventually led to a grant from the Defense Advanced Research Projects Agency, a research arm of the U.S. Defense Department. darpa gave me 17 issues to examine, and as it happened, the model -- by then somewhat more sophisticated -- got all 17 right. According to a declassified cia assessment, the predictions for which I've been responsible over the years have a 90 percent accuracy rate.

This is not a reflection of any great wisdom or insight on my part-- I have little enough of both. What I do have is the lesson I learned back in 1979: Politics is predictable. All that is needed is a tool, like my model, that takes basic information, evaluates it by assuming people do what they think is best for them, and produces reliable assessments of what they will do and why they will do it.

However reliable my model has proven, though, it still represents a radical departure from the way most "experts" shape decisions about international affairs. Most diplomats, for example, remain convinced that a country's name is an important variable that helps explain behavior. That's why the State Department continues to be organized around country desks, just as the intelligence community is organized around geographic regions. Leaders of multinational corporations take much the same view. When they have a problem in Kazakhstan, they call their guys in Kazakhstan to find out what to do. That seems eminently reasonable. Yet it is terribly inadequate for solving most problems.

 SUBJECTS: GLOBAL WARMING
 

Bruce Bueno de Mesquita is a professor of political science at New York University and author of The Predictioneer's Game, from which this article was adapted.

PTDF

6:34 PM ET

October 23, 2009

1. China and India may show

1. China and India may show higher support for an agreement with differentiated commitments from developed and developing countries.
2. The relative power of nay-actors will increase throughout the century, but that won't stop NGO pressure and concrete climate change impacts from influencing their position.
3. Wouldn't stagnation in emission controls be more likely than actual reversion?
4. After China and India, 1/3 of the human population, the next wave of emerging countries will be relatively small and more easily controlled. Can there still be hegemonic wars in the nuclear age?
5. Climate change will be a net benefit perhaps to countries around the arctic circle. That's it. All others will suffer losses from more extreme weather. There is no reason to expect a beneficial reallocation of renewable energy resources. These impacts will be a strong incentive for innovation - but wouldn't it be smarter to act on these incentives right now?

 

PIOTR WADAS

10:39 PM ET

October 24, 2009

good point

The model is quite simple, I guess. And it just works, like fuzzy logic, or google.
But - "New technologies will solve the problem for us" - just go and put a question "What kind of really new technology will appear and approx. when (in tens of years) it will appear?". Now, think about new cars, then about new windows system, then about new regulations in general, what kind of new technology we can expect? Regarding new technology, actually, look on Harley-and-Buell issue, or Oracle-and-Virtual-Iron issue. More - try to predict how the government's expenses on they're own living and its bureaucracy will behave.
I'd recommend Asimov's "Foundation", and Huxley's "The great new world".
Have a nice reading.. I really hope "new technology" appear, and even, someone like you - or me - will invent it. I have doubts, unfortunately.. anyway, giving up is not the strategy.
Qui vivre, verra, I guess ;-)

 

SLG

5:37 AM ET

October 25, 2009

What an excellent defense of area studies!

So what we learn is that a little bit of theoretical rigor- of the sort most social sciences bring- is a useful way to structure an enormous amount of data! We learn that knowing the preferences and chosen strategies of a large number of actors, indeed knowing who the relevant actors are, makes it much easier to work out what will happen. Um, yeah.

That's no manifesto for game theory, or BdM's charming attempt to produce superfreakpoliticalscience. It's called social science: know your stuff and then use theoretical tools to say meaningful, generalizable things. BdM's chosen form of theoretical tool is game theory, which brings costs and benefits (the benefits are in analyses of decisions, which is why it's useful in thinking about decisions). He also happens to be quite good at the data collection, which is why he gets useful places with game theory that is not all that sophisticated.

The economists- not to mention a horrible virus that was in the water in Rochester a few decades back- have taught us that this operation (called social science) must be done with enormous hubris. They sound like Comte in the history of sociology and will seem just as strange in a decade or two. But Walt was right: game theory has added very little that Max Weber didn't know.

I congratulate BdM on graduating from journalism to social science in his conversation with the State Department official, but he really shouldn't be trying to turn himself into the LTCM of politics. If nothing else, it undersells his own impressive interviewing skills and will produce many more misguided PhD students who buy the line that knowing the game theory beats knowing the facts.

 

BGARD6977

11:45 AM ET

October 25, 2009

Errors

..."and I can prove it" -- A computer model is not a mathematical proof.

Game theory proven mathematical fact, and as such it should be a welcome addition to the tools available to policy makers. I do not think however that it should replace local expertise. Someone has to put the numbers into the model, and no one knows the situation better that the "troops on the ground".

If Mr. Bueno de Mesquita really believes that his model will help alleviate global suffering, he should release the source code to his model for peer review. If such a thing really has benefit, then we should be putting it in the hands of every state department official.

With some modest web searching, I've found no links to Mr. Bueno de Mesquita's model. The results are typically fascinating but sensationalistic news stories like this one.

 

DT

3:18 PM ET

October 25, 2009

Game Theory Approach

I think it is telling that you begin your process by grabbing a "yellow pad" and write down "how much clout they [the actors] had, what their preference was between the various plausible candidates for prime minister, and how much they cared about trying to shape that choice". So, the starting numbers for your computer model are totally subjective, even if the model itself is rigorous. It follows that your entire approach is based upon the (unstated) assumption that the initial data on your "yellow pad" is easier to quantify/estimate than final outcomes. local expertise is still vital to your process, but you use it in an unorthodox way.

 

JONOROM

3:43 PM ET

October 25, 2009

Huh?

Perhaps I am missing something, but I cannot find where you have included GLOBAL WARMING in your calculations. Do you believe that facts do not influence political decisions? Are the lives and needs (AND decisions) of the peoples of the earth factored into your calculations?

I assume you are aware that some scenarios (see for example http://arxiv.org/abs/0804.1126 ) developed by our best scientists include the possibility of sea level rises of meters in this century. Do you think the effects of global warming will not change how decision-makers act?

 

JOHNUW93

7:02 AM ET

October 27, 2009

Peak Oil

It appears the model is missing the fact that oil is a finite resource. Climate change aside, the world will have to move to other forms of energy eventually (depending on when one things peak oil has or will occur) due to lack of low-cost fossil fuels to burn. Sure, there will be plenty of coal still, but we can hardly run today's economy on coal.

The model is predicting the emissions standards in international treaties, but the entire question may well be irrelevant in fifty years.

 

OCHIENG100

5:44 AM ET

November 13, 2009

How do we factor in the

How do we factor in the simulation the act of God?