In 2005 Philip Tetlock wrote a book called, "Expert Political Judgment: How Good is it? How can we know?"
To find out, he did something extraordinary. He went back and studied 50 years of writings by various media pundits and commentators who made predictions about politics and economics. Then he carefully tracked the results.
What did he find?
Experts don't do so good.
They were worse than random. As one reviewer noted: "Human beings who spend their lives studying the state of the world... are poorer forecasters than dart-throwing monkeys." It didn't make any difference if they were conservative or liberal.
The reasons for this appalling performance are many.
Reasonable people with modest opinions aren't that much fun to read. People who say outrageous things command more attention. But that doesn't mean they're right. In fact, the wilder they get, they less likely that is.
It's a twist on the old "hedgehog versus the fox" fable. The simple hedgehog knows One Big Thing (how to roll up into a prickly ball and ignore outside threats). The clever fox knows many things.
Most experts are hedgehogs. They fall in love with their own perspectives and are impervious to all the evidence to the contrary. It becomes a kind of arrogance.
Or as H. L. Mencken once said, "For every complex problem there is an answer that is clear, simple, and wrong."
Foxes, on the other hand, are wary of big ideas that explain everything. They are less grandiose.
But foxes make better guesses about the future. The future is nuanced.
People get fooled by their own supposed expertise. They get deeper and deeper into arcane knowledge and think it really tells them something. But Tetlock concluded that more general perspectives - taking into account the information from multiple areas of study, and more than one perspective - gives people a better read on the likely future.
No comments:
Post a Comment