May 21, 2013
Who is Shyster?
Or you can search by:
Most Recent Comments
Sam Zell’s Nightmare Continues (11)
William S. Stevens: 1948-2008 (22)
Teixeira’s Options (18)
Cole Hamels Meets Talk Radio (23)
Appropos of nothing (4)
Shyster's Daily Circuit
Joe Posnanski Blog
Cot's Baseball Contracts
It IS About the Money
Baseball Think Factory
MLB Trade Rumors
Way Back and Gone
Bats -- NYT Baseball Blog
The Biz of Baseball
The Daily Fungo
The Common Man
Jorge Says No!
Baseball Over Here
Thursday, March 05, 2009
Worse than chanceThe biggest danger of the opinion writing business is the risk of tying oneself up in logical and rhetorical knots in order to justify things you wrote days, weeks, or months ago when events in real time render those opinions, well, not entirely correct. Here's some evidence of that:
Writing about Jonah Lehrer's book on decision making in The Sunday Times, I didn't mention the findings of Philip Tetlock at Berkeley. He studied pundits and discovered they were, to a rough approximation, always wrong when making predictions. He took 284 pundits and asked them questions about the future. Their performance was worse than chance. With three possible answers, they were right less than 33 per cent of the time. A monkey chucking darts would have done better. This is consoling. More consoling still is Tetlock's further finding that the more certain a pundit was, the more likely he was to be wrong. Their problem being that they couldn't self-correct, presumably because they'd invested so much of their personality and self-esteem in a specific view.
The above excerpt is about political punditry, but it applies to the sporting press as well. After all, if you praised every move the Mudville Nine made in the offseason, it's going to be really hard not to pick them as your favorites when you sit down to write that preseason picks column. And if you pick them as your favorites and they stumble out of the gate, it can be very difficult to assess their problems in an objective fashion rather than write that "there's still time, they look strong!" piece. The same goes for opinions about steroids and business and everything else about which we self-appointed experts spew.
Which is why I try to throw so many jokes in with the posts. I mean, there's gotta be something you can count on around here.
(link via Sullivan)
Posted by Craig Calcaterra at 2:41pm
Sara K said...
“certain a pundit was, the more likely he was to be wrong. Their problem being that they couldn’t self-correct, presumably because they’d invested so much of their personality and self-esteem in a specific view.”
You can replace “pundit” with virtually any personal noun and be dead-on. Lord knows it’s true of college freshmen in English courses, which is why one of my classroom mantras is “confusion often represents an advanced state of understanding.”
Posted 03/05 at 05:59 PM
Wrong significantly more than chance? If these are binary outcome predictions, I could imagine this information would be pretty useful. If you just take their predictions with the knowledge that they’re actually the opposite, you’re right 70% of the time. Those are pretty good odds.
Posted 03/06 at 12:10 PM
Page 1 of 1
Commenting is not available in this weblog entry.
Next Post: Today at THT>> <<Previous Post: Your early afternoon non-baseball post