ADVERTISEMENT
  About the SA Blog Network













Why Math is Like the Honey Badger: Nate Silver Ascendant

The views expressed are those of the author and are not necessarily those of Scientific American.


Email   PrintPrint



“Neglect of mathematics works injury to all knowledge, since one who is ignorant of it cannot know the other sciences, or the things of this world. And what is worst, those who are thus ignorant are unable to perceive their own ignorance, and so do not seek a remedy.” — Roger Bacon

It’s no secret that lots of people hate and fear any kind of math. I certainly spent much of my life fighting a kneejerk inward cringe at the mere sight of an equation, and many of the folks I spoke with while writing The Calculus Diaries had even more extreme reactions. They talked about sweaty palms, cold sweats, and a cold knot of dread in the pit of their stomachs when encountering anything to do with numbers. Per my friend Lee, who initially failed her high school algebra class: “It wrecked my self-confidence in a way nothing else ever did, and still knots my stomach. I’m not totally innumerate, but anything that looks like an equation makes me break out into a cold sweat and run screaming in the other direction.”

Another friend, Allyson, was even more blunt: “My initial reaction to the word ‘calculus’ is not unlike a caveman throwing rocks at the moon in ignorance and fear resulting in blind rage. There is no such thing as ghosts creeping up behind me on the stairs, but there is such a thing as a polynomial monster, and it has hooked teeth and causes chronic yeast infections, I’m sure.”

I can’t speak to the yeast infections, but a new psychological study indicates that such reactions do have real, measurable physical effects. Specifically, when it comes to neural responses, math anxiety reads much the same as physical pain. It’s not the numbers themselves, but the anticipation of encountering them, that seemed to trigger anxious, painful responses in the test subjects.

There are many complicated reasons why people react this way, but one of them might be the fact that math is just so damned unyielding, the enemy of wishful thinking, dashing our most cherished hopes with its cold hard facts. And is it sorry? It is not! Like the infamous honey badger, math don’t care. Math don’t give a s$%.

Also like the honey badger, math has shown itself to be quite the badass of late. If ever there was an iron-clad case to be made for math literacy, it’s what happened over the last few weeks with the New York Times‘ star statistician Nate Silver and his 538 blog (named after the 538 votes in the electoral college).

For the 0.1% of you who don’t know Silver’s name by now, he started out analyzing the statistical probabilities of baseball teams, then turned his attention to the 2008 presidential elections. He devised a fairly sophisticated mathematical model that didn’t just rely on a few public opinion polls here and there, but fed all the polls into the model, with additional tweaking to eliminate the inevitable sampling errors. And the results were pretty darned impressive: he correctly called 49 out of the 50 states and many of the Congressional races that year as well.

Fast forward to the 2012 presidential election, when most pundits were describing the race as a veritable toss-up between Mitt Romney and Barack Obama. As partisan tensions rose, Silver’s forecast became a handy target, because his models consistently gave Obama much better statistical odds than the general punditry at winning re-election. Even at the low point of the Obama campaign, in the aftermath of that first debate, Silver’s model still gave the president around a 66% chance of re-election — largely based on his rigorous analysis of polling trends in critical battleground swing states. A week before Election Day, those odds increased to around 75%, rising steadily to a final prediction of 90.9%.

This was in stark contrast to the conservative punditry, who seemed to be inhabiting a bizarre alternate reality where Romney held a slight lead and was poised to win many of the battleground states. George Will, Peggy Noonan, Newt Gingrich, Fox News’ numbers guy Michael Barone, and GOP strategist Karl Rove all predicted a solid Romney win, breaking 300 electoral votes and winning the popular vote, while Dick Morris hopped on the crazy train and predicted a Romney landslide. (Hey, someone‘s gotta take the longshot odds!)

How to explain the discrepancy? The conservatives went on the offense, attacking Silver’s analysis as hopelessly biased — everyone knew, they said, that Silver was “in the tank” for Obama — and overly reliant on polls skewed in favor of Obama.  This last accusation even inspired a separate Website, Unskewed Polls, purporting to be an unbiased analysis — shades of Fox News’ laughable “fair and balanced” tagline. (Huh. Conservatives didn’t have a problem with Silver’s 2010 prediction of major gains for the GOP in the House, which also proved to be highly accurate.)

The attacks got pretty personal, with David Brooks calling Silver “over-rated,” MSNBC’s Joe Scarborough dismissing him as an ideologue and “a joke,” and even Politico’s Dylan Byers pondering whether Silver was “a one-term celebrity” — as if it was his name recognition, rather than the numbers, that mattered. And the Unskewed Polls founder, Dean Chalmers, sneered in The Examiner that Silver was “a man of very small stature, a thin and effeminate man with a soft-sounding voice that sounds almost exactly like the ‘Mr. New Castrati’ voice used by Rush Limbaugh on his program.”

Honestly, what could a scrawny, liberal-intellectual girly-man with a reedy voice really tell us about such a close election, relying on something as magically intangible as numerical wizardry? Silver channeled his inner honey badger and handled the backlash admirably, ably defending his statistical methodology against the charges of wizardry and partisan bias, and cheekily responding to his detractors on Twitter.

(My favorite Silver tweet, after the massive storm, Sandy, devastated New York and New Jersey: “”CAN’T BELIEVE METEOROLOGISTS USED MATH AND SCIENCE TO PREDICT THIS STORM. THEY MUST BE MAGIC WIZARDS.”

He kept chugging away at his predictive model, feeding in the daily poll numbers and crunching the data, accounting for confounding factors and potential sources of bias, trusting in teh math over the gut instincts of the punditry. As many others have pointed out, there was a great deal of ignorance of statistical probabilities — and the nature of uncertainty — behind much of the Silver criticism (not that there aren’t valid things to criticize in his model, but bitching about his reedy voice and slight built aren’t among them).

Clearly, that widespread antipathy towards all things numerical plagues some otherwise very smart people. But the outcry was as much part of the rampant anti-intellectualism that dominates certain circles in our society. In a post at Deadspin, David Roher opined, “It was only a matter of time before the war on expertise spilled over into the cells of Nate Silver’s spreadsheets.” Stephen Colbert memorably said reality has a well-known liberal bias; apparently that bias extends to math.

(For those keen on knowing more details, Zeynep Tufekci of the University of North Carolina offered one of the best defenses of Silver and statistical modeling methods at Wired: check it out.)

Silver is not an oracle, and has never claimed to be, so the over-reaction was just plain silly. Sure, by late October 538′s models favored Obama 79% to 21%, when the national polling averages were indicating a dead heat. But any good poker player will tell you that a 21% favored hand wins quite frequently — i.e., 21% of the time. In fact, Silver himself used the poker metaphor in his last post before Election Day, estimating Romney’s chances of winning the election as being roughly the same odds as drawing in inside straight:

[I]n poker, making an inside straight requires you to catch one of 4 cards out of 48 remaining in the deck, the chances of which are about 8 percent. Those are now about Mr. Romney’s chances of winning the Electoral College, according to the FiveThirtyEight forecast.

As any poker player knows, those 8 percent chances do come up once in a while. If it happens this year, then a lot of polling firms will have to re-examine their assumptions — and we will have to re-examine ours about how trustworthy the polls are. But the odds are that Mr. Obama will win another term.

He later slightly revised those odds to give Romney a 9.1% chance of an upset — largely to account for just the sort of pro-Obama potential bias in the polls that his critics had been braying about. So how’d Silver do in predicting the actual election? Check it out:

Boo-yah!  Behold the data, for it is mighty! Silver correctly predicted 50 states out of 50, and even nailed the popular vote within a few tenths of a percentage point. When the graphic above hit Twitter, Alaska’s returns hadn’t been recorded, but it went, as predicted, to Romney. The sole genuine toss-up state, Florida — which Silver had at 50/50 odds — is still technically not final (as of  5 PM EST on Wednesday, November 7), waiting on votes from Miami-Dade county, which heavily favors Obama, who already holds a slight lead. It’s expected Florida will also land in Obama’s column, so Silver’s controversial last-minute switch of Florida from light pink to light baby blue was justified. (To see how all the others fared, check out this graph.)

Plus his book sales are skyrocketing, he’s well poised to negotiate an even more lucrative contract with the Times, and he’s inspired his own Chuck Norris style Twitter hastag, #NateSilverfacts. (My favorite so far: “When criticized by pundits, Nate Silver doesn’t get angry – he regresses toward the mean.”) Oh, and one satirical Website proclaimed Silver a witch. One imagines an elated Silver dancing Gangnam style in his office digs, thoroughly vindicated by the election returns — although it’s more likely that he collapsed in exhaustion, given his feverish frequency of updates over the last few weeks. But he’s certainly earned to the right in indulge in a bit of Schadenfreude.

That was just the presidential race, of course. I haven’t seen a full assessment of his predictions for other races, but there was at least one major upset in North Dakota, when Heidi Heitkamp (not Heitberg, a typo in the original post) narrowly edged out opponent Rick Berg, despite Silver giving the latter a 92.5% chance of re-election.

And he missed on a Montana race, too, where the Democratic candidate handily won, although Silver gave his Republican opponent a 66% chance of winning (although there were far fewer Montana polls, and hence not as large of a data sample). So, yanno, the guy’s not perfect. That’s statistical uncertainty for you.

Still, to quote a classic xkcd comic: SCIENCE! It works, bitchez! The math doesn’t care what you want to be true: it calls it like it sees it, denialism be damned. The honey badger heartily approves.

xkcd's Randal Munroe nails it. As always.

Which is why it was so fascinating to watch the election coverage meltdown on Fox News as the numbers came rolling in: denialism crashed head-first into numbers-based reality and popped the conservative punditry bubble. The cognitive dissonance was palpable.  (As Steve Mirsky noted on Twitter, “Fox News is having a psychotic break.)

Rove actually objected on-air when Fox’s independent election analysts called the race for Obama, insisting Romney still had a fighting chance in Ohio.  Anchor Megyn Kelly marched down the hall to the analysts’ desk and demanded an explanation.

To their credit, the analysts (who had done the math) didn’t back down: “We’re actually quite comfortable with the call.” And of course, the analysts were right, something Rove — a smart, math-minded guy in his own right, when he’s not blinded by partisanship — grudgingly conceded in the end. (So did Barone,  Gingrich, and Morris.)

So is Nate Silver the new God of the Geeks? Should we all bow down to our thin, effeminate Mathematical Wizardry Overlord? Not so fast. As several folks pointed out this morning, Silver certainly wasn’t the only poll-savvy statistician with heavy odds favoring an Obama re-election — most notably, Sam Wang’s Princeton Election Consortium gave Obama 98% odds of re-election. He was just the most visible.

Silver’s gift is combining rigorous statistical modeling with a savvy populist approach. But he did bear the brunt of the criticism, so it’s only fair he reap the requisite rewards. Ironically, Silver also predicted the post-election reaction to his analysis, in an interview with Buzzfeed: “I’m sure that I have a lot riding on the outcome. I’m also sure I’ll get too much credit if the prediction is right and too much blame if it is wrong.”

The real winner wasn’t Silver, but the math. The 2012 election was a real-time experiment in the accuracy of statistical modeling, and it passed with flying colors. That doesn’t mean there still isn’t room for improvement, or that such models are infallible, but the fundamental principles are solid. For now. Call it the triumph of the nerds. I doubt we’ve seen the end of denialism, by a long shot, but it’s nice when, once in awhile, scientific rigor gets a big win.

 

Jennifer Ouellette About the Author: Jennifer Ouellette is a science writer who loves to indulge her inner geek by finding quirky connections between physics, popular culture, and the world at large. Follow on Twitter @JenLucPiquant.

The views expressed are those of the author and are not necessarily those of Scientific American.





Rights & Permissions

Comments 9 Comments

Add Comment
  1. 1. mikeprocario 8:44 pm 11/7/2012

    I enjoyed the article. I will be posting links on Facebook and Twitter. I was arguing with daughter about the practical aspects of math, but she wants to be a writer.

    Link to this
  2. 2. Azuaron 9:13 pm 11/7/2012

    Criticizing Nate Silver because, of dozens of races, two came out the other way is silly. That kind of variability is predicted by the model. A 2/3 prediction of winning is like rolling a die and trying to get 1-4; 33 of 100 times you’re going to come up 5 or 6.

    In fact, if a couple races didn’t go the other way, I would be perfectly comfortable calling Nate Silver a practitioner of black magic, because at that point, it’s no longer statistics.

    Link to this
  3. 3. daktari 12:48 am 11/8/2012

    I had math horror until I was 30, interesting to bump into fellow sufferers. Like any of these things, once it’s gone, it’s hard to remember why it was so awful. I thought there was something actually wrong with me, something shameful and confusing and though I could pretend that it was because I just didn’t try in fact I was terrified that if I did try it would only prove that I was deficient.

    Interesting also to see that Limbaugh is still doing the “little gay dweeb libbie” voice. He’ll take his schtick to the grave with him I guess.

    Link to this
  4. 4. stargene 2:45 am 11/8/2012

    Thanks for a good article. The ad-hominem attacks by
    today’s far right against Mr. Silver and everyone else
    who dares challenge the right with ‘mere’ facts and
    logic have become truly sickening and dismaying. We
    haven’t seen such appalling tactics since the Third
    Reich and Stalinist Russia. A venomous hatred, contempt
    for ‘the other’, and the most narrow provincialism seem
    to have seized the minds of many whites in Middle-
    America, shriveling their hearts, propelling them toward increasingly violent solutions to all issues.

    In addition to actual physical violence toward The
    Other, we must include the violence of increasing
    poverty, slashing public education, vilifying teachers
    and other workers as ‘the shiftless, parasitic 47%’,
    sewing hatred and paranoia about minorities, women
    and science itself.

    As the great lawyer in the film classic “Inherit the
    Wind” says at one point, “…hatred and ignorance are
    forever busy, and need feeding.”

    Link to this
  5. 5. Bill Lasley 2:17 pm 11/8/2012

    It may be easier to reform children than reform the educational system. For example; https://www.facebook.com/groups/247514481932070/doc/290937107589807/

    Link to this
  6. 6. dregstudios 7:47 pm 11/8/2012

    Despite all odds, our President prevailed. He still has an uphill battle fighting a Red House which has blocked his every move in an attempt to squash his goals of bringing the Middle Class equal pay, women’s rights, gay rights and affordable healthcare. The Bush Administration drove our economy into a swift nose dive and Obama is still the patsy. Watch conservative hands paint him in Blackface with a visual commentary of how Barack has been bamboozled at http://dregstudiosart.blogspot.com/2012/10/bamboozling-obama.html

    Link to this
  7. 7. Kagehi 10:50 pm 11/8/2012

    “I thought there was something actually wrong with me, something shameful and confusing and though I could pretend that it was because I just didn’t try in fact I was terrified that if I did try it would only prove that I was deficient.”

    A lot of it may be how we teach math. I recently got a kindle copy of something called Calculus Direct, by John Weiss, which goes from very basic math, all the way up to basic differential equations. I did, eventually, hit a point where I had to actually pick up pad and paper, and try to work out what was going on, so, since I was reading at work, on breaks, couldn’t follow as well, but I learned some things anyway, which I flat out never got to in school.

    Funny thing is, being a computer programmer, my reaction to the point where it started talking about functions, it was, “Damn.. I already know this. I use precisely that sort of thing all the time, just that what gets “returned” isn’t always a number, or even uses math.

    Math in school, by comparison, is, “Here is an equation, and a vague idea of what its used for, we hope you actually comprehend how this thing came out of the prior things you learned last year.” And, if you can’t see the logic of going from, say, certain bits of geometry, to plotting a line, using algebra, never mind how that connects, at all, to calculus….

    Link to this
  8. 8. Peter Tibbles 1:15 am 11/11/2012

    I’ve never understood this antipathy to maths (sorry, I can’t come at this silly Americanism “math”). Okay, I’ll say up front that it’s the subject in which I received my degree.
    I guess maths, like all science, has a “liberal bias”. It’s really another example of “you’re entitled to your own opinion, but not your own reality”.

    Link to this
  9. 9. markorman 11:38 am 11/14/2012

    The anti-Obama rhetoric from the right prior to the election was incredible, more so than in any election I can remember in my lifetime. I wasn’t certain that I would vote for him up to the last few days or so (reservations about his foreign policy), but I was flabbergasted to receive an email from a family connection that showed a red hammer and sickle with the caption that the Communist Party had endorsed Obama, and didn’t this make it obvious where he was coming from (he’s a Communist!) Interestingly, haven’t heard a peep from these types since; they’re apparently too busy licking their wounds. Watching the election proceed in the last week or so, and seeing Silver’s ass being put on the line in the public media each day with the outcome (that is, of Silver’s ass) uncertain made for an interesting side drama. Don’t know that he’ll be right next time, but it was quite the spectacle.

    Link to this

Add a Comment
You must sign in or register as a ScientificAmerican.com member to submit a comment.

More from Scientific American

Scientific American Back To School

Back to School Sale!

12 Digital Issues + 4 Years of Archive Access just $19.99

Order Now >

X

Email this Article



This function is currently unavailable

X