ADVERTISEMENT
  About the SA Blog Network













Guest Blog

Guest Blog


Commentary invited by editors of Scientific American
Guest Blog HomeAboutContact

Is High Ability Necessary for Greatness?

The views expressed are those of the author and are not necessarily those of Scientific American.


Email   PrintPrint



As soon as I saw the headline “Research sheds light on origins of greatness” , my interest was piqued. The article is referring to a new paper in Current Directions in Psychological Science, so I immediately downloaded that paper and left the press release open to the side. I’m wary of press releases with these sorts of headlines so best to go right to the source. Scanning the paper, which is coauthored by David Z. Hambrick and Elizabeth J. Meinz, I realize it’s a summary of research they’ve already conducted (some published, some not). As I read about their studies I noticed that not one of them actually looked at greatness.

In a nutshell, their impressive body of research shows that working memory—the ability to simultaneously hold information in memory while processing other information—is correlated with performance on different “complex tasks” in the laboratory, including remembering baseball information, Texas Hold’em poker performance (their manuscript on this topic is submitted for publication), memory for the movement of spaceships and baseball players, and piano sight-reading performance. What’s more, working memory performance is still correlated with these “complex tasks” even among individuals with high levels of specific experience and knowledge for the domain. Hambrick and Meinz conclude “although deliberate practice may well be necessary to reach a very high level of skill, it is not always sufficient.

I thought about this statement, and how the media interpreted it. Something just didn’t feel right. It seemed like they were setting up a straw man. Who really thinks that deliberate practice is completely sufficient for greatness? As if it’s even a possibility that we’re just machines, and the only thing we do is input knowledge and export greatness. Surely Hambrick and Meinz meant that deliberate practice might not be sufficient without accompanying high ability, not that deliberate practice might not be the only factor contributing to greatness. Even Anders Ericsson and his colleagues—who study the importance of deliberate practice for attaining elite performance— would have to admit that other factors come into play, such as inspiration, motivation, passion, perseverance, mindset, and self-belief. Environmental circumstances also of course play a huge role, as does just plain luck (i.e., being in the right or wrong place at the right or wrong time).

So I decided to flip the question on its head. The most interesting question isn’t whether deliberate practice is both necessary and sufficient for elite performance, but whether high ability is necessary for greatness. My reading of the literature is that Ericsson’s specific argument is that (with the exception of innate constraints on body size and height) genetic endowment doesn’t put limits on the ultimate level of elite performance healthy individuals are capable of attaining. This is a different question than asking whether differences in ability contribute to differences in elite performance. Genes contribute to all of our traits (including our tendency for perseverance), and all of our traits contribute to our greatness. But this doesn’t mean that our genes necessarily constrain our potential for greatness.

The correlations found by Hambrick and Meinz, which were far from perfect, suggest that ability contributes to greatness, not constrains it. Take their study on piano sight-reading skill. They found that deliberate practice was correlated .67 (p < .01) with sight-reading performance, while working memory was only correlated with sight-reading skill .28 (p < .05). After looking at both variables simultaneously (in a regression model), they found that deliberate practice accounted for about half of the differences (45.1%) in sight-reading performance whereas working memory accounted for an additional 7.4% of the differences in sight-reading performance above and beyond deliberate practice.

A few things to note:

- The researchers call this 7.4% increase in prediction “significant”. While they are referring to significance in the statistical sense, keep in mind that we’re talking about explaining differences. The correlation between working memory and sight-reading was .28, so 7.8% of the differences in sight-reading were explained by working memory. This means that 92.2% of the differences in sight-reading skill were not explained by differences in working memory performance. I’d say 92.2% is much more “significant” than 7.8%, at least in terms of practical meaning!

- Deliberate practice explained a much larger (45.1% vs. 7.4%) amount of the differences in sight-reading performance compared to working memory when both variables were looked at simultaneously. The facts are quite different than the media would have us believe. Look at this headline, from Psych Central: “Key to Greatness is Working Memory, Not Practice”. First of all, their studies actually show that both working memory and practice contribute to differences in performance, not one or the other. Second of all, we already determined that their studies don’t actually involve greatness. Third of all, practice is actually a much better predictor of “complex task” performance than working memory. That headline is wrong on so many levels, I could hurl!

So again I ask: is high working memory necessary for greatness?

To explore this question, I decided to look at a dataset I already had sitting on my computer. A few years back I went to Cambridge, England and administered psychological tests on high school (“Sixth Form”) students as part of a larger study I was conducting. I had measured working memory using the Operation Span Task), which asks participants to remember words while simultaneously verifying whether easy mathematical equations are correct (e.g., “Is 2 + 4 =6?”). Working memory can become more burdened by increasing the number of words to remember. The minimum number of words I had participants remember was 2, and the maximum was 6. It’s actually pretty darn difficult to keep that many words in your head while you’re also processing math equations!

I also assessed creative achievement across 10 different arts and sciences domains (Visual Arts, Music, Dance, Architectural Design, Creative Writing, Humor, Inventions, Scientific Discovery, Theater and Film, and Culinary Arts) using the Creative Achievement Questionnaire. For each domain, participants had to check off their level of achievement. For instance, for Inventions, the scale ranged from “I do not have recognized talent in this area” to “I have sold one of my inventions to a manufacturing firm”. While these were just high school students, some had accomplished quite a bit (this may have to do with the intense specialization of the British school system).

Once I dug into my data, I realized a few things that make this analysis very tricky. Working memory and greatness have very different distributions in the general population. Hambrick and his colleagues can find linear correlations because they are comparing two different variables that are both normally distributed. Any complex cognitive task that is administered in the laboratory is probably going to be normally distributed (and is also going to have a good chance of being positively correlated with each other, as well). Greatness, on the other hand, is a whole other ball of wax.

By definition, greatness is rare; only very few people reach greatness in any domain. Greatness is also combinatorial: as already mentioned, it consists of many, many traits and environmental influences that interact. Sight-reading skill may contribute to musical greatness, but musical greatness is much, much more than sight-reading skill! And anyway, sight-reading skill isn’t even necessary for musical greatness. Lots of great musicians—especially jazz musicians—can’t even read music. Some, like Ray Charles, even have learning disabilities that physically prevent them from sight-reading music.

To illustrate the different distributions of working memory and greatness, I plotted some graphs. Here’s the distribution of working memory scores in my sample of 177 British high school students:

See how it conforms pretty well to the bell curve? This is roughly what a normal distribution looks like.

Now let’s look at the distribution of greatness:

See the difference? Greatness is not normally distributed among the students in my sample (this distribution is similar to what others looking at creative achievement have found). Consistent with the idea that greatness is rare, greatness scores are highly skewed to the right. Most people fall within a particular range, and only very few are at the very right of the tail. Again, this is because greatness is combinatorial, comprising many different traits and environmental conditions that interact with each other. It’s a lot easier to memorize information or sight-read music if you’re a professional musician than it is to be a great musician!

The differing distributions make my analysis tricky because whatever relationship between working memory and greatness does exist, it ain’t gonna be all that linear. So I did the best with what I had and calculated my correlations using a Spearman rho rank correlation coefficient).

What did I find? Lo and behold, working memory was not statistically significantly correlated with total greatness scores. So I looked at separate domains. Things weren’t looking too promising here either; working memory didn’t correlate with creative achievement in most domains (which were mostly focused on the arts). That is, until I got to scientific discovery. Aha—a significant correlation! Very small (ρ= .16), but statistically significant nonetheless. (I should note that while the correlation between working memory and music creative achievement was not statistically significant, the correlation did approach statistical significance).

So I zoomed in on scientific discovery, by making a scatterplot of the relationship between working memory scores and scientific discovery greatness scores. Here it is:


Like the total greatness scores, scientific discovery is also highly skewed to the right. 88.1% of all my participants fit within levels 0 and 1 of scientific discovery greatness. In fact, 97.2% fit within levels 0-4. As suspected, whatever linear relationship does exist is very minimal. Those circles to the right seem mighty lonely, don’t they?

Those aren’t just circles, by the way. Each one represents a different participant—a unique living, breathing, human being, to be exact. There were 177 total human beings in my sample, and each circle represents their level of working memory and greatness for scientific discovery. See all those circles at the top left corner? That’s right, those represent the slackers—the ‘underachievers’, some would say. Their working memory scores are high, but they aren’t achieving much in scientific discovery (although, of course, not all my participants were equally motivated to achieve in science, particularly those at level 0, and their greatness may lie in other domains.)

But, do you see that big circle— the one that looks like a smiley face? Well, that represents a person too. And why did I make that one person stand out among all the rest? Because that person is my existence proof that a high level of working memory isn’t a necessary condition for greatness.

Let’s see why that’s the case. The average working memory score in my sample was 44.63 and the standard deviation (or how much variation there is from the average) was 8.56. The minimum working memory score in my sample was 24 and the maximum was 60 (which was also the maximum for the test). This smiley, blue circle represents a person “who won a prize at a science fair or other local competition”, and also “won a national prize in the field of science or medicine”. Quite impressive for a high school student! What’s more, this person won these prizes with a lower than average working memory score (35). Technically, about 68% of the other students in my sample scored higher in working memory than this person, but this person still stands heads and shoulders above virtually all the other students in terms of scientific discovery greatness!

Of course, it’s entirely possible that this smiley face kid either lied about his scientific discovery creative achievement or didn’t try very hard on the working memory task. So don’t take this data as gospel (in fact, you shouldn’t take any single dataset as gospel)! Still, I hope this illustrates a very important point: it’s so easy for psychologists, desperately trying to find linear, straight lines, to miss this person. Clearly, whatever this person lacks in working memory (or at least in his or her ability to do well on that task that day), they make up for in other ways. This person, in my opinion, is a true outlier.

A few years back, I was kindly invited by one of Ericsson’s former students, Edward Cokely, to give a talk at the Max Planck Institute for Human Development, where he was working at the time as a postdoctoral Fellow. At dinner, we were discussing Anders Ericsson’s theory of deliberate practice and I was questioning how it could possibly be true. I had been conducting my own research on the predictive value of cognitive ability and was finding statistically significant correlations with fancy outcomes such as academic achievement and even creative cognition as measured in the laboratory.

Then we started discussing individual cases of people who surmounted seemingly insurmountable physical and cognitive limitations, only to become great in their field. Edward described these people as “existence proofs”; they were proof that greatness is possible, despite their apparent weaknesses. I never forgot that term, which is why I used it to describe my blue-face outlier (whose real identity I will never know). For these existence proofs, their lower ability does not constrain their ultimate levels of performance; they are able to overcome their limitations. Perhaps they even attained greatness because of their limitations!

At one level of analysis—the group level—Hambrick and his colleagues are surely scientifically correct: ability matters all across the performance spectrum. Differences in working memory performance are slightly to moderately but significantly (at least statistically), related to performance on measures of complex cognition under laboratory conditions, and these effects don’t weaken at the high ends of domain-specific knowledge. Research also shows that early ability matters. In a recent review, Kimberley Robertson and her colleagues showed that among a group of adolescence, both domain-general and domain-specific abilities even at the very top 1% were statistically predictive of the likelihood of educational, occupational, and creative outcomes decades later in life (although independent of that, measures of educational-vocational interest and lifestyle preferences also had a significant effect). These are certainly interesting findings, and popular writers such as Malcolm Gladwell or David Brooks are technically (or scientifically) incorrect if they claim that ability does not matter. Perhaps a more nuanced view is that the importance of different abilities and traits depends on the domain in question. For the arts, the type of ability measured on IQ tests appears to be less important than for scientific discovery. At least when looking at group averages.

But at another level of analysis, this debate breaks down. While it’s fun for scientists to find order among apparent chaos, let’s remember that we’re talking about chaos among human beings, not fractals. Each participant comes to the experiment with their own unique constellation of traits, abilities, inspirations, motivations, passions, desires, life circumstances, and life experiences. There are so many different paths to greatness. The name of the game is strengthening what you’re good at, and compensating for your weaknesses. This is actually part of the definition of intelligence, at least as defined by my former advisor Robert J. Sternberg.

Everyone who is alive has at least some level of working memory, and they can use it the best they can, while trying to reduce their mental burden through the use of technology and collaboration. Even though working memory is heritable, this doesn’t mean it’s fixed at birth. Recent research suggests that working memory can be improved through training. Psychological experiments that intentionally make it as hard as possible for mostly uninterested participants to solve a task underestimate the power and possibility of compensation in the real world given sufficient motivation.

So next time you see a study that says some ability is necessary for some form of greatness, remember that this isn’t necessarily the case. You can personally get there, regardless of the group trend. After all, working memory is common, but greatness is rare.

————————–

Note: In their paper, David Z. Hambrick and Elizabeth J. Meinz refer to “working memory capacity”. Here, I am referring to the same construct when I talk about “working memory”. I dropped the “capacity” bit since some researchers have convincingly argued (at least to me) that working memory is not a capacity, per se, but more of an ability for attentional control.

Acknowledgement: Thanks to Andrea Bartz for bringing the article “Research sheds light on origins of greatness” to my attention.

————————–

© 2011 by Scott Barry Kaufman. Follow me on G+ or Twitter.

Scott Barry Kaufman About the Author: Scott Barry Kaufman is Scientific Director of The Imagination Institute in the Positive Psychology Center at the University of Pennsylvania. Follow on Twitter @sbkaufman.

The views expressed are those of the author and are not necessarily those of Scientific American.






Comments 11 Comments

Add Comment
  1. 1. DouglasEby 2:00 pm 10/14/2011

    “Ability for attentional control” is an intriguing idea – it reminds me of comments by Malcolm Gladwell on the achievements of Bill Joy and the Beatles, who were “willing to play for eight hours straight, seven days a week. Joy was willing to stay up all night programming. In either case, most of us would have gone home to bed.” From my High Ability site post Outliers and developing exceptional abilities
    http://highability.org/113/outliers-and-developing-exceptional-abilities/

    Link to this
  2. 2. zstansfi 6:39 pm 10/14/2011

    Isn’t the question you are really trying to answer whether or not “ability” is “innate”? And given that the term “innate” has largely lost its meaning with respect to complex traits, I think that this question is actually self-refuting, don’t you?

    Link to this
  3. 3. Nagnostic 1:45 am 10/15/2011

    “Greatness” is subjective. High ability can be measured in a fairly straightforward manner.

    Link to this
  4. 4. gnomricon 2:54 pm 10/15/2011

    This is where so many Fortune 500 companies miss out. They winnow their new hires to only those with a 4.0 GPA, believing that academic success guarantees professional success. Too often, such hires are only good at looking good. The resulting ineffectiveness necessitates outsourcing all the work to more capable firms with sensible hiring standards.

    Link to this
  5. 5. gwern 7:10 pm 10/15/2011

    > I also assessed creative achievement across 10 different arts and sciences domains (Visual Arts, Music, Dance, Architectural Design, Creative Writing, Humor, Inventions, Scientific Discovery, Theater and Film, and Culinary Arts) using the Creative Achievement Questionnaire. For each domain, participants had to check off their level of achievement. For instance, for Inventions, the scale ranged from “I do not have recognized talent in this area” to “I have sold one of my inventions to a manufacturing firm”. While these were just high school students, some had accomplished quite a bit (this may have to do with the intense specialization of the British school system).

    So in other words, while the WM was measured by an objective nigh-uncheatable process, the achievement was measured by an uncheckable subjective self-report.

    177 subjects. Isn’t it more than a little likely that someone might inflate their scores and that’s your hopeful single counterexample (not that 1 out of 177 is very encouraging)? Especially given the almost perfect emptiness of that half of the graph?

    (Would you have wondered about the validity of that datapoint if the WM score had been below 30? Below 20?)

    Link to this
  6. 6. pmineault 3:55 pm 10/16/2011

    I don’t understand why you would use a log transform before a rank correlation. Rank correlation is preserved under monotone transformations, which includes the log.

    Link to this
  7. 7. Nagnostic 1:52 am 10/17/2011

    This article reminds me of the non-correlation of intelligence and performance, regarding US presidential administrations. Just look at Obama for one example.

    Link to this
  8. 8. DaoudaW 9:58 am 10/17/2011

    “Even Anders Ericsson and his colleagues—who study the importance of deliberate practice for attaining elite performance— would have to admit that other factors come into play, such as inspiration, motivation, passion, perseverance, mindset, and self-belief.”

    Why would they? Inspiration quickly evaporates without the incremental progress that comes from practice. We all know that self-belief becomes self-deception without supporting effort. Motivation, passion, perseverance, mindset facilitate the deliberate practice that leads to expertise. They don’t provide an alternate route to greatness.

    Link to this
  9. 9. skass 12:54 am 10/20/2011

    This article contains many embarrassing statistical mistakes.

    1. The author writes, “You can judge how strong a linear correlation is by how much those little circles conform to that diagonal line.”

    The diagonal line is clearly not the line of best fit, so the circles’ conformity to the diagonal line has nothing to do with the strength of any linear correlation. The scatterplot in fact suggests a strong linear correlation here (with a line of best fit around Y = 40 + 1.8 X).

    2. The author describes as “skewed left” distributions that are skewed to the right.

    3. The author questions whether what Hambrick and Meinz call “significant” is. While this word can be confusing to a casual reader, it has a precise and completely justified meaning in the context of the reporting of statistical results, which is the context in which Hambrick and Meinz used it. Hambrick and Meinz are not making a value judgment or expressing an opinion. The author might as well read a calculus text and deride the mathematician-author for calling something “normal” that he doesn’t find conforming to his standards. (The word normal means “perpendicular” in the mathematical context.)

    4. The author uses correlation coefficients in sentences incorrectly, which suggests a poor understanding of what they are and mean. He writes that a “correlation was .28” and that two variables “correlated .28.” Neither of these makes any sense. A correlation is an association. The number .28 is a measure of the strength of the association. The number .28 is not the value of the correlation. (A correlation doesn’t have a value.) The number .28 is neither “the correlation” nor is it how much the variables “correlated.” This may seem persnickety, but what the author writes is as nonsensical as writing “Mary made 17 marathon” when Mary placed 17th in a marathon.

    4. The author does not seem to know what the words “necessary” and “sufficient” mean. The blue smiley-face person by itself shows that high working memory is not necessary for scientific greatness. It does not, however, show (on its own, as the author claims) that high working memory is not sufficient.

    In addition, the author interprets Hambrick and Meinz’s statement that “although deliberate practice may well be necessary to reach a very high level of skill, it is not always sufficient“ to express the idea “that deliberate practice is the only contributor to greatness.”

    What Hambrick and Meinz wrote does not express the idea that deliberate practice is the only contributor to greatness. The author’s misunderstanding that it does suggests that the author misunderstands what “necessary” and “sufficient” mean.

    Link to this
  10. 10. jgrosay 4:13 pm 10/21/2011

    The Upjonh Co taught me that, as for basic levels technical skills are the basis of job description and tasks, the higher levels of management require mainly social and personal relations abilities.

    Link to this
  11. 11. jgrosay 4:17 pm 10/21/2011

    Sorry, I meant Upjohn,Kalamazoo MI, now owned by Pfizer. This company was a very good example of internal promotion of employees, the president of the company, that was married to the owner’s daughter, started his career as salesman in a NY sales district.

    Link to this

Add a Comment
You must sign in or register as a ScientificAmerican.com member to submit a comment.

More from Scientific American

Scientific American Back To School

Back to School Sale!

12 Digital Issues + 4 Years of Archive Access just $19.99

Order Now >

X

Email this Article



This function is currently unavailable

X