ADVERTISEMENT
  About the SA Blog Network













Absolutely Maybe

Absolutely Maybe


Evidence and uncertainties about medicine and life
Absolutely Maybe Home

The Hawthorne effect: An old scientists’ tale lingering “in the gunsmoke of academic snipers”

The views expressed are those of the author and are not necessarily those of Scientific American.


Email   PrintPrint



Cartoon showing confusion of cause and effect

It’s easy to see a “cause and effect” relationship where there isn’t one. Or overlook one that should be as plain as daylight.

Sometimes, these errors are dramatic. And when scientists make them, a lot of people can follow down the garden path without ever looking too closely at how they got there. That’s what happened with the Hawthorne “effect.”

In November 1924, the first of a series of experiments began at Western Electric’s factory in Cicero, just outside of Chicago. Western Electric was the child of the Bell telephone company and parent to AT&T.

Photo of Hawthorne Works 1920

Aerial photo of the Hawthorne Works around 1920, Western Electric, via Wikimedia Commons

The factory complex was called the Hawthorne Works, and it was like a small city. It had a hospital, ballpark, library and much more. By the end of the decade, there would be 40,000 workers.

The electric industry wanted people to use more lighting. They sponsored the National Research Council to work with Massachusetts Institute of Technology (MIT) on experiments to show that illumination increased productivity in factory workers.

Western Electric telephone 1931

Photo of 1931 Western Electric telephone, by Lovellama (Creative Commons) via Wikimedia Commons

Three initial experiments were conducted between 1924 and 1927. You can see photos of women workers in the experiments in this collection. You would think from the way many people write about it now, that these were perfectly controlled experiments that proved that people’s productivity rose every time there was any change in lighting at all – up or down – and that it was because of something called “the Hawthorne effect.”

What people mean by that now can vary. Mostly it has come to mean that the “specialness” and novelty of being studied was all that was needed to motivate increased productivity. And that has been extended: from factory workers to all other workers, including surgical staff during operations; and from productivity to other aspects of people’s lives, including health outcomes.

The thing is, it never even happened at the Hawthorne Works. In fact, out of the first three experiments, one showed improved productivity, the second (the only one with any control) found no improved productivity, and in the third, productivity worsened. The sponsors ordered the destruction of all data – including everything that had been sent to MIT – and for no report to be written.

A manager at the Works and some researchers decided to do more experiments. Elton Mayo and his team were excited that they had discovered that workers were not only motivated by money, and they kept doing more studies till 1933. They published without a lot of data on the illumination studies, and the subsequent experiments were more about social aspects of motivation at work.

There was enough, though, to establish the myths of “the Hawthorne experiments.” It led to a radical change in thinking about management, giving birth to a new school of human relations in management that still shapes theory and the way many of us work.

What data was available would be hotly contested over the years. Henry Landsberger concluded in 1958 that the Hawthorne effect had originated “in the bias of the creators rather than in the facts it seeks to explain.” There had been, he said, “as comprehensive an indictment of a theoretical system as could be imagined.”

Then surviving data was unearthed and it surely should have dispelled any remaining belief in the experiments’ ability to prove any hypothesis at all. Critiques increased in complexity and range. The experiments’ weaknesses were dissected and debunked, including major data re-analyses in 1992, 2009 and 2011.

What were the influences that could have potentially affected productivity at Hawthorne – other than the researchers’ attention? There were many.

The women in the illumination studies had previously worked under very close supervision. But when they entered the study, their working conditions changed quite dramatically. The researchers were now in effect their supervisors, not the factory foremen. They could negotiate the terms of their working day and had more autonomy than previously.

The work done in the different departments being compared was different. The workers differed, too, with some being moved out because of low productivity, and more productive people getting their jobs.

Another big increase in productivity after the illumination experiments coincided with the Great Depression, when people were desperately afraid of losing their jobs. And by 1933, they did indeed lose their jobs.

That’s just the beginning of a long list of factors that could account for changes the researchers observed, many of them related to the lighting issue as well. For example, the researchers thought productivity went up immediately after they changed lights, but they always did that on Sundays. Even if they were not in an experimental room, workers were more productive on Monday, becoming less productive as the week went on.

There was no “Hawthorne effect” in the Hawthorne experiments.

Photo of vestige of Hawthorne Works

Photo of vestige of Hawthorne Works, Cicero, Chicago, by Harman via Wikimedia Commons

Many others who have looked for it have not been able to find it either. In 1984, John Adair reviewed educational studies that had controlled for a Hawthorne effect: only 7 of 40 found any evidence of one. Of 13 studies that sought to establish its existence, only 4 could find any sign of it.

If a Hawthorne effect were as important as many suggest in health studies as well, then you would expect there to be some detectable difference in outcomes for people who participate in controlled trials, for example, compared with those who do not. But there doesn’t seem to be.

Of course research and researchers can sometimes influence the outcomes of what they study, simply by studying. It’s just far from true that validity is always threatened by it. Yet the Hawthorne “effect” is used to trivialize results and dispute their internal and external validity. It fills a need so great, and is so deeply embedded, that it has proven “impossible to eradicate.” It is a product of the imagination, but some treat it as real and many seem unaware of its dubious origins.

The durability of this old scientists’ tale tells us more about the phenomena that lead people to believe it, than it does about the influence of experimentation in people’s lives. Science is self-correcting, in theory and aspiration at least, if not as much in practice as we need it to be. In the case of the Hawthorne hypothesis, that self-correction is a mighty long time coming.

~~~~

This post’s title quotes a phrase used by Jeff Sonnenfeld in his 1985 article, Shedding light on the Hawthorne studies.

The cartoon is by the author, under a Creative Commons, non-commercial, share-alike license.

 

The thoughts Hilda Bastian expresses here are personal, and do not necessarily reflect the views of the National Institutes of Health or the U.S. Department of Health and Human Services.

Hilda Bastian About the Author: Hilda Bastian likes thinking about bias, uncertainty and how we come to know all sorts of thing. Her day job is making clinical effectiveness research accessible. And she explores the limitless comedic potential of clinical epidemiology at her cartoon blog, Statistically Funny. Follow on Twitter @hildabast.

The views expressed are those of the author and are not necessarily those of Scientific American.





Rights & Permissions

Comments 6 Comments

Add Comment
  1. 1. WRQ9 12:52 pm 07/26/2013

    I suppose the “Hawthorne effect” could be reinterpreted to posit that a popular theory combined with incompetent science creates redundancy of effort and expense benefitting mostly bad scientists. This alone is worth knowing, if only it could be encapsulated simply enough for the sake of clarity. I imagine the definitive solution could seem unfit for print.
    I do know that whatever the truth, complicating an issue with an already popular theme at it’s core serves to create the impression that the theme bears merit. Also that the spending of actual money on these boondoggles tends also to inherit the “credibility” or “cache” of the spender, regardless of intent. The mind of the “body public” is a black box which is understood by many and yet subject only to those willing to stoop to it’s manipulation.
    There is no reason on earth that bad science could not (if properly managed) show a healthy financial return as an institution. Certainly they could garner profits a significant percentage of the real thing. Risk could be controlled better under these conditions so it seems possible that it could replace it’s predecessor completely, especially as interest and disclosure wanes in actual results.
    It all seems roughly reminiscent of TV in a business model, you could even have focus groups pick your scientists for you.

    Link to this
  2. 2. Hilda Bastian in reply to Hilda Bastian 1:49 pm 07/26/2013

    Yes, I think you’re right, WRQ9 – “the Hawthorne effect” is this phenomenon itself, isn’t it? Although in their defense, it was very important to overturn the idea of workers as machines that prevailed before then. And the issues they were researching were important. Illumination matters for your comfort and perhaps health as a worker. This was the 20s and 30s, so the research standards were different – although destroying the data is just plain shocking (thank goodness for carbon paper!). None of which explains (or excuses) why this belief – popular, as you say – has held on for so long.

    Link to this
  3. 3. Kathy K. 2:19 pm 07/26/2013

    I’m reminded of the expression: “You can’t teach an old dog new tricks.” I love your cartoon at the top.
    This is a fascinating and thought provoking subject and illuminates how hard it is to eliminate existing bias, and how hard it can sometimes be to overturn bad science.
    Excellent article.

    Link to this
  4. 4. Hilda Bastian in reply to Hilda Bastian 2:26 pm 07/26/2013

    I didn’t think of think of the new tricks angle – how appropriate! And thanks very much, Kathy.

    Link to this
  5. 5. DrLPalmer 1:21 am 07/28/2013

    The biggest problem with considering “Hawthorne Effect” a result of change or being observed (like Schroedigger’s Cat in quantum physics?) is the typically unreported extra payment for the increased productivity. Hawthorne Effect has come to mean an uncontrolled variable. On the other hand, there is such a thing as power of suggestion that is stronger in some persons than others (some persons are oppositional and resist suggestion or promotion of ideas–beyond skepticism to cynicism in that the proponent is considered immoral for making the proposal–obviously, the glass is half empty and anyone who says otherwise is unworthy of attention). Subject to being influenced is an individual ability and the operator can influence appropriately when the attitude is known. For example, the child who is oppositional is easily influenced by being told NOT to eat the peas. Hawthorne effect was used as grounds for dismissal of significant findings until the 1990s, but is now out of vogue as a blanket criticism of research findings.

    Link to this
  6. 6. Hilda Bastian in reply to Hilda Bastian 9:59 am 07/28/2013

    Yes, agree it’s out of vogue for many, DrLPalmer. But it’s still current for many, too. Mentions in biomedical literature aren’t decreasing yet, for example, and authors who look for it/explain findings with it are still only citing articles that claim it as a proven effect. And it’s still highly prevalent in management information on the internet, too.

    Link to this

Add a Comment
You must sign in or register as a ScientificAmerican.com member to submit a comment.

More from Scientific American

Scientific American Dinosaurs

Get Total Access to our Digital Anthology

1,200 Articles

Order Now - Just $39! >

X

Email this Article

X