ADVERTISEMENT
  About the SA Blog Network













PsySociety

PsySociety


Blogging At The Intersection Of Psych and Pop Culture
PsySociety Home

Fox News Fact Check: Are studies on maternal employment all tinged with political bias?

The views expressed are those of the author and are not necessarily those of Scientific American.


Email   PrintPrint



Last week, the anchors at Fox News made headlines when they covered the recent Pew Research Center finding that 40% of all households in America have a female primary breadwinner. About 1/3 of these households consist of two-parent households where the mothers make more money than their husbands, and the remaining 2/3 consist of single mothers. Left completely in a tizzy after learning of this statistic, Fox assembled an entirely-male panel to mourn, in no uncertain terms, the downfall of society as we know it. This was quickly followed by another segment in which lead mouthpiece Erickson doubled down on his statements, and a third in which female anchor Megyn Kelly criticized the men for their backwards, offensive views. Many of the things said on these segments were hurtful to thousands of men, women, and children who were essentially being told that they are responsible for society crumbling into ruins. However, in addition to being offensive, many of the “facts” and much of the “science” on these videos were not quite correct. In a series of blog posts this week, I will be comparing what the Fox news anchors have claimed in these segments with empirical reality.

The Claim: In response to Megyn Kelly citing a 2010 study released by the American Psychological Association stating that there are no differences in positive outcomes between children whose mothers work and those whose mothers stay home, Erick Erickson says, “I think the experts can be as politically motivated as anyone else when it comes to these particular studies, because it plays into a particular current notion that it’s OK.” (Note: For an explainer on how to understand the results of a meta-analysis and more information about the meta-analysis being discussed in this post, please see my post from yesterday).

The Reality:

I’m never quite sure of what this type of accusation actually means, but there are a few possibilities that we can explore.

1. The Researchers Doing The Meta-Analysis Picked And Chose Which Articles To Include Because Of Politics. Maybe Erickson is trying to argue that the meta-analysts themselves are selectively choosing which articles to include in their analysis, leaving out the ones that don’t fit their idea of what’s “right.” However, that is really, truly not how a meta-analysis works. When you conduct a meta-analysis, you have to describe in excruciating detail exactly how you decided which studies to include or exclude. You are not able to decide not to include certain studies simply because you don’t want to do so. And believe me – people read meta-analyses of fields in which they have conducted research. Scientists who conduct research in a certain field certainly want to see their names in print and their work being cited in relevant meta-analyses. If a meta-analyst were to casually leave out someone’s papers because of political motives, believe me — it would NOT stay secret for very long.

So how did the researchers find all of these papers in the first place? Typically, meta-analytic researchers have to conduct a comprehensive search of all relevant databases, reporting which keywords they used in the search. In this case, the researchers searched every major database (including an entire database that consists solely of unpublished dissertation abstracts) for every single paper that had been published from 1960 through 2010 containing the following keywords in every possible combination: maternal, mother(s), parental, employment, work, labor, child care, early, infancy, children(’s), boy(s), girl(s), achievement, academic, cognitive, cognition, school, behavior problems, adjustment, external(izing), internal(izing), defiance, and compliance. They ended up with 216 total studies after searching for these keywords. So how did they end up with 69 studies if they started with 216? Again, they have to detail in the manuscript exactly why each study was excluded – nothing can be left secret. 78 studies were excluded because they did not focus on early employment (perhaps only measuring whether or not mothers were employed when the children were teens or adults), 22 were excluded because they did not measure “maternal employment” in a way that fit with the specified inclusion criteria1, 14 excluded because they did not measure “child outcomes” in a way that fit with the specified inclusion criteria2, 11 studies were excluded because even though they included measures of maternal employment and measures of child outcomes, they did not present any information on how those two things related to each other, 7 studies were excluded because they were review pieces and did not include any empirical data, 8 studies were excluded because the data were used in more than one peer-reviewed study and could not be double counted, 5 studies were not available to be downloaded, and 2 studies did not provide effect sizes that could be coded for the analysis. 216 – 78 – 22 – 14 – 11 – 7 – 8 – 5 – 2 = 69 studies, and not a single one was excluded because of any sort of vague “I don’t like what they said” criteria.

2. Publication Bias. Maybe Erickson is trying to argue that the editors and reviewers of empirical journals are suppressing any research findings that support conservative politics, and journals are therefore only publishing results that support a liberal point of view. Thus, even when researchers comprehensively search all of the relevant databases, their search will still be biased because published papers are all liberally slanted.

This is a fairly paranoid point of view, and not at all how publication/peer review really works, but let’s pretend for the sake of this argument that this is something to be concerned about. If you take a look at the sample characteristics for the meta-analysis (discussed in a previous post), 20% of the samples actually come from unpublished data (mostly in the form of unpublished doctoral dissertations or MA theses). This is quite an impressive percentage of unpublished data to have in a meta-analysis. I’m working on one where we’re thrilled we were able to get 11% of our data coming from unpublished studies. Not only that, but the way that researchers typically obtain unpublished data for meta-analyses is by e-mailing relevant listservs, faculty, universities, research centers, etc. and sending out a massive call for all unpublished studies. If you were someone who felt that your research had been suppressed by political bias, odds are fairly good that you would jump at the chance to send your data in to be part of a meta-analysis. Because of this, there’s generally an assumption that unpublished data is either more likely to have null results than published studies, or that it might actually be more likely to have controversial results (yes, it’s an issue that this might make it harder for something to get published — but that is not the point for today). So yes, 20% of the sample is pretty good representation for unpublished data. And yet, even when eyeballing the results of only the unpublished data, there’s still no evidence that maternal employment is a bad thing.

3. Social Norm Bias. Erickson mentions that researchers may want to find evidence that maternal employment is not damaging, as it “plays into a particular current notion that it’s OK.” In other words, Erickson is saying that researchers might be more likely to “find effects” that positively reflect current social norms, biases, or preferences. Extending this logic, then, you should naturally expect that the studies in this meta-analysis that were conducted in the 1960s might show a negative effect of maternal employment (as it was considerably less socially acceptable for mothers to work outside of the home in the 1960s), whereas those conducted in the 2000s would show a positive (or null) effect of maternal employment on children’s academic and behavioral outcomes.

However, once again — this is not the case. The researchers actually checked to see if the study effects differ based on when the studies were published, and they found absolutely no difference in effects based on publication year. So, studies published in the 1960s or 1980s show the same overall effects as those published in the 1990s or 2000s. Studies conducted from 2000-2009 were no more likely to find positive (or null) effects of maternal employment than those conducted in any earlier year.

Let’s take a closer look at one of the studies included in the meta-analysis from the 1960s, as an example. In a study from 1961, researchers Burchinal and Rossman sent surveys home with every single seventh- and eleventh-grade student throughout Cedar Rapids, Iowa, ending up with 1172 surveys from children and their parents. These surveys measured:

  • Parents’ marital histories, educational levels, and current occupations
  • Mother’s employment history (How many months the mother was employed during (a) the years when her child was 0-4, (b) the years when her child was 4-6, (c) the years when her child was 0-7, (d) the 2.5 years prior to data collection, and (e) throughout the child’s entire life).
  • Several scales measuring physical and behavioral outcomes in children, including measures of obsessive feelings (do thoughts run through your head a lot at night?), oversensitivity (are your feelings easily hurt?), excessive introspection (do you worry too long about humiliating experiences?), upper respiratory issues (do you get colds easily?), envy & withdrawal (do you envy others’ happiness?), head & eye complaints (do you get a lot of headaches?), illness proneness (do you get sick a lot?), nervous symptoms (do you consider yourself a nervous person?), fatigue (do you feel tired most of the time?), mood fluctuations (do you get upset easily?), and anxiety (do you worry over possible misfortune?)

Let’s look at anxiety, one of the internalizing behavioral problems that allowed this study to qualify for inclusion in the meta-analysis, and how it correlates with Mom’s employment history. Among the 370 seventh grade boys? Correlations ranged from .01 to .08. Among the 283 eleventh grade boys? Correlations ranged from -.04 to .06. Among the 351 seventh grade girls? Correlations ranged from -.01 to .06. Among the 245 eleventh grade girls? Correlations ranged from -.05 to .03. Not a single one of those correlations was significant. Not even close. Not even marginal. Moms who worked outside of the home in the 1950s & 1960s when their children were very young were absolutely no more (or less) likely to have sons or daughters with anxiety issues than mothers who stayed at home. And sure, this is just one variable. But it seems like a pretty important one, especially since anxiety is theoretically the best candidate for a specific behavioral issue that you might expect to see in someone who struggled with maintaining high-quality parental attachment bonds throughout childhood.

 

Correlation coefficients from the 1961 Burchinal & Rossman study. Click to embiggen.

We can do this for every single indicator that they measured. Obsessive, ruminating thoughts (a symptom of anxiety and/or depression)? No significant correlations. Excessive introspection? No significant correlations. Mood swings? No significant correlations. The only times when there are significant correlations, they aren’t particularly informative. Eleventh grade boys reported slightly higher rates of fatigue if their mothers worked outside of the home when they were younger, but only if this employment occurred when they were between the ages of 4 and 6. Seventh grade girls reported higher rates of head and eye complaints if their mothers worked while they were young, but eleventh grade girls didn’t show this same effect. There are five different employment indicators, four different groups of kids, and eleven dependent variables, yielding 220 correlations. Of those 220 correlations, 17 are significant and 203 are not. Given that you might reasonably expect about 11 false positives (correlations that come back as “significant” but truly aren’t) to pop out of these analyses anyway, and given that the few correlations that are significant are unpredictable, scattered, and not theoretically meaningful, this…seems like a fairly open and shut case. Maternal employment was just fine in the 1960s, too.

Pew Research Center Data

Graph provided by Pew Research Center

The study is not perfect. They only included White families and families with both biological parents living at home. But, it is a study that was done in 1961 — a year in which (as seen in the graph at left) only 3.5% of married mothers served as the primary breadwinners in their households, compared with 15% in the current day. Even in the context of a society in which social norms clearly supported the idea of a mother staying at home, research showed no negative effects of maternal employment.

4. Too Many Liberals In Science. Maybe Erickson is complaining that all studies, published or unpublished, will have a liberal bias, because all scientists are liberal. However, there are several issues with this accusation. First of all, in the studies being discussed here, they all simply measure “maternal employment” as an objective measure of how much mothers work, and then measure “child outcomes” by using commonly accepted metrics for achievement or behavioral issues, like IQ, grades, teacher evaluations, scales for depression, anxiety, or impulsivity, or teacher ratings of aggression. I’m not sure exactly how political bias could really alter their statistical analyses of these data or their choices of which metrics to use in this situation. If someone has a solid, theoretical argument that might support the idea that liberals are biased towards choosing these metrics and conservatives would clearly choose entirely different outcomes or scales that you would expect to show completely different effects, I’d be happy to hear it. Second of all, the studies span a wide range of socioeconomic and racial groups, so it doesn’t seem like results could be swayed by selective sampling.

And finally, if the complaint is just that conservatives don’t go into scientific research — I’m not sure that liberally-minded researchers can really do much to fix that problem. That one’s on conservatives to change.

Takeaway points here? Erickson might want to cry “bias” about these findings, but there doesn’t seem to be any support for that claim — at all. Meta-analyses are basically designed to “debias” entire research fields by aggregating effects across many, many different studies. The meta-analysis discussed in this post included a high percentage of unpublished data, so the analysis itself was not swayed by publication bias. The samples cover a wide range of racial and socioeconomic groups, and the metrics are as objective as they could possibly be and not clearly tied to any one political slant, limiting concerns about selective sampling or biased measures. And finally, we saw the same effects emerging in the (very different) 1960s as we see emerging in the 2000s, making it difficult to believe that researchers are only finding the effects that “society” wants them to find.


1. Maternal employment in each included paper had to be defined in terms of status as a categorical indicator (e.g., “employed,” “not employed,” “full-time employed,” or “part-time employed”) or had to provide the number of weekly work hours as a continuous indicator. This is because, for each analysis, studies were “grouped” together to compare effect sizes based on these categories. Therefore, studies were excluded if they measured “maternal employment” in ways that could not possibly have allowed the researchers to analyze these effects in this way, like characteristics of the workplace, maternal work behavior, etc.

2. Child outcomes in each included paper were limited to three specific achievement outcomes (children’s performance on formal tests of academic or intellectual development, school grades, or teacher ratings of cognitive/academic competence) and three specific behavioral outcomes (children’s externalizing problems, children’s internalizing problems, or overall behavior problems). This is, again, to make it as easy as possible to compare groups that contain as many studies as possible, to give you more power to see what the differences are. If you have too many studies where each one details a different type of outcome, that’s not as helpful. Studies were excluded if they used different kinds of achievement outcomes (like task motivation or parental perceptions of achievement other than grades) or different kinds of behavioral outcomes (like positive or prosocial behaviors).


APA Press Release: http://www.apa.org/news/press/releases/2010/10/working-mothers.aspx

ResearchBlogging.org

Lucas-Thompson, R.G., Goldberg, W.A., & Prause, J. (2010). Maternal work early in the lives of children and its distal associations with achievement and behavior problems: A meta-analysis. Psychological Bulletin, 136 (6), 915-942 PMID: 20919797

Burchinal, L., & Rossman, J. (1961). Relations among Maternal Employment Indices and Developmental Characteristics of Children. Marriage and Family Living, 23 (4) DOI: 10.2307/347590

 

Image Credit: Fair and Balanced slogan via Wikipedia and available under free use, as the purpose of this post is “for identification and critical commentary on the station ID or program and its contents.”

Melanie Tannenbaum About the Author: Melanie Tannenbaum is a doctoral candidate in social psychology at the University of Illinois at Urbana-Champaign, where she received an M.A. in social psychology in 2011. Her research focuses on the science of persuasion & motivation regarding political, health-related, and environmental behavior. You can add her on Twitter or visit her personal webpage. Follow on Twitter @melanietbaum.

The views expressed are those of the author and are not necessarily those of Scientific American.





Rights & Permissions

Comments 15 Comments

Add Comment
  1. 1. Ungolythe 10:25 am 06/4/2013

    I love how they continue to harken on a mythical better yesteryear where living standards were so much better than today as they bemoan the disintegration of society as they know it. My guess would be that they would chart societies decline starting at the http://en.wikipedia.org/wiki/Seneca_Falls_Convention. Things were much better when women couldn’t: inherit property, server on juries or vote in elections. I wish they would give me that magical year, when society was at it’s zenith. If they could, something tells me that only a certain segment would find things very favorable to them.

    Link to this
  2. 2. nicholasjh1 12:10 pm 06/4/2013

    I’ve already determined that fox news is pretty worthless, but thanks for the great report!

    Link to this
  3. 3. Celary_Stalker 3:28 pm 06/4/2013

    Those who watch Fox News believe that they are part of an elite group that is getting information that the unwashed liberal masses are not privy to, or else are hiding from the rest of society.Anything that contradicts Fox News is considered liberal propaganda.

    I am unsure as to what utility correcting Fox news is, other than it makes those of us that don’t watch it feel better about ourselves.

    After all, we who read Scientific American are an elite group that is privy to information the conservative masses do not.

    Link to this
  4. 4. drafter 4:07 pm 06/4/2013

    No matter what your opinion is attacking a biased opinion by stating that scientist aren’t biased, something that has been proven false many times, is not very scientific.

    Link to this
  5. 5. Melanie Tannenbaum in reply to Melanie Tannenbaum 4:12 pm 06/4/2013

    I never said that scientists aren’t biased. Scientists are human. Of course we have our own political opinions. And of course that can impact things like hypotheses, for example, or what we deep down “want” to find.

    But what I am saying is that it’s difficult to imagine how a political opinion would impact the correlations found HERE, seeing as these are correlations over 50 years that are consistently employing fairly objective and difficult-to-argue-against metrics. If you can come up with SPECIFIC ideas to contest anything I said in this post (like, as I mentioned in the post itself, specific, different scales or measures that you think an unbiased or oppositely-biased researcher would choose that you expect based on strong theoretical logic would yield different effects than the ones found here), I would be glad to hear it.

    Link to this
  6. 6. Katatonic 4:17 pm 06/4/2013

    Prime example of a “news” source blathering that required hours of dissection and rebuttal by an actual scientist to determine if their claims of bias are valid. Same kind of cr*p that goes on with all conspiracy theorists. It only takes a few moments make unfounded claims and unceasing research to refute that position. Meanwhile, they’ve moved on to the next supposed symptom of sociaty’s imminent demise…

    Link to this
  7. 7. Melanie Tannenbaum in reply to Melanie Tannenbaum 4:49 pm 06/4/2013

    Upon thinking about this further, I think I have a good candidate for how “political bias” could creep in here.

    It could certainly be the case that political bias could impact how the data/correlations are interpreted or explained. For example, the fact that the correlations are all very small and rarely ever significant could be explained as, “Children with working mothers fare no worse than children with stay-at-home mothers.” However, someone with a different bias could describe the same finding by saying, “Despite popular notions that children benefit by having positive parental role models who work outside the home, children with working mothers fare no better than children with stay-at-home mothers.” Same data, two very different slants.

    However, I still wholeheartedly maintain my assertion that it is quite difficult to imagine how bias would actually change the results found in this research.

    Link to this
  8. 8. dhughes 5:01 pm 06/4/2013

    Meta-analysis can mean different things to different people. Meta-analysis selection/interpretation is often biased as it is at best an estimation of effects. What I would find interesting is a study that might determine any correlation between a head of household Single maternal breadwinner’s off-spring’s socio-economic status @ say age 26 versus the socio-economic status @ age 26 of the offspring of any combination of head of household maternal OR paternal breadwinners who co-habitate with said offspring. Tannenbaum’s Aunt Sally argument’s (cloaked in supposed objectivity) are quite absurd in themselves.

    Link to this
  9. 9. John A. 6:55 pm 06/4/2013

    I really can’t argue with someone who uses the gender of the people they are arguing against as an argument.

    Link to this
  10. 10. dick c 11:08 am 06/5/2013

    Fox panders. Their viewers are being told that their prejudices are okay and they have no reason to even consider modifying their opinions. It’s much easier to buy that message than change. If Fox’s primary concern is audience size then Fox might not even really care what’s true, just what makes their audience comfortable. I don’t think it’s possible to be overly cynical when speculating on Fox’s motivations. As hard as it might be to believe, after these stories some portion of their audience will tend to elevate Fox opinion to the level of, or even above that of scientific study.

    Link to this
  11. 11. dick c 12:11 pm 06/5/2013

    Above I said, “As hard as it might be to believe, after these stories some portion of their audience will tend to elevate Fox opinion to the level of, or even above that of scientific study,” with a greater degree of certainty than it deserves. Channeling Erickson perhaps.

    Link to this
  12. 12. northernguy 7:46 pm 06/5/2013

    F.W.I.W.

    The author indicates that the presenter (Erickson) was challenged by the anchor. The editors even helpfully provided a video clip of the debate. The author goes on to say that she is on a mission to rebut Fox’s position on the science presented on this issue and others. Many commenters on this thread jump up on cue to say this is all the proof they need to know how terrible Fox news and their regular audience is, because of the ignorance apparently displayed.

    And yet, Erickson is a very occasional presenter. Lou Dobbs one of the other participants was brought in from another network recently and seems to fill the role of of a likeable but crusty old guy who laments everything about modern society, especially anything about economics which is his area of interest. He appears about once a week unlike his previous multi-year gig on another network where he was a star.

    The third person was Megan Kelly, who is a star personality anchor on Fox news. She debated Erickson’s conclusions at every turn. When finally leaving him she cited a list of science organizations whose analysis contradicted Erickson’s, finishing with the comment “why should we believe your science instead of theirs?” She then turned to Lou Dobbs and effectively destroyed the basis of his lament about the state of the modern family.

    So the Fox News person obliterates the statements of the people brought in to present the contrarian point of view but somehow it’s Fox News that’s held up as biased, ignorant and bigoted. They are judged to be so because they are seen to have to be like that to keep their low brow audience.

    Interestingly, the people putting forth such views about Fox’s behavior cast themselves as being beyond reproach when it comes to objectivity, rationality and general ability to engage in critical thinking. Which is clearly to be seen as quite distinctive from Fox News or anyone who watches it.

    The only possible bias displayed by Fox News was it’s dismissal of the science presented which ran counter to general liberal tenets relating to the value of both parents working.

    As for both parents working while raising children:

    Parents can both work but adjust their schedule to ensure that one of them is home most of the time.

    Parents can both work but have family members (grandparents etc.) fill in much of the their role. (As we do for our grand children)

    Parents can both work and basically leave their children on their own for much of the day. (As I was)

    Parents can both work and arrange for child rearing operations (daycare, school, sports organizations etc.) which are owned, operated, financed, regulated or heavily influenced by the state, to fill in for them.

    Parents can both work and choose or be forced to take any combination of or all of these options over a period of years.

    Each one of these alternatives will produce a different outcome. I didn’t see any discussion, in the paper, of what both parents working actually meant in terms of the real life conditions in which children in the study were raised.

    This lets everyone reach just about any conclusion you want. As far as we can tell from the actions and statements of Fox News staff they seem to think there is nothing necessarily wrong with both parents working and they feel they have the science to back up their belief.
    In the case of Megan Kelly she seems quite happy to put forward that position with anyone who cares to engage her on the subject.

    However, if you ask her I bet she would admit that she wishes she could spend more time with her family and that doing so would probably be better for them all.

    Link to this
  13. 13. Melanie Tannenbaum in reply to Melanie Tannenbaum 8:34 pm 06/5/2013

    NorthernGuy,

    I am the author, and I am the one that provided the video, not the editors. Everything presented in this post is my own work. I do not regularly watch Fox News, so I have no idea about how frequently Erickson and Dobbs appear on the network. All I know is where these clips and this panel appeared — which was Fox News. I gave Megyn Kelly plenty of credit for her tenacity on this. I said that Dobbs and Erickson appeared and made these statements on Fox. Nothing that I wrote was incorrect. I am not rebutting “Fox’s position.” I am fact checking information that was presented on Fox News. Big difference. You, for example, are taking issue with my post. That does not mean you are taking issue with “Scientific American’s position.”

    Your final statement does seem to contradict the scientific findings discussed at length in this post, however.

    Link to this
  14. 14. syzygy 12:48 am 06/6/2013

    Ms. Tannenbaum,

    I watched the second Erickson interview and the one with Megyn Kelly. Your analysis is exemplary as usual. You tried to understand how Erickson arrived at his conclusions. My only argument with your work is that it gives Erickson far too much credit. I doubt if he could follow your alternative explanations of how he might have reached his interpretation of the study. He has a position he wishes to validate. Erickson would see validation of his views in tea leaves. So, I believe it is an error to attempt to rationalize the irrational.

    Bias is ubiquitous. For example when people watch specific news channels to reinforce their existing viewpoints, their objective understanding of issues may suffer. I know of at least two viewers who can watch the Fox News Channel without buying into everything broadcast there. MSNBC has effectively become Pravda for the current Whitehouse. Some who see bias on Fox see little bias on MSNBC. Bias needs to be recognized wherever it exists.

    I’m unsure of your political leanings. It’s possible I might not agree with you on some or even many political issues. The fact that your personal political views can’t easily be discerned from your writings is to your credit. You maintain objectivity in your work. Some of your commenters could benefit by following your example.

    Link to this
  15. 15. bucketofsquid 12:22 pm 06/12/2013

    There was an article in this very publication a few months ago that reported on a study indicating that intelligence is directly a result of interaction between parents and children from time of birth to the second birthday. I have no idea if that was a valid study and I can’t speak from experience because when my children were small my wife worked the daycare they attended and then ran a daycare at home so she straddled the two extremes. She worked and spent the day with our children. It doesn’t appear that situation was covered in the meta-analysis presented on this blog post.

    Link to this

Add a Comment
You must sign in or register as a ScientificAmerican.com member to submit a comment.

More from Scientific American

Scientific American Special Universe

Get the latest Special Collector's edition

Secrets of the Universe: Past, Present, Future

Order Now >

X

Email this Article

X