Bad Stats Plague Neuroscience

A new study blames the unreliable nature of some research in the field on underpowered statistical analyses.

By | April 16, 2013

An image from an fMRI study of brain activity in schizophrenia patientsWIKIMEDIA, PLOS One. 2010 AUG 11;5(8):e12068.Weak statistics are the downfall of many neuroscience studies, according to researchers that analyzed the statistical strategies employed by dozens of published reports in the field. Especially lacking in statistical power are human neuroimaging studies—especially those that use fMRI to infer brain activity—noted the coauthors of the analysis, published in Nature Reviews Neuroscience last week (April 10).

By taking a look at 49 meta-analyses published in 2011, involving a total of 730 neuroscience studies, a team of researchers from the United Kingdom and United States found that about half of the papers had a statistical power below 20 percent. Statistical power is a measure of the probability that a study will detect the presence of a true phenomenon in the samples at hand. High-powered studies can demonstrate even small effects if sample sizes are big enough. Low-powered studies, however, run the risk of either missing genuine phenomena or reporting false positives, usually due to considering too few samples. Research studies typically aim to have a statistical power of at least 80 percent.

Human neuroimaging studies had a median statistical power of just 8 percent, the researchers found.

“This paper should help by revealing exactly how bad things have gotten,” Hal Pashler, a psychologist at the University of California, San Diego, who wasn’t involved with the study, told Wired Science.

Senior author Marcus Munafò, a psychologist at the University of Bristol, United Kingdom, told Wired that such underpowered statistics in neuroscience research may be the result of publishing pressure. ”In many cases, we’re more incentivized to be productive than to be right,” he said.


Add a Comment

Avatar of: You



Sign In with your LabX Media Group Passport to leave a comment

Not a member? Register Now!

LabX Media Group Passport Logo


Avatar of: agular17


Posts: 5

December 7, 2013

Whats left to say, Okay, we're done, film at eleven.


Popular Now

  1. Sex Differences in the Brain
    Features Sex Differences in the Brain

    How male and female brains diverge is a hotly debated topic, but the study of model organisms points to differences that cannot be ignored.

  2. DNA Repair Pioneers Win Nobel
    Daily News DNA Repair Pioneers Win Nobel

    Tomas Lindahl, Paul Modrich, and Aziz Sancar have won this year’s Nobel Prize in Chemistry for their work elucidating mechanisms of DNA repair.

  3. Antioxidants Facilitate Melanoma Metastasis
    Daily News Antioxidants Facilitate Melanoma Metastasis

    Two compounds boost the ability of melanoma cells to invade other tissues in mice, providing additional evidence that antioxidants can be beneficial to malignant cells as well as healthy ones.

  4. Antiparasite Drug Developers Win Nobel
    Daily News Antiparasite Drug Developers Win Nobel

    William Campbell, Satoshi Omura, and Youyou Tu have won this year’s Nobel Prize in Physiology or Medicine in recognition of their contributions to antiparasitic drug development.

Bethyl Laboratories
Bethyl Laboratories
Life Technologies