Bad Stats Plague Neuroscience

A new study blames the unreliable nature of some research in the field on underpowered statistical analyses.

| 1 min read

Register for free to listen to this article
Listen with Speechify
0:00
1:00
Share

An image from an fMRI study of brain activity in schizophrenia patientsWIKIMEDIA, PLOS One. 2010 AUG 11;5(8):e12068.Weak statistics are the downfall of many neuroscience studies, according to researchers that analyzed the statistical strategies employed by dozens of published reports in the field. Especially lacking in statistical power are human neuroimaging studies—especially those that use fMRI to infer brain activity—noted the coauthors of the analysis, published in Nature Reviews Neuroscience last week (April 10).

By taking a look at 49 meta-analyses published in 2011, involving a total of 730 neuroscience studies, a team of researchers from the United Kingdom and United States found that about half of the papers had a statistical power below 20 percent. Statistical power is a measure of the probability that a study will detect the presence of a true phenomenon in the samples at hand. High-powered studies can demonstrate even small effects if sample sizes are big enough. Low-powered studies, however, run the risk of either missing genuine phenomena or reporting false positives, usually due to considering too few samples. Research studies typically aim to have a statistical power of at least 80 percent.

Human neuroimaging studies had a median statistical power of just ...

Interested in reading more?

Become a Member of

The Scientist Logo
Receive full access to more than 35 years of archives, as well as TS Digest, digital editions of The Scientist, feature stories, and much more!
Already a member? Login Here

Keywords

Meet the Author

  • Bob Grant

    From 2017 to 2022, Bob Grant was Editor in Chief of The Scientist, where he started in 2007 as a Staff Writer.
Share
May digest 2025 cover
May 2025, Issue 1

Study Confirms Safety of Genetically Modified T Cells

A long-term study of nearly 800 patients demonstrated a strong safety profile for T cells engineered with viral vectors.

View this Issue
Detecting Residual Cell Line-Derived DNA with Droplet Digital PCR

Detecting Residual Cell Line-Derived DNA with Droplet Digital PCR

Bio-Rad
How technology makes PCR instruments easier to use.

Making Real-Time PCR More Straightforward

Thermo Fisher Logo
Characterizing Immune Memory to COVID-19 Vaccination

Characterizing Immune Memory to COVID-19 Vaccination

10X Genomics
Optimize PCR assays with true linear temperature gradients

Applied Biosystems™ VeriFlex™ System: True Temperature Control for PCR Protocols

Thermo Fisher Logo

Products

The Scientist Placeholder Image

Biotium Launches New Phalloidin Conjugates with Extended F-actin Staining Stability for Greater Imaging Flexibility

Leica Microsystems Logo

Latest AI software simplifies image analysis and speeds up insights for scientists

BioSkryb Genomics Logo

BioSkryb Genomics and Tecan introduce a single-cell multiomics workflow for sequencing-ready libraries in under ten hours

iStock

Agilent BioTek Cytation C10 Confocal Imaging Reader

agilent technologies logo