How to Use P-Values Correctly

The American Statistical Association offers guidance on best practices for the oft-misused tool.

kerry grens
| 2 min read

Register for free to listen to this article
Listen with Speechify
0:00
2:00
Share

FLICKR, LENDINGMEMOConcerns about widespread misunderstanding and misuse of p-values in science have prompted the American Statistical Association (ASA) to issue its first-ever policy statement about the proper use of the statistical tool. On March 7, the organization released a set of six principles on the power and limitations of the p-value.

For instance, determining policy or making scientific conclusions should not be based on a p-value alone. “Practices that reduce data analysis or scientific inference to mechanical ‘bright-line’ rules (such as ‘p < 0.05’) for justifying scientific claims or conclusions can lead to erroneous beliefs and poor decision-making,” according to the ASA’s statement. “A conclusion does not immediately become ‘true’ on one side of the divide and ‘false’ on the other.”

Rather, complementing p-values with other statistics, such as confidence intervals, may better address the validity of a hypothesis.

In a commentary on the statement, Stanford University’s John Ioannidis wrote that adding more statistical layers does not solve the problems of “hidden multiplicity and selective reporting biases.” Transparency—another of the ASA’s principles—is essential. “Efforts to promote ...

Interested in reading more?

Become a Member of

The Scientist Logo
Receive full access to more than 35 years of archives, as well as TS Digest, digital editions of The Scientist, feature stories, and much more!
Already a member? Login Here

Keywords

Meet the Author

  • kerry grens

    Kerry Grens

    Kerry served as The Scientist’s news director until 2021. Before joining The Scientist in 2013, she was a stringer for Reuters Health, the senior health and science reporter at WHYY in Philadelphia, and the health and science reporter at New Hampshire Public Radio. Kerry got her start in journalism as a AAAS Mass Media fellow at KUNC in Colorado. She has a master’s in biological sciences from Stanford University and a biology degree from Loyola University Chicago.

Share
3D illustration of a gold lipid nanoparticle with pink nucleic acid inside of it. Purple and teal spikes stick out from the lipid bilayer representing polyethylene glycol.
February 2025, Issue 1

A Nanoparticle Delivery System for Gene Therapy

A reimagined lipid vehicle for nucleic acids could overcome the limitations of current vectors.

View this Issue
Enhancing Therapeutic Antibody Discovery with Cross-Platform Workflows

Enhancing Therapeutic Antibody Discovery with Cross-Platform Workflows

sartorius logo
Considerations for Cell-Based Assays in Immuno-Oncology Research

Considerations for Cell-Based Assays in Immuno-Oncology Research

Lonza
An illustration of animal and tree silhouettes.

From Water Bears to Grizzly Bears: Unusual Animal Models

Taconic Biosciences
Sex Differences in Neurological Research

Sex Differences in Neurological Research

bit.bio logo

Products

Tecan Logo

Tecan introduces Veya: bringing digital, scalable automation to labs worldwide

Explore a Concise Guide to Optimizing Viral Transduction

A Visual Guide to Lentiviral Gene Delivery

Takara Bio
Inventia Life Science

Inventia Life Science Launches RASTRUM™ Allegro to Revolutionize High-Throughput 3D Cell Culture for Drug Discovery and Disease Research

An illustration of differently shaped viruses.

Detecting Novel Viruses Using a Comprehensive Enrichment Panel

Twist Bio&nbsp;