How to Use P-Values Correctly

The American Statistical Association offers guidance on best practices for the oft-misused tool.

kerry grens
| 2 min read

Register for free to listen to this article
Listen with Speechify
0:00
2:00
Share

FLICKR, LENDINGMEMOConcerns about widespread misunderstanding and misuse of p-values in science have prompted the American Statistical Association (ASA) to issue its first-ever policy statement about the proper use of the statistical tool. On March 7, the organization released a set of six principles on the power and limitations of the p-value.

For instance, determining policy or making scientific conclusions should not be based on a p-value alone. “Practices that reduce data analysis or scientific inference to mechanical ‘bright-line’ rules (such as ‘p < 0.05’) for justifying scientific claims or conclusions can lead to erroneous beliefs and poor decision-making,” according to the ASA’s statement. “A conclusion does not immediately become ‘true’ on one side of the divide and ‘false’ on the other.”

Rather, complementing p-values with other statistics, such as confidence intervals, may better address the validity of a hypothesis.

In a commentary on the statement, Stanford University’s John Ioannidis wrote that adding more statistical layers does not solve the problems of “hidden multiplicity and selective reporting biases.” Transparency—another of the ASA’s principles—is essential. “Efforts to promote ...

Interested in reading more?

Become a Member of

The Scientist Logo
Receive full access to more than 35 years of archives, as well as TS Digest, digital editions of The Scientist, feature stories, and much more!
Already a member? Login Here

Keywords

Meet the Author

  • kerry grens

    Kerry Grens

    Kerry served as The Scientist’s news director until 2021. Before joining The Scientist in 2013, she was a stringer for Reuters Health, the senior health and science reporter at WHYY in Philadelphia, and the health and science reporter at New Hampshire Public Radio. Kerry got her start in journalism as a AAAS Mass Media fellow at KUNC in Colorado. She has a master’s in biological sciences from Stanford University and a biology degree from Loyola University Chicago.

Share
Image of small blue creatures called Nergals. Some have hearts above their heads, which signify friendship. There is one Nergal who is sneezing and losing health, which is denoted by minus one signs floating around it.
June 2025, Issue 1

Nergal Networks: Where Friendship Meets Infection

A citizen science game explores how social choices and networks can influence how an illness moves through a population.

View this Issue
Unraveling Complex Biology with Advanced Multiomics Technology

Unraveling Complex Biology with Five-Dimensional Multiomics

Element Bioscience Logo
Resurrecting Plant Defense Mechanisms to Avoid Crop Pathogens

Resurrecting Plant Defense Mechanisms to Avoid Crop Pathogens

Twist Bio&nbsp;
The Scientist Placeholder Image

Seeing and Sorting with Confidence

BD
The Scientist Placeholder Image

Streamlining Microbial Quality Control Testing

MicroQuant™ by ATCC logo

Products

The Scientist Placeholder Image

Agilent Unveils the Next Generation in LC-Mass Detection: The InfinityLab Pro iQ Series

parse-biosciences-logo

Pioneering Cancer Plasticity Atlas will help Predict Response to Cancer Therapies

waters-logo

How Alderley Analytical are Delivering eXtreme Robustness in Bioanalysis