More Than 1 Percent of Clinical Trial Reports Appear Flawed

A new screening tool flags dozens of papers with potential errors.

Written byJef Akst
| 2 min read

Register for free to listen to this article
Listen with Speechify
0:00
2:00
Share

FLICKR, ESOAnalyzing 5,087 randomized controlled trials published between January 2000 and December 2015, John Carlisle, a consultant anesthetist at Torbay Hospital in the U.K., has found around 80 papers that raised cause for concern, with more than half very likely to contain errors in key data. Some of these papers have already been retracted, but many stand in the scientific literature.

While some of these errors may be the result of “misinterpretation, statistical error, or plain simple mistakes,” Carlisle says in a press release emailed to The Scientist, it’s likely that some of the research in question “may have been deliberately falsified.” He published his results today (June 5) in Anaesthesia.

“This study is about working to correct the scientific record,” Andrew Klein, the editor-in-chief of the journal, says in the press release. “The new Carlisle screening tool has been developed here in the U.K. and it is now clear that it should be used by medical publications around the world. The integrity of medical science demands that we do everything we can to ensure complete accuracy in the publication of research.”

Carlisle’s screening tool looks ...

Interested in reading more?

Become a Member of

The Scientist Logo
Receive full access to more than 35 years of archives, as well as TS Digest, digital editions of The Scientist, feature stories, and much more!
Already a member? Login Here

Related Topics

Meet the Author

  • Jef (an unusual nickname for Jennifer) got her master’s degree from Indiana University in April 2009 studying the mating behavior of seahorses. After four years of diving off the Gulf Coast of Tampa and performing behavioral experiments at the Tennessee Aquarium in Chattanooga, she left research to pursue a career in science writing. As The Scientist's managing editor, Jef edited features and oversaw the production of the TS Digest and quarterly print magazine. In 2022, her feature on uterus transplantation earned first place in the trade category of the Awards for Excellence in Health Care Journalism. She is a member of the National Association of Science Writers.

    View Full Profile
Share
Illustration of a developing fetus surrounded by a clear fluid with a subtle yellow tinge, representing amniotic fluid.
January 2026, Issue 1

What Is the Amniotic Fluid Composed of?

The liquid world of fetal development provides a rich source of nutrition and protection tailored to meet the needs of the growing fetus.

View this Issue
Skip the Wait for Protein Stability Data with Aunty

Skip the Wait for Protein Stability Data with Aunty

Unchained Labs
Graphic of three DNA helices in various colors

An Automated DNA-to-Data Framework for Production-Scale Sequencing

illumina
Exploring Cellular Organization with Spatial Proteomics

Exploring Cellular Organization with Spatial Proteomics

Abstract illustration of spheres with multiple layers, representing endoderm, ectoderm, and mesoderm derived organoids

Organoid Origins and How to Grow Them

Thermo Fisher Logo

Products

Brandtech Logo

BRANDTECH Scientific Introduces the Transferpette® pro Micropipette: A New Twist on Comfort and Control

Biotium Logo

Biotium Launches GlycoLiner™ Cell Surface Glycoprotein Labeling Kits for Rapid and Selective Cell Surface Imaging

Colorful abstract spiral dot pattern on a black background

Thermo Scientific X and S Series General Purpose Centrifuges

Thermo Fisher Logo
Abstract background with red and blue laser lights

VANTAstar Flexible microplate reader with simplified workflows

BMG LABTECH