More Than 1 Percent of Clinical Trial Reports Appear Flawed

A new screening tool flags dozens of papers with potential errors.

Written byJef Akst
| 2 min read

Register for free to listen to this article
Listen with Speechify
0:00
2:00
Share

FLICKR, ESOAnalyzing 5,087 randomized controlled trials published between January 2000 and December 2015, John Carlisle, a consultant anesthetist at Torbay Hospital in the U.K., has found around 80 papers that raised cause for concern, with more than half very likely to contain errors in key data. Some of these papers have already been retracted, but many stand in the scientific literature.

While some of these errors may be the result of “misinterpretation, statistical error, or plain simple mistakes,” Carlisle says in a press release emailed to The Scientist, it’s likely that some of the research in question “may have been deliberately falsified.” He published his results today (June 5) in Anaesthesia.

“This study is about working to correct the scientific record,” Andrew Klein, the editor-in-chief of the journal, says in the press release. “The new Carlisle screening tool has been developed here in the U.K. and it is now clear that it should be used by medical publications around the world. The integrity of medical science demands that we do everything we can to ensure complete accuracy in the publication of research.”

Carlisle’s screening tool looks ...

Interested in reading more?

Become a Member of

The Scientist Logo
Receive full access to more than 35 years of archives, as well as TS Digest, digital editions of The Scientist, feature stories, and much more!
Already a member? Login Here

Related Topics

Meet the Author

  • Jef (an unusual nickname for Jennifer) got her master’s degree from Indiana University in April 2009 studying the mating behavior of seahorses. After four years of diving off the Gulf Coast of Tampa and performing behavioral experiments at the Tennessee Aquarium in Chattanooga, she left research to pursue a career in science writing. As The Scientist's managing editor, Jef edited features and oversaw the production of the TS Digest and quarterly print magazine. In 2022, her feature on uterus transplantation earned first place in the trade category of the Awards for Excellence in Health Care Journalism. She is a member of the National Association of Science Writers.

    View Full Profile
Share
Image of small blue creatures called Nergals. Some have hearts above their heads, which signify friendship. There is one Nergal who is sneezing and losing health, which is denoted by minus one signs floating around it.
June 2025, Issue 1

Nergal Networks: Where Friendship Meets Infection

A citizen science game explores how social choices and networks can influence how an illness moves through a population.

View this Issue
An illustration of green lentiviral particles.

Maximizing Lentivirus Recovery

cytiva logo
Unraveling Complex Biology with Advanced Multiomics Technology

Unraveling Complex Biology with Five-Dimensional Multiomics

Element Bioscience Logo
Resurrecting Plant Defense Mechanisms to Avoid Crop Pathogens

Resurrecting Plant Defense Mechanisms to Avoid Crop Pathogens

Twist Bio 
The Scientist Placeholder Image

Seeing and Sorting with Confidence

BD

Products

The Scientist Placeholder Image

Waters Enhances Alliance iS HPLC System Software, Setting a New Standard for End-to-End Traceability and Data Integrity 

The Scientist Placeholder Image

Agilent Unveils the Next Generation in LC-Mass Detection: The InfinityLab Pro iQ Series

agilent-logo

Agilent Announces the Enhanced 8850 Gas Chromatograph

parse-biosciences-logo

Pioneering Cancer Plasticity Atlas will help Predict Response to Cancer Therapies