High Risk of Bias in Early COVID-19 Studies: Meta-Analysis

Few peer-reviewed clinical papers on the pandemic contained original data, and many of those that did had poor experimental design.

Written byMax Kozlov
| 5 min read

Register for free to listen to this article
Listen with Speechify
0:00
5:00
Share

ABOVE: © ISTOCK.COM,
BRIANAJACKSON

As scientists led initial investigations into the novel coronavirus last winter and spring, journal publishers saw an enormous surge in COVID-19 publications. A study published January 4 in BMC Medical Research Methodology reports that the majority of early clinical studies on the pandemic lacked original data, and those that did were rushed and did not include the appropriate measures to reduce bias.

The researchers evaluated more than 10,000 COVID-19–related medical papers published in English or Chinese before May 2020. Among peer-reviewed papers, the researchers found that 56.1 percent were opinions that did not contain any new data. Original articles that included patient data represented only 9.6 percent of the peer-reviewed studies. The researchers then evaluated the quality of research of the original articles using validated tools to assess study design and concluded that 80 percent were at risk of bias, mainly because of few participants, short follow-up ...

Interested in reading more?

Become a Member of

The Scientist Logo
Receive full access to more than 35 years of archives, as well as TS Digest, digital editions of The Scientist, feature stories, and much more!
Already a member? Login Here

Related Topics

Meet the Author

  • Max is a science journalist from Boston. Though he studied cognitive neuroscience, he now prefers to write about brains rather than research them. Prior to writing for The Scientist as an editorial intern in late 2020 and early 2021, Max worked at the Museum of Science in Boston, where his favorite part of the job was dressing in a giant bee costume and teaching children about honeybees. He was also a AAAS Mass Media Fellow, where he worked as a science reporter for the St. Louis Post-Dispatch. Read more of his work at www.maxkozlov.com.

    View Full Profile
Share
Image of a woman with her hands across her stomach. She has a look of discomfort on her face. There is a blown up image of her stomach next to her and it has colorful butterflies and gut bacteria all swarming within the gut.
November 2025, Issue 1

Why Do We Feel Butterflies in the Stomach?

These fluttering sensations are the brain’s reaction to certain emotions, which can be amplified or soothed by the gut’s own “bugs".

View this Issue
Olga Anczukow and Ryan Englander discuss how transcriptome splicing affects immune system function in lung cancer.

Long-Read RNA Sequencing Reveals a Regulatory Role for Splicing in Immunotherapy Responses

Pacific Biosciences logo
Research Roundtable: The Evolving World of Spatial Biology

Research Roundtable: The Evolving World of Spatial Biology

Conceptual cartoon image of gene editing technology

Exploring the State of the Art in Gene Editing Techniques

Bio-Rad
Conceptual image of a doctor holding a brain puzzle, representing Alzheimer's disease diagnosis.

Simplifying Early Alzheimer’s Disease Diagnosis with Blood Testing

fujirebio logo

Products

Eppendorf Logo

Research on rewiring neural circuit in fruit flies wins 2025 Eppendorf & Science Prize

Evident Logo

EVIDENT's New FLUOVIEW FV5000 Redefines the Boundaries of Confocal and Multiphoton Imaging

Evident Logo

EVIDENT Launches Sixth Annual Image of the Year Contest

10x Genomics Logo

10x Genomics Launches the Next Generation of Chromium Flex to Empower Scientists to Massively Scale Single Cell Research