Menu

Qualities Tied to Potential Scientific Bias

Overestimation of effect sizes in meta-analyses is linked with early-career status, small collaborations, or misconduct records, according to a study.

Mar 21, 2017
Kerry Grens

© BRYAN SATALINOLooking for patterns of potential bias in scientific studies, a Stanford University–based research team found a number of risk factors. Among more than 3,000 meta-analyses, small studies that were highly cited were more likely to contain bias, as were studies authored by scientists with a history of misconduct or by small but global research teams. On the other hand, the study, published in PNAS yesterday (March 20), found no association between bias and the authors’ country of origin giving incentives to individuals for performance, refuting the idea of a “publish or perish” environment.

“To the best of my knowledge, all the evidence that we have about pressures to publish comes from surveys, i.e. what scientists say. Now, there is no question that these pressures exist, we all feel them, and it is reasonable to suspect that they might have negative effects on the literature,” coauthor Daniele Fanelli told Retraction Watch. “However, as scientists we should verify empirically whether these concerns are justified or not. And, to the best of my current understanding, as explained above, evidence suggests that they are partially misguided.”

Fanelli and colleagues collected data from more than 3,000 meta-analyses, and looked for correlations among various characteristics, such as authors’ retraction history, citations, career level, and gender, as well as studies’ effect sizes. Scientists who had at least one retraction were more likely to overestimate effect sizes, as were small studies and those published in the “gray literature,” such as PhD theses and conference proceedings.

“Our results should reassure scientists that the scientific enterprise is not in jeopardy, that our understanding of bias in science is improving, and that efforts to improve scientific reliability are addressing the right priorities,” the authors wrote in their study. 

November 2018

Intelligent Science

Wrapping our heads around human smarts

Marketplace

Sponsored Product Updates

Slice® Safety Cutters for Lab Work

Slice® Safety Cutters for Lab Work

Slice cutting tools—which feature our patent-pending safety blades—meet many lab-specific requirements. Our scalpels and craft knives are well suited for delicate work, and our utility knives are good for general use.

The Lab of the Future: Alinity Poised to Reinvent Clinical Diagnostic Testing and Help Improve Healthcare

The Lab of the Future: Alinity Poised to Reinvent Clinical Diagnostic Testing and Help Improve Healthcare

Every minute counts when waiting for accurate diagnostic test results to guide critical care decisions, making today's clinical lab more important than ever. In fact, nearly 70 percent of critical care decisions are driven by a diagnostic test.

LGC announces new, integrated, global portfolio brand, Biosearch Technologies, representing genomic tools for mission critical customer applications

LGC announces new, integrated, global portfolio brand, Biosearch Technologies, representing genomic tools for mission critical customer applications

LGC’s Genomics division announced it is transforming its branding under LGC, Biosearch Technologies, a unified portfolio brand integrating optimised genomic analysis technologies and tools to accelerate scientific outcomes.