Menu

Qualities Tied to Potential Scientific Bias

Overestimation of effect sizes in meta-analyses is linked with early-career status, small collaborations, or misconduct records, according to a study.

Mar 21, 2017
Kerry Grens

© BRYAN SATALINOLooking for patterns of potential bias in scientific studies, a Stanford University–based research team found a number of risk factors. Among more than 3,000 meta-analyses, small studies that were highly cited were more likely to contain bias, as were studies authored by scientists with a history of misconduct or by small but global research teams. On the other hand, the study, published in PNAS yesterday (March 20), found no association between bias and the authors’ country of origin giving incentives to individuals for performance, refuting the idea of a “publish or perish” environment.

“To the best of my knowledge, all the evidence that we have about pressures to publish comes from surveys, i.e. what scientists say. Now, there is no question that these pressures exist, we all feel them, and it is reasonable to suspect that they might have negative effects on the literature,” coauthor Daniele Fanelli told Retraction Watch. “However, as scientists we should verify empirically whether these concerns are justified or not. And, to the best of my current understanding, as explained above, evidence suggests that they are partially misguided.”

Fanelli and colleagues collected data from more than 3,000 meta-analyses, and looked for correlations among various characteristics, such as authors’ retraction history, citations, career level, and gender, as well as studies’ effect sizes. Scientists who had at least one retraction were more likely to overestimate effect sizes, as were small studies and those published in the “gray literature,” such as PhD theses and conference proceedings.

“Our results should reassure scientists that the scientific enterprise is not in jeopardy, that our understanding of bias in science is improving, and that efforts to improve scientific reliability are addressing the right priorities,” the authors wrote in their study. 

April 2019

Will Car T Cells Smash Tumors?

New trials take the therapy beyond the blood

Marketplace

Sponsored Product Updates

Getting More Consistent Results by Knowing the Quality of Your Protein
Getting More Consistent Results by Knowing the Quality of Your Protein
Download this guide from NanoTemper to learn how to identify and evaluate the quality of your protein samples!
Myth Busting: The Best Way to Use Pure Water in the Lab
Myth Busting: The Best Way to Use Pure Water in the Lab
Download this white paper from ELGA LabWater to learn about the role of pure water in the laboratory and the advantages of in-house water purification!
Shimadzu's New Nexera UHPLC Series with AI and IoT Enhancements Sets Industry Standard for Intelligence, Efficiency and Design
Shimadzu's New Nexera UHPLC Series with AI and IoT Enhancements Sets Industry Standard for Intelligence, Efficiency and Design
Shimadzu Corporation announces the release of the Nexera Ultra High-Performance Liquid Chromatograph series, incorporating artificial intelligence as Analytical Intelligence, allowing systems to detect and resolve issues automatically. The Nexera series makes lab management simple by integrating IoT and device networking, enabling users to easily review instrument status, optimize resource allocation, and achieve higher throughput.
IDT lowers genomic barriers with powerful rhAmpSeq™ targeted sequencing system
IDT lowers genomic barriers with powerful rhAmpSeq™ targeted sequencing system
Increasing accuracy and reducing cost barriers, IDT’s innovative system delivers simple and cost-effective amplicon sequencing