Advertisement

Beware of Striking Medical Studies

A large-scale statistical analysis shows that medical studies revealing “very large effects” seldom stand up when other researchers try to replicate them.

By | October 25, 2012

Wikimedia, BmramonClinical trials that find very large effects for medical treatments tend not to hold up under further scrutiny, according a study published this week (October 24) in the Journal of the American Medical Association. The authors say the findings should be a reminder to be cautious about exciting early studies.

Analyzing data from 230,000 clinical trials across various disciplines, a team led by Stanford University epidemiologist John Ioannadis found that researchers rarely succeed in replicating study results that claimed a “very large effect.” “The effects largely go away; they become much smaller,” Ioannidis told the Los Angeles Times. “It's likely that most interventions that are effective have modest effects.”

The analysis also revealed that studies reporting outstanding results tended to have used fewer than 100 subjects, so the effects are more likely to be influenced by chance. Moreover, “very large effect” studies usually measure intermediate effects, such as whether statins reduce LDL cholesterol in the blood, rather than more meaningful outcomes like the incidence of disease or death.

The authors suggest that the results should reiterate to patients, physicians, and policymakers that drugs or devices that get glowing reports in small, early-stage trials should be treated with caution—rather than rushed through for approval.

Gordon Guyatt, a clinical epidemiologist at McMaster University in Hamilton, Canada, who was not involved in the study, agreed. People tend to “get excited, and misguidedly so” by these “very large effect” results, he told the LA Times.

(Hat tip to GenomeWeb)

Advertisement

Add a Comment

Avatar of: You

You

Processing...
Processing...

Sign In with your LabX Media Group Passport to leave a comment

Not a member? Register Now!

LabX Media Group Passport Logo
Advertisement
Eppendorf
Eppendorf

Popular Now

  1. Antibody Maker Loses License Over Animal Welfare Violations
  2. ORI: Researcher Faked Dozens of Experiments
    The Nutshell ORI: Researcher Faked Dozens of Experiments

    A former scientist at the University of Michigan and the University of Chicago made up more than 70 experiments on heart cells, according to the Office of Research Integrity.

  3. Exploring Emotional Contagion
  4. Amyloid Thwarts Microbial Invaders
    Daily News Amyloid Thwarts Microbial Invaders

    Alzheimer’s disease–associated amyloid-β peptides trap microbes in the brains of mice and in the guts of nematodes, a study shows. 

Advertisement
Advertisement
LabX
LabX
Biosearch Technologies
illumina Corporate
illumina Corporate