Menu

Cancer Studies Seem Replicable

In the latest findings from the Reproducibility Project: Cancer Biology, independent researchers achieve results that mirror those of two earlier papers.

Jun 27, 2017
Kerry Grens

WIKIMEDIA, NATIONAL INSTITUTES OF HEALTHAs part of the Reproducibility Project: Cancer Biology, independent teams of researchers attempt to replicate the experiments in a few dozen highly cited papers published from 2010 to 2012. They’ve already reported the results of replicating five papers, and today (June 27), the results from re-doing the experiments of two more papers were posted in eLife, this time largely confirming the same conclusions as the original authors.

In one study, replicators copied the experiments from a 2011 Nature paper in which researchers used a drug to impede the growth of leukemia cells. In both studies, the inhibitor worked for a particular cell line and not another, yet unlike the original study, the replication attempt did not see increased survival in treated mice.

“Differences between the original study and this replication attempt, such as different conditioning regimens and doses [of the drug], are factors that might have influenced the outcome,” the replication team writes in its report.

Tony Kouzarides of the University of Cambridge who led the original Nature study, tells ScienceInsider that the discrepancy between the two attempts “highlights the pitfalls of biological research, namely, that different labs may vary conditions that affect the outcome of a given experiment.”

See “Replication complications

The other Reproducibility Project study replicated experiments from a 2010 Cancer Cell study examining genetic mutations underlying acute myeloid leukemia. For the most part, the replicators arrived at similar results, and they note in their report that subsequent studies have also backed up the 2010 conclusions.

Other replication attempts from the Reproducibility Project have not always come to the same results as the original papers. One published in January, for instance, did not find that an antibody therapy for breast cancer shrunk tumors in mice as the original authors observed. Another problem encountered by the replication team was that many of the tumors regressed spontaneously.

“This is an extremely important effort. Even though the published results pertain to only a small set of the larger project, the picture is convincing that reproducibility in cancer biology is very difficult to achieve,” Stanford University School of Medicine’s John Ioannidis, who was not involved with the project, told The Scientist in January. “I see the results not in a negative way . . . but as a reality check and as an opportunity to move in the right direction, which means more transparency, more openness, more detailed documentation of [methodology], and more honesty with ourselves.”

See “The rules of replication

July 2019

On Target

Researchers strive to make individualized medicine a reality

Marketplace

Sponsored Product Updates

DNASTAR® announced the release of Lasergene 16 Software
DNASTAR® announced the release of Lasergene 16 Software
DNASTAR® announced the release of Lasergene 16 today, which includes a broad range of improvements in for analysis of DNA, RNA and protein sequence data, as well as new advancements for predicting and analyzing protein structures. 
Arbor Biosciences Partners with Curio Genomics for Analysis of IWGSC Wheat Exome
Arbor Biosciences Partners with Curio Genomics for Analysis of IWGSC Wheat Exome
Arbor Biosciences, a division of Chiral Technologies, Inc and worldwide leader in next generation sequencing (NGS) target enrichment, announces a partnership with Curio Genomics for bioinformatics analysis of the wheat genome.
IDT and Washington University join forces to increase access to the latest NGS technologies
IDT and Washington University join forces to increase access to the latest NGS technologies
As part of its commitment to advocate for the genomics age, Integrated DNA Technologies (IDT) aims to lower the barriers to access the latest NGS technologies.
Bio-Rad Launches Bio-Plex Pro Human Immunotherapy Panel 20-plex Multiplex Assay, a targeted tool for researching signaling networks in Immunotherapy Research
Bio-Rad Launches Bio-Plex Pro Human Immunotherapy Panel 20-plex Multiplex Assay, a targeted tool for researching signaling networks in Immunotherapy Research
Bio-Rad Laboratories, Inc. (NYSE: BIO and BIOb) July 15, 2019 announced the launch of its Bio-Plex Pro Human Immunotherapy Panel 20-plex, a multiplex immunoassay that offers a targeted approach for Immunotherapy Research.