Menu

Cancer Studies Seem Replicable

In the latest findings from the Reproducibility Project: Cancer Biology, independent researchers achieve results that mirror those of two earlier papers.

Jun 27, 2017
Kerry Grens

WIKIMEDIA, NATIONAL INSTITUTES OF HEALTHAs part of the Reproducibility Project: Cancer Biology, independent teams of researchers attempt to replicate the experiments in a few dozen highly cited papers published from 2010 to 2012. They’ve already reported the results of replicating five papers, and today (June 27), the results from re-doing the experiments of two more papers were posted in eLife, this time largely confirming the same conclusions as the original authors.

In one study, replicators copied the experiments from a 2011 Nature paper in which researchers used a drug to impede the growth of leukemia cells. In both studies, the inhibitor worked for a particular cell line and not another, yet unlike the original study, the replication attempt did not see increased survival in treated mice.

“Differences between the original study and this replication attempt, such as different conditioning regimens and doses [of the drug], are factors that might have influenced the outcome,” the replication team writes in its report.

Tony Kouzarides of the University of Cambridge who led the original Nature study, tells ScienceInsider that the discrepancy between the two attempts “highlights the pitfalls of biological research, namely, that different labs may vary conditions that affect the outcome of a given experiment.”

See “Replication complications

The other Reproducibility Project study replicated experiments from a 2010 Cancer Cell study examining genetic mutations underlying acute myeloid leukemia. For the most part, the replicators arrived at similar results, and they note in their report that subsequent studies have also backed up the 2010 conclusions.

Other replication attempts from the Reproducibility Project have not always come to the same results as the original papers. One published in January, for instance, did not find that an antibody therapy for breast cancer shrunk tumors in mice as the original authors observed. Another problem encountered by the replication team was that many of the tumors regressed spontaneously.

“This is an extremely important effort. Even though the published results pertain to only a small set of the larger project, the picture is convincing that reproducibility in cancer biology is very difficult to achieve,” Stanford University School of Medicine’s John Ioannidis, who was not involved with the project, told The Scientist in January. “I see the results not in a negative way . . . but as a reality check and as an opportunity to move in the right direction, which means more transparency, more openness, more detailed documentation of [methodology], and more honesty with ourselves.”

See “The rules of replication

December 2018

Invisible Borders

An emerging appreciation for membraneless organelles and the liquid dynamics that shape them

Marketplace

Sponsored Product Updates

Using CDD Vault to Manage Redbrid Molecular Ltd. Catalogues - A Case Study
Using CDD Vault to Manage Redbrid Molecular Ltd. Catalogues - A Case Study
Check out this case study to find out why Redbrick Molecular Ltd. chose CDD Vault as their database and informatics platform, and how they made use of the CDD Vault to implement a complex catalogue in a simple way.
New automated N-glycan profiling web app shaves days off of data interpretation for glycobiologists
New automated N-glycan profiling web app shaves days off of data interpretation for glycobiologists
The first automated, web-based application that enables routine use of enzymatic digestions to improve N-glycan analyses from New England Biolabs (NEB). This software not only saves precious times for glycobiologists who are more attuned to traditional methods, but also provides the most accurate interpretation of glycan enzymatic digestion data on the market.
Recapitulating 3-D Microenvironments In Vitro Using Hollow Fiber Bioreactors
Recapitulating 3-D Microenvironments In Vitro Using Hollow Fiber Bioreactors
Download this white paper from FiberCell Systems to learn about how HFBRs are used in single cell-type/multi cell-type assays, antiviral and anticancer drug evaluations, and generating 3-D cellular models!
Using Centrifugal Ultrafiltration for Cloning and PCR
Using Centrifugal Ultrafiltration for Cloning and PCR
Learn about how centrifugal ultrafiltration devices can provide a more streamlined cloning process with this application note from PALL Laboratory!