Menu

Cancer Studies Seem Replicable

In the latest findings from the Reproducibility Project: Cancer Biology, independent researchers achieve results that mirror those of two earlier papers.

Jun 27, 2017
Kerry Grens

WIKIMEDIA, NATIONAL INSTITUTES OF HEALTHAs part of the Reproducibility Project: Cancer Biology, independent teams of researchers attempt to replicate the experiments in a few dozen highly cited papers published from 2010 to 2012. They’ve already reported the results of replicating five papers, and today (June 27), the results from re-doing the experiments of two more papers were posted in eLife, this time largely confirming the same conclusions as the original authors.

In one study, replicators copied the experiments from a 2011 Nature paper in which researchers used a drug to impede the growth of leukemia cells. In both studies, the inhibitor worked for a particular cell line and not another, yet unlike the original study, the replication attempt did not see increased survival in treated mice.

“Differences between the original study and this replication attempt, such as different conditioning regimens and doses [of the drug], are factors that might have influenced the outcome,” the replication team writes in its report.

Tony Kouzarides of the University of Cambridge who led the original Nature study, tells ScienceInsider that the discrepancy between the two attempts “highlights the pitfalls of biological research, namely, that different labs may vary conditions that affect the outcome of a given experiment.”

See “Replication complications

The other Reproducibility Project study replicated experiments from a 2010 Cancer Cell study examining genetic mutations underlying acute myeloid leukemia. For the most part, the replicators arrived at similar results, and they note in their report that subsequent studies have also backed up the 2010 conclusions.

Other replication attempts from the Reproducibility Project have not always come to the same results as the original papers. One published in January, for instance, did not find that an antibody therapy for breast cancer shrunk tumors in mice as the original authors observed. Another problem encountered by the replication team was that many of the tumors regressed spontaneously.

“This is an extremely important effort. Even though the published results pertain to only a small set of the larger project, the picture is convincing that reproducibility in cancer biology is very difficult to achieve,” Stanford University School of Medicine’s John Ioannidis, who was not involved with the project, told The Scientist in January. “I see the results not in a negative way . . . but as a reality check and as an opportunity to move in the right direction, which means more transparency, more openness, more detailed documentation of [methodology], and more honesty with ourselves.”

See “The rules of replication

February 2019

Big Storms Brewing

Can forests weather more major hurricanes?

Marketplace

Sponsored Product Updates

Bio-Rad Releases First FDA-Cleared Digital PCR System and Test for Monitoring Chronic Myeloid Leukemia Treatment Response
Bio-Rad Releases First FDA-Cleared Digital PCR System and Test for Monitoring Chronic Myeloid Leukemia Treatment Response
Bio-Rad Laboratories, Inc. (NYSE: BIO and BIOb), a global leader of life science research and clinical diagnostic products, today announced that its QXDx AutoDG ddPCR System, which uses Bio-Rad’s Droplet Digital PCR technology, and the QXDx BCR-ABL %IS Kit are the industry’s first digital PCR products to receive U.S. Food and Drug Administration (FDA) clearance. Used together, Bio-Rad’s system and kit can precisely and reproducibly monitor molecular response to treatment in patients with chronic myeloid leukemia (CML).
Bio-Rad Showcases New Automation Features of its ZE5 Cell Analyzer at SLAS 2019
Bio-Rad Showcases New Automation Features of its ZE5 Cell Analyzer at SLAS 2019
Bio-Rad Laboratories, Inc. (NYSE: BIO and BIOb) today showcases new automation features of its ZE5 Cell Analyzer during the Society for Laboratory Automation and Screening 2019 International Conference and Exhibition (SLAS) in Washington, D.C., February 2–6. These capabilities enable the ZE5 to be used for high-throughput flow cytometry in biomarker discovery and phenotypic screening.
Andrew Alliance and Sartorius Collaborate to Provide Software-Connected Pipettes for Life Science Research
Andrew Alliance and Sartorius Collaborate to Provide Software-Connected Pipettes for Life Science Research
Researchers to benefit from an innovative software-connected pipetting system, bringing improved reproducibility and traceability of experiments to life-science laboratories.
Corning Life Sciences to Feature 3D Cell Culture Technologies at SLAS 2019
Corning Life Sciences to Feature 3D Cell Culture Technologies at SLAS 2019
Corning Incorporated (NYSE: GLW) will showcase advanced 3D cell culture technologies and workflow solutions for spheroids, organoids, tissue models, and applications including ADME/toxicology at the Society for Laboratory Automation and Screening (SLAS) conference, Feb. 2-6 in Washington, D.C.