JUN 23, 2015 12:03 PM PDT

The Cost of Bad Data

WRITTEN BY: Kerry Evans
The United States loses $28 billion on irreproducible pre-clinical research every year. Leonard Freedman, Iain Cockburn, and Timothy Simcoe tabulate this figure in their recent PLOS Biology article (http://journals.plos.org/plosbiology/article?id=10.1371/journal.pbio.1002165). They also offer solutions to the problem of irreproducibility in the pre-clinical and life sciences, an issue addressed by the National Institutes of Health (NIH) in 2012 with their Reproducibility Initiative and commented on by microbiologists Arturo Casadevall and Ferric Fang in Infection and Immunity (http://iai.asm.org/content/80/3/897.full and http://iai.asm.org/content/80/3/891.full).
Irreproducible data costs the US an estimated $28 billion each year.
Freedman contends that roughly 50% of pre-clinical research conducted annually in the U.S. is irreproducible, costing around $28 billion, half of the total $56.4 billion spent on pre-clinical research. He defines irreproducibility as "the existence and propagation of one or more errors, flaws, inadequacies, or omissions that prevent replication of results." Freedman also identifies four primary causes of irreproducibility: 1) study design, 2) biological reagents and reference materials, 3) laboratory protocols, and 4) data analysis and reporting.

He suggests the solution lies in a standard of best practices similar to those developed for the Internet by the World Wide Web Consortium (W3C) and the Internet Engineering Task Force (IETF). Specifically, Freedman suggests applying such standards to the problem of misidentified cancer cell lines. The NIH funds roughly $3.7 billion in research annually using cell lines, and Freedman estimates roughly a quarter of this work is irreproducible due to contaminated or misidentified lines. What's more, Freedman's organization, the Global Biological Standards Institute, has already launched a campaign aimed at authenticating cell lines (http://www.gbsi.org/work/authenticate/).

Too melodramatic? Critics think so. Stefano Bertuzzi, executive director of the American Society for Cell Biology, posted a rebuttal on the society's blog (http://ascb.org/imaginary-numbers-and-the-real-irreproducibility-crisis-in-preclinical-research/), and according to Ferric Fang, "to suggest that 50% of research dollars are being wasted is ridiculous and unhelpful" (Science Insider).

(Sources: PLOS Biology, www.the-scientist.com, Infection and Immunity, www.news.sciencemag.org, www.gbsi.org, www.ascb.org)
About the Author
  • Kerry received a doctorate in microbiology from the University of Arkansas for Medical Sciences.
You May Also Like
OCT 04, 2021
Health & Medicine
Guillain-Barre Syndrome After COVID-19 Infection
OCT 04, 2021
Guillain-Barre Syndrome After COVID-19 Infection
Researchers with the International GBS Outcome Study (IGOS) investigated newly-diagnosed GBS patients from the beginning ...
OCT 06, 2021
Genetics & Genomics
Signs of Huntington's Disease in Early Embryonic Development
OCT 06, 2021
Signs of Huntington's Disease in Early Embryonic Development
Huntington's disease is a neurodegenerative disorder that's caused by mutations in the huntingtin gene. People can be di ...
OCT 07, 2021
Neuroscience
Unclogged: Constipation Drug May Stimulate Memory and Cognition
OCT 07, 2021
Unclogged: Constipation Drug May Stimulate Memory and Cognition
A drug commonly prescribed for constipation shows promise for memory and cognition
OCT 12, 2021
Immunology
Major Landmark in a 100-Year Search for a Malaria Vaccine
OCT 12, 2021
Major Landmark in a 100-Year Search for a Malaria Vaccine
In one of the greatest global health milestones of our time, the World Health Organization has approved the widespread d ...
OCT 13, 2021
Cardiology
Low-Dose Aspirin as Preventive Medication? Recommendations Have Changed
OCT 13, 2021
Low-Dose Aspirin as Preventive Medication? Recommendations Have Changed
Heart disease is the primary cause of death in the United States. It's estimated that every year, about 605,000 American ...
OCT 19, 2021
Cell & Molecular Biology
Mouse Fathers Passed Immunity Onto Offpsring After Infection
OCT 19, 2021
Mouse Fathers Passed Immunity Onto Offpsring After Infection
Parents pass their genes on to their children. But they can pass down other things too with epigenetic marks, chemical t ...
Loading Comments...