JUN 23, 2015 12:03 PM PDT

The Cost of Bad Data

WRITTEN BY: Kerry Evans
The United States loses $28 billion on irreproducible pre-clinical research every year. Leonard Freedman, Iain Cockburn, and Timothy Simcoe tabulate this figure in their recent PLOS Biology article (http://journals.plos.org/plosbiology/article?id=10.1371/journal.pbio.1002165). They also offer solutions to the problem of irreproducibility in the pre-clinical and life sciences, an issue addressed by the National Institutes of Health (NIH) in 2012 with their Reproducibility Initiative and commented on by microbiologists Arturo Casadevall and Ferric Fang in Infection and Immunity (http://iai.asm.org/content/80/3/897.full and http://iai.asm.org/content/80/3/891.full).
Irreproducible data costs the US an estimated $28 billion each year.
Freedman contends that roughly 50% of pre-clinical research conducted annually in the U.S. is irreproducible, costing around $28 billion, half of the total $56.4 billion spent on pre-clinical research. He defines irreproducibility as "the existence and propagation of one or more errors, flaws, inadequacies, or omissions that prevent replication of results." Freedman also identifies four primary causes of irreproducibility: 1) study design, 2) biological reagents and reference materials, 3) laboratory protocols, and 4) data analysis and reporting.

He suggests the solution lies in a standard of best practices similar to those developed for the Internet by the World Wide Web Consortium (W3C) and the Internet Engineering Task Force (IETF). Specifically, Freedman suggests applying such standards to the problem of misidentified cancer cell lines. The NIH funds roughly $3.7 billion in research annually using cell lines, and Freedman estimates roughly a quarter of this work is irreproducible due to contaminated or misidentified lines. What's more, Freedman's organization, the Global Biological Standards Institute, has already launched a campaign aimed at authenticating cell lines (http://www.gbsi.org/work/authenticate/).

Too melodramatic? Critics think so. Stefano Bertuzzi, executive director of the American Society for Cell Biology, posted a rebuttal on the society's blog (http://ascb.org/imaginary-numbers-and-the-real-irreproducibility-crisis-in-preclinical-research/), and according to Ferric Fang, "to suggest that 50% of research dollars are being wasted is ridiculous and unhelpful" (Science Insider).

(Sources: PLOS Biology, www.the-scientist.com, Infection and Immunity, www.news.sciencemag.org, www.gbsi.org, www.ascb.org)
About the Author
  • Kerry received a doctorate in microbiology from the University of Arkansas for Medical Sciences.
You May Also Like
DEC 16, 2020
Clinical & Molecular DX
Gene Marker PACS a Punch for Cervical Cancer Treatments
DEC 16, 2020
Gene Marker PACS a Punch for Cervical Cancer Treatments
In cervical cancer, mutations in healthy cells cause cells to grow and multiply uncontrollably, invading surrounding tis ...
DEC 27, 2020
Immunology
Thymus Transplantation?! It Could be Possible!
DEC 27, 2020
Thymus Transplantation?! It Could be Possible!
The thymus is an essential organ of the lymphatic system; it is responsible for developing mature T cells. T c ...
DEC 23, 2020
Health & Medicine
Holiday Cheer: Americans Swap Alcohol for Cannabis this Christmas
DEC 23, 2020
Holiday Cheer: Americans Swap Alcohol for Cannabis this Christmas
Cannabis users polled by Glasshouse Group — a California-based cannabis and hemp company, which runs several dispe ...
DEC 23, 2020
Immunology
COVID Survivors Stay Immune for at Least a Year
DEC 23, 2020
COVID Survivors Stay Immune for at Least a Year
Once the coronavirus enters the body, the immune system springs into action, producing antibodies that bind to and neutr ...
DEC 28, 2020
Cell & Molecular Biology
How an Herbal Compound May Fight Pancreatic Cancer
DEC 28, 2020
How an Herbal Compound May Fight Pancreatic Cancer
For centuries, Chinese practitioners have used herbs to treat all kinds of ailments. New research has shown that one of ...
JAN 06, 2021
Immunology
What's Causing Prostate Cancer Patients to Doze Off?
JAN 06, 2021
What's Causing Prostate Cancer Patients to Doze Off?
For prostate cancer patients, androgen deprivation therapy or ADT is a standard treatment aimed at stalling the growth o ...
Loading Comments...