MAY 14, 2020 9:00 AM PDT

PANEL: Experimental design and the reproducibility crisis: pitfalls, power, and practical best practice

Speakers
  • Associate Professor of Comparative Medicine and, By Courtesy, of Psychiatry and Behavioral Sciences, Stanford University Medical Center
    BIOGRAPHY
  • Associate Professor of Animal Welfare, Animal Sciences, Purdue University, College of Agriculture
    BIOGRAPHY

Abstract

The justification of sample size is one of the hardest sections of a proposal an IACUC (ethical review board) has to assess, yet is arguably one of the most important (1). This is a key opportunity for the IACUC to assess whether the experiment is well designed, whether animals are being used in the most efficient and productive way possible (2), and even whether the experiment is worth pursuing in its proposed design (3).

Poor experimental design and poor statistics have two consequences of concern to an IACUC: 1) they increase sample size; and 2) they generate false positives which may then commit animals to further unnecessary experiments. To provide perspective on this issue, consider the fact that only 10% of compounds that ‘work’ in an animal model actually ‘work’ in human trials (4) – that is the false positive rate in terms of human outcomes of animal models is 90%. Poor experimental design plays a huge role in this highly wasteful (and invasive) use of animals (5-7). Similarly, although estimates vary, a very large proportion of published papers contain basic statistical errors (8). For example 38% of papers in a recent review of work published in Nature Medicine contained basic statistical errors (9). Similarly a review of top-tier neuroscience journals revealed basic errors in 50% of behavioral neuroscience papers, and 100% of molecular neuroscience papers surveyed (10).

Learning Objectives:

1. This talk will go over in everyday terms, the reasons why good experimental design is so important, what it should look like in an IACUC proposal, how to identify reasonable and unreasonable sample sizes, and how to identify when improved experimental design may allow a PI to perform the same work better with fewer animals.

2. This talk will be user friendly (it won’t use equations), and the goal is to provide a set of rules of thumb for quick assessment of experimental design and sample size so that IACUC members can triage out protocols where they might want to seek input from a statistician.


Show Resources
You May Also Like
SEP 14, 2021 7:00 AM PDT
C.E. CREDITS
SEP 14, 2021 7:00 AM PDT
Date: September 14, 2021 Time: 7am PDT, 10am EDT, 4pm CEST A conventional thermal cycler has long been a commodity product in the lab and end-point PCR techniques can be completed almost wit...
NOV 30, 2021 10:00 AM PST
C.E. CREDITS
NOV 30, 2021 10:00 AM PST
Date: November 30, 2021 Time: 10:00am (PDT), 1:00pm (EDT) The prevalence of thyroid disease worldwide has served as a catalyst for healthcare providers to study various tools and methods to...
OCT 20, 2021 10:00 AM PDT
C.E. CREDITS
OCT 20, 2021 10:00 AM PDT
Date: October 20, 2021 Time:10:00am (PDT), 1:00pm (EDT) As the prevalence of Diabetes continues to rise in many areas across the globe, healthcare providers continue to look for methods that...
OCT 12, 2021 9:00 AM PDT
C.E. CREDITS
OCT 12, 2021 9:00 AM PDT
Date: October 12, 2021 Time: 9:00am (PDT), 12:00pm (EDT) SCIEX’s next-generation Biologics Explorer software is an innovative platform for the comprehensive and deep characterization o...
NOV 17, 2021 8:00 AM PST
C.E. CREDITS
NOV 17, 2021 8:00 AM PST
Date: November 17, 2021 Time: 8:00am (PDT), 11:00am (EDT) From waste disposal to promising biomarkers and therapeutic agents, exosomes and other extracellular vesicles are valuable in resear...
OCT 27, 2021 6:00 AM PDT
C.E. CREDITS
OCT 27, 2021 6:00 AM PDT
Date: October 27, 2021 Time: 6:00 AM PDT, 9:00 AM EDT Etanercept is a recombinant Fc fusion protein therapeutic that has a complex distribution of post-translation modifications (PTM), such...
Loading Comments...
Show Resources