Core Rigor and Reproducibility (CCoRRe) Resources
CCoRRe serves as a central access point for information related to best practices, important publications, and resources related to rigor, reproducibility, and transparency (RRT) in research. Committee activities are motivated by the conviction that shared research resources are critical to support and enhance RRT. To request the addition of new materials or links, please contact the CCoRRe Team (ccorre@abrf.memberclicks.net).
Opportunities
NIH Guidance on RR&T
-
Enhancing Reproducibility through Rigor and Transparency
-
NOT-OD-15-103: Enhancing Reproducibility through Rigor and Transparency (RRT)
-
NOT-OD-16-011: Implementing Rigor and Transparency in NIH & AHRQ Research Grant Applications
-
NOT-OD-16-012: Implementing Rigor and Transparency in NIH & AHRQ Career Development Award Applications
-
NOT-OD-16-034: Advanced Notice of Coming Requirements for Formal Instruction in Rigorous Experimental Design and Transparency to Enhance Reproducibility: NIH and AHRQ Institutional Training Grants, Institutional Career Development Awards, and Individual Fellowships
Best Practice Examples from Core Facilities
Rigor, Reproducibility, and Transparency Publications
Critical Articles
- Reproducibility and Replicability in Science. The National Academies Press; 2019.
- Leek JT, Jager LR. Is Most Published Research Really False? Annual Review of Statistics and Its Application. 2017;4(1):109-122. doi:10.1146/annurev-statistics-060116-054104
- Bustin SA. The reproducibility of biomedical research: Sleepers awake! Biomol Detect Quantif. Dec 2014;2:35-42. doi:10.1016/j.bdq.2015.01.002
- Freedman LP, Inglese J. The increasing urgency for standards in basic biologic research. Cancer Res. Aug 1 2014;74(15):4024-9. doi:10.1158/0008-5472.CAN-14-0925
- Chang M, Grieder FB. Sharing Core Facilities and Research Resources--An Investment in Accelerating Scientific Discoveries. J Biomol Tech. Apr 2016;27(1):2-3. doi:10.7171/jbt.16-2701-004
- Nosek BA, Alter G, Banks GC, et al. SCIENTIFIC STANDARDS. Promoting an open research culture. Science. Jun 26 2015;348(6242):1422-5. doi:10.1126/science.aab2374
- Munafo MR, Nosek BA, Bishop DVM, et al. A manifesto for reproducible science. Nat Hum Behav. Jan 10 2017;1:0021.
- Reality check on reproducibility. Nature. May 26 2016;533(7604):437. doi:10.1038/533437a
- Freedman LP, Venugopalan G, Wisman R. Reproducibility2020: Progress and priorities. F1000Res. 2017;6:604. doi:10.12688/f1000research.11334.1
- National Academies of Sciences Engineering and Medicine (U.S.). Committee on Reproducibility and Replicability in Science, National Academies of Sciences Engineering and Medicine (U.S.). Nuclear and Radiation Studies Board, National Academies of Sciences Engineering and Medicine (U.S.). Board on Research Data and Information, National Academies of Sciences Engineering and Medicine (U.S.). Board on Mathematical Sciences and Analytics. Reproducibility and replicability in science. A consensus study report of the National Academies of Sciences, Engineering, Medicine. National Academies Press; 2019:xxi, 234 pages.
- Jamieson KH. Crisis or self-correction: Rethinking media narratives about the well-being of science. Proc Natl Acad Sci U S A. Mar 13 2018;115(11):2620-2627. doi:10.1073/pnas.1708276114
- Fostering Integrity in Research. The National Academies Press; 2017.
- Data Matters: Ethics, Data, and International Research Collaboration in a Changing World: Proceedings of a Workshop. The National Academies Press; 2018.
- Baker M. 1,500 scientists lift the lid on reproducibility. Nature. May 26 2016;533(7604):452-4. doi:10.1038/533452a
- Begley CG, Ellis LM. Drug development: Raise standards for preclinical cancer research. Nature. Mar 28 2012;483(7391):531-3. doi:10.1038/483531a
- Hutson M. Artificial intelligence faces reproducibility crisis. Science. Feb 16 2018;359(6377):725-726. doi:10.1126/science.359.6377.725
- Open Science C. PSYCHOLOGY. Estimating the reproducibility of psychological science. Science. Aug 28 2015;349(6251):aac4716. doi:10.1126/science.aac4716
ABRF RG Results / Best Practices
- Under Construction
CCoRRe Committee Membership
- Andrew Ott, Northwestern University (Co-Chair)
- Jenn Page, Salk Institute (Co-Chair)
- Patricia Basta, University of North Carolina at Chapel Hill
- Sridar Chittur - SUNY Albany
- Joseph Dragavon, (Executive Board Liaison) - University of Colorado, Boulder
- Christopher Gregory, University of North Carolina School of Medicine
- Kevin Knudtson, University of Iowa
- Katia Sol-Church, University of Virginia
- Caterina Strambio-De-Castillia, University of Massachusetts Medical School
- Michael Sturges, Miltenyi Biotec
- Doug Taatjes, University of Vermont
- Frances Weis-Garcia, Memorial Sloan Kettering Cancer Center
- Nicole (Amanda) White, Cincinnati Children's Hospital Research Foundation
