Reproducibility in Research
Three test tubes, one bubbling over and making a mess.

A lack of consistent reproducibility in some pre-clinical research has serious implications for translating those findings from bench to bedside. This is a problem that requires urgent corrective action. Restoring confidence in the rigor of pre-clinical biomedical research will require all stakeholders to be a part of the solution, including basic scientists, academic institutions, industry, and publishers.

Reproducibility Symposia

Avoiding Common Pitfalls in Preclinical Animal Research Design

James Fox (Massachusetts Institute of Technology), Valerie Hamilton (Merck), and Tom Cheever (NIAMS) outline key areas to focus on when designing your animal research experiments in order to improve the quality of data outcomes. (Experimental Biology 2018)

Why Scientific Rigor Matters and Ways to Improve It

Abstract and resource links for the 2017 EB symposium in which Kristine Willis (NIH), Bradley K. Yoder (University of Alabama-Birmingham), Curt D. Sigmund (University of Iowa), and Tracey Weissgerber (Mayo Clinic) described efforts to increase scientific rigor through training students in research design, more transparent reporting of research findings, and better approaches to data visualization.

Reproducibility in Research Symposium

Shai Silberberg (NINDS), Richard Nakamura (NIH-CSR), and Malcolm Macleod (Edinburgh University) identified issues that undermine scientific rigor and the importance of addressing them. (Experimental Biology 2015)

APS Resources

Reproducibility ToolBox

Resource collection handout made available during the Why Scientific Rigor Matters and Ways to Improve It Symposium [pdf]

Reproducibility Journal Club

Use this journal club activity to gain insight into the challenges of improving scientific rigor. It includes articles and sample questions recommended by speakers at the APS Reproducibility Symposium.

Professional Integrity: Best Practices for Publishing Your Research

APS Education Department's Professional Skills Training Course on Publication Ethics.

APS Advises NIH on Sex as a Biological Variable

The APS response to an NIH Request for Information (RFI, NOT-OD-14-128) on developing policies for the inclusion of sex as a biological variable in pre-clinical research studies involving animals and cells.

Outside Resources

NIH: Rigor and Reproducibility

Access point for NIH announcements and resources on improving scientific rigor.

NIH OER Rigor & Reproducibility Guidance

Information from the NIH Office of Extramural Research designed to assist the extramural community in addressing rigor and transparency in NIH grant applications and progress reports.

FASEB: Enhancing Research Reproducibility

A report by the Federation of American Societies for Experimental Biology (FASEB) with recommendations for a variety of stakeholders aimed at promoting the reproducibility and transparency of biomedical and biological research.

iBiology: Shai Silberberg Video on Unconscious Bias & Publications Bias

In a video produced by iBiology, NINDS Program Director Shai Silberberg discusses two key contributors to irreproducibility and offers suggestions for mitigating these factors.

ILAR Workshop Brief: Reproducibility in Research with Animal Models

A summary of the National Academy of Sciences's Roundtable on Science and Welfare in Laboratory Animal Use. The document is available as a free PDF download or to read online.

NIH One Pager on Reproducibility in Grant Applications

A One Pager by NIH breaking down various aspects of reproducibility and rigor and explaining where they should be addressed in grant applications [PDF].

Nature: Reproducibility Challenges

Nature magazine's special feature collecting materials related to reproducibility.