JASA Reproducibility Guide

Logo

Reproducibility guide for authors and reviewers publishing in the Journal of the American Statistical Association (JASA).

View the Project on GitHub jasa-acs/repro-guide

The JASA Reproducibility Guide

As of September 2021, all invited revisions to JASA (both Applications & Case Studies and Theory & Methods) for manuscripts whose initial submission was on or after September 1, 2021, must include code, data, and the workflow to reproduce the work presented. We encourage but do not require that initial submissions include the code, data, and workflow.

Submissions before September 2021 to JASA Applications & Case Studies (but not Theory & Methods) should have included these materials upon initial submission, but submission upon invited revision is acceptable.

These web pages provide guidance on reproducibility for authors and reviewers in JASA.

Guidance for authors

  1. In preparing your materials, please see our guidelines for authors.
  2. Authors must fill out the ACC form, documenting the reproducibility of their work.
  3. Feel free to look at previously published articles for example reproducible materials. All reproducibility materials for published articles in Applications & Case Studies (those submitted as of September 2016) are available at https://github.com/jasa-acs. We particularly recommend the reproducibility materials in the following articles:

Guidance for reproducibility reviewers

While an associate editor may ask one of the reviewers to review a given manuscript for reproducibility, in most cases one of the JASA associate editors for reproducibility (AER) is asked to carry out this review (by selecting the generic ‘reviewer for reproducibility’ in the review system.

  1. Please see our guidelines for reviewers when reviewing a manuscript for reproducibility.
  2. We ask that reproducibility reviewers consider these review criteria and ideally explicitly fill out a review form (simply create a document with the headers as given in that link) and include the completed form as an attachment with your review.

General resources on reproducibility

Various journals are now requiring or strongly encouraging authors to provide code and data to reproduce their work. In addition, many researchers have written guidance on best practices for reproducibility. These are just a few of the many resources you may find online.

  1. Guidance from a group of reproducibility (aka ‘data’) editors of social science journals.
  2. The American Economic Association requires code and data for all submissions to the AEA journals. Here is guidance from the AEA data editor.

Help

Please contact the Associate Editors for Reproducibility at jasa.app.cs.aer@gmail.com with any questions about the guidelines for authors or for reviewers, or if you are interested in learning more about our reproducibility initiative.