Replication Package & AEA Data Policy (aeja-replication-package)

SkillDev tools

Use when assembling the data and code replication package for an American Economic Journal: Applied Economics (AEJ: Applied) manuscript to pass the AEA Data and Code Availability Policy and the AEA Data Editor's pre-publication reproducibility check. Builds the openICPSR deposit and README; it does not run the analysis or write the paper.

Available today. Use it from your connected AI after setup.

Connect ahel once, and every AI you use reads what you have installed.

Then ask your AI: use the Replication Package & AEA Data Policy (aeja-replication-package) skill

What this skill tells your AI

The instructions your AI receives, as published by brycewang-stanford/awesome-journal-skills in AEJ-Applied-Economics-Skills/skills/aeja-replication-package/SKILL.md and read by ahel’s review.

When to trigger

  • The paper is empirical and you are heading toward acceptance (or want to build the package early)
  • An R&R or conditional acceptance asks you to prepare the data + code deposit
  • You need to write the README and Data Availability Statement to AEA standard
  • Some data are restricted/proprietary and you must plan the deposit around that

Why this is the AEJ: Applied signature

The single most distinctive AEJ: Applied differentiator is the AEA Data and Code Availability Policy, administered by the AEA Data Editor (Lars Vilhuber). Papers offered a revise-and-resubmit are asked to submit a data replication package at resubmission, and accepted papers must clear the Data Editor's compliance and reproducibility checks before publication. The default home is the AEA Data and Code Repository on openICPSR; other trusted repositories require appropriate Data Editor access. Build this package as you analyze; do not treat it as an acceptance-day formality.

What the package must contain

ComponentRequirement
Data filesAll data used, unzipped, in open/documented formats; or, for restricted data, a precise access path
Analysis + transformation codeEvery script from raw data → cleaned data → each table/figure
Master scriptOne run_all that regenerates every exhibit from raw inputs
READMEAEA README template: data sources, access, computational requirements, run instructions, exhibit-to-code mapping
Data Availability Statement (DAS)States provenance and access terms for each dataset; required in the paper
InstrumentsSurvey instruments / experiment instructions for own-data studies

Handling restricted or proprietary data

  • You cannot deposit restricted data, but you must still deposit all code and document the exact access procedure (provider, application steps, cost, approximate wait).
  • Provide a small synthetic or public extract so the code runs and the Data Editor can verify logic where possible.
  • Declare any restricted-data or exemption request at the earliest opportunity — limited-access arrangements are at editor/Data-Editor discretion and must be flagged, not discovered at the check.

Reproducibility hygiene (build as you go)

  • Pin versions: Stata version + recorded ssc/net package versions; requirements.txt/conda env (Python); renv.lock (R).
  • Set and report seeds for every simulation, bootstrap, and randomization-inference step.
  • No absolute paths — one root macro/variable; relative paths thereafter.
  • Exhibit-to-code map in the README: Table 3 → code/05_main.do, Figure 2 → code/06_event_study.R, etc.
  • Run it clean on a fresh checkout before depositing; the Data Editor will.

Adapt the vendored skeleton in ../../resources/code/ (master script → clean → descriptive → DID/IV/RD/DML → mechanism → robustness → tables) as the package backbone.

Checklist

  • One run_all master script regenerates every table and figure from raw data
  • All data deposited unzipped (or restricted-data access path fully documented + synthetic extract provided)
  • README follows the AEA template with a complete exhibit-to-code map
  • Data Availability Statement written for every dataset, with access terms
  • Software/package versions pinned; seeds set and reported
  • No absolute paths; runs clean on a fresh checkout
  • Restricted-data / exemption requests declared early, not at the check
  • Own-data studies include survey instruments / experiment instructions

Anti-patterns

  • Treating the package as an acceptance-day task — the check is pre-publication and gates publication
  • Depositing code that depends on absolute paths or unrecorded package versions (fails to reproduce)
  • Zipped data, missing intermediate files, or a README with no exhibit-to-code mapping
  • Restricted data discovered at the check with no access documentation or synthetic extract
  • Unset seeds making bootstrap/RI results non-reproducible

Output format

【Master script】run_all regenerates all exhibits from raw? [Y/N]
【Data】all deposited unzipped, or restricted path + synthetic extract? [state]
【README】AEA template + exhibit-to-code map complete? [Y/N]
【DAS】written for every dataset with access terms? [Y/N]
【Reproducibility】versions pinned + seeds set + no absolute paths + clean fresh run? [Y/N]
【Restricted/exemption】declared early? [Y/N/NA]
【Next step】aeja-referee-strategy (or aeja-submission)

Supplementary resources

Signals

GitHub stars
1k
Forks
146
Last commit
Aug 2026
Advanced
Catalog kind
skill
Gateway key
aeja-replication-package
Source
github.com/brycewang-stanford/awesome-journal-skills