Audit Replication Package
SkillFiles & storageValidate the replication package for the sewage-house-prices project. Runs 10 checks covering script execution, file integrity, output freshness, dependency verification, data provenance, and README completeness (AEA format). This skill should be used when asked to "audit replication", "check the package", or "verify reproducibility".
Instructions available. Your AI can read the instructions. Execution depends on the setup they require.
Account requirements not reviewed. Check the skill instructions before use; ahel provides instructions and does not run this skill.
Add ahel to your AI once: Claude, ChatGPT, Cursor, Claude Code or Codex. Then ask it to use this.
Then ask your AI: use the Audit Replication Package skill
What this skill tells your AI
The instructions your AI receives, as published by brycewang-stanford/auto-empirical-research-skills in skills/41-sticerd-eee-sewage-econometrics-check/skills/audit-replication/SKILL.md and read by ahel’s review.
Run end-to-end validation of the replication package for the sewage-house-prices project.
Input: $ARGUMENTS — directory containing the replication package (Replication/ by default), or here for the current project root.
Project-Specific Context
Expected Structure
- Pipeline scripts:
scripts/R/01_data_ingestion/throughscripts/R/06_analysis_datasets/ - Analysis scripts:
scripts/R/09_analysis/ - Utilities:
scripts/R/utils/ - Python:
scripts/python/ - Data:
data/raw/,data/processed/,data/final/ - Output:
output/tables/,output/figures/ - Manuscript:
docs/overleaf/ - R packages:
renv.lock
Workflow
Step 1: Locate Package
- If
$ARGUMENTSis a directory path: use it - If
$ARGUMENTSishereor empty: useReplication/if it exists, otherwise project root - Verify the directory exists and contains scripts
Step 2: Run 10 Verification Checks
Standard Checks (1-4)
- Script syntax — All
.Rfiles parse without syntax errors - File references — All
read_parquet(),readRDS(),read.csv()targets exist or are documented as inputs - File integrity — No orphaned scripts (referenced but missing), no orphaned outputs (generated but unreferenced)
- Output freshness — Output files are newer than their source scripts (no stale outputs)
Submission Checks (5-10)
- Package inventory — Scripts are logically ordered, master script exists
- Dependency verification —
renv.lockpresent, R version documented, Python deps documented - Data provenance — Every dataset has documented source, access date, and restrictions
- Path hygiene — No hardcoded absolute paths, all paths use
here::here() - Output cross-reference — Every table/figure in the manuscript traces to a specific script
- README completeness — AEA format: data availability, computational requirements, program descriptions, instructions
Step 3: Handle Failures
If failures found:
- Display specific error with file and line number
- Suggest concrete fix
- Ask user if they want to fix and re-audit (max 3 iterations)
Step 4: Present Results
# Replication Audit Report
**Date:** YYYY-MM-DD
**Directory:** [path]
## Check Results
| # | Check | Status | Details |
|---|-------|--------|---------|
| 1 | Script syntax | PASS/FAIL | |
| 2 | File references | PASS/FAIL | |
| 3 | File integrity | PASS/FAIL | |
| 4 | Output freshness | PASS/FAIL | |
| 5 | Package inventory | PASS/FAIL | |
| 6 | Dependencies | PASS/FAIL | |
| 7 | Data provenance | PASS/FAIL | |
| 8 | Path hygiene | PASS/FAIL | |
| 9 | Output cross-reference | PASS/FAIL | |
| 10 | README completeness | PASS/FAIL | |
## Summary
- Checks passed: N / 10
- **Overall: PASS / FAIL**
- Blocking issues: [list]
- Positive findings: [list]
Save to output/log/replication_audit_[date].md.
Principles
- Read and analyse only. Do not modify the package during audit.
- Specific errors. "Script 03_robustness.R references
data/final/panel.parquetwhich does not exist" beats "file reference error." - AEA Data Editor standards. The target is full compliance.
- Path checking is critical. Any
setwd()or absolute path is a FAIL for Check 8. - Restricted data awareness. Land Registry and Zoopla data may have access restrictions — document, don't block.
Signals
- GitHub stars
- 4k
- Forks
- 531
- Last commit
- Sep 2026
Advanced
- Item type
- skill
- Key
audit-replication- Source
- github.com/brycewang-stanford/auto-empirical-research-skills
github.com/brycewang-stanford/auto-empirical-research-skills
Related picks
Skill · wshobson
The pick for Pythonpython-pro
Skill · jeffallan
The pick for Pythonlatex-posters
Skill · k-dense-ai
The pick for LaTeXlatex-drawing-guide
Skill · brycewang-stanford
The pick for LaTeXobsidian-markdown
Skill · agricidaniel
The pick for Markdownmarkdown-formatter
Skill · nvidia
The pick for Markdown