Edge Strategy Reviewer
SkillCommerce & financeThis skill gives your AI a critical reviewer for trading strategy drafts, working alongside edge-strategy-designer. Once added, your AI can check a draft for a plausible edge, overfitting risk, whether the sample size is adequate, and whether the strategy could realistically be executed before it is exported to your pipeline. Every review ends with a clear PASS, REVISE, or REJECT verdict and a confidence score.
Available today. Use it from your connected AI after setup.
No other account needed.
Add the skill, then keep your strategy drafts as YAML files in a strategy_drafts folder. Ask your AI to review a draft whenever it needs a quality check before being exported to your pipeline.
Then ask your AI: use the Edge Strategy Reviewer skill
What your AI can do with it
- Review strategy drafts produced by edge-strategy-designer
- Check whether a draft's trading edge is plausible
- Flag overfitting risk in strategy drafts
- Judge whether the sample size behind a strategy is adequate
- Assess how realistically a strategy can be executed
- Return PASS, REVISE, or REJECT verdicts with confidence scores
What this skill tells your AI
The instructions your AI receives, as published by baggat236/ai-trading-skills in skills/edge-strategy-reviewer/SKILL.md and read by ahel’s review.
Deterministic quality gate for strategy drafts produced by edge-strategy-designer.
When to Use
- After
edge-strategy-designergeneratesstrategy_drafts/*.yaml - Before exporting drafts to
edge-candidate-agentvia the pipeline - When manually validating a draft strategy for edge plausibility
Prerequisites
- Strategy draft YAML files (output of
edge-strategy-designer) - Python 3.10+ with PyYAML
Workflow
- Load draft YAML files from
--drafts-diror a single--draftfile - Evaluate each draft against 8 criteria (C1-C8) with weighted scoring
- Compute confidence score (weighted average of all criteria)
- Determine verdict: PASS / REVISE / REJECT
- Assess export eligibility (PASS + export_ready_v1 + exportable family)
- Write review output (YAML or JSON) and optional markdown summary
Review Criteria
| # | Criterion | Weight | Key Checks |
|---|---|---|---|
| C1 | Edge Plausibility | 20 | Thesis quality, domain terms, mechanism keywords (continuous 50-95) |
| C2 | Overfitting Risk | 20 | 5-tier filter count scoring (90/80/60/40/10), precise threshold penalty |
| C3 | Sample Adequacy | 15 | Continuous scoring from estimated annual opportunities (10-95) |
| C4 | Regime Dependency | 10 | Cross-regime validation |
| C5 | Exit Calibration | 10 | Stop-loss, reward-to-risk |
| C6 | Risk Concentration | 10 | Position sizing limits |
| C7 | Execution Realism | 10 | Volume filter, export consistency |
| C8 | Invalidation Quality | 5 | Signal count and specificity |
Verdict Logic
- C1 or C2 severity=fail → immediate REJECT
- confidence >= 70, no fail findings → PASS
- confidence < 35 → REJECT
- Otherwise → REVISE (with revision instructions)
Running the Script
# Review all drafts in a directory
python3 skills/edge-strategy-reviewer/scripts/review_strategy_drafts.py \
--drafts-dir reports/edge_strategy_drafts/ \
--output-dir reports/
# Single draft review
python3 skills/edge-strategy-reviewer/scripts/review_strategy_drafts.py \
--draft reports/edge_strategy_drafts/draft_xxx.yaml \
--output-dir reports/
# JSON output with markdown summary
python3 skills/edge-strategy-reviewer/scripts/review_strategy_drafts.py \
--drafts-dir reports/edge_strategy_drafts/ \
--output-dir reports/ \
--format json \
--markdown-summary
# Strict export mode: export-eligible drafts with any warn → REVISE
python3 skills/edge-strategy-reviewer/scripts/review_strategy_drafts.py \
--drafts-dir reports/edge_strategy_drafts/ \
--output-dir reports/ \
--strict-export
Output Format
Primary output: review.yaml (or review.json)
generated_at_utc: "2026-02-28T12:00:00+00:00"
source:
drafts_dir: "/path/to/strategy_drafts"
draft_count: 4
summary:
total: 4
PASS: 1
REVISE: 2
REJECT: 1
export_eligible: 1
reviews:
- draft_id: "draft_xxx_core"
verdict: "PASS"
confidence_score: 80
export_eligible: true
findings: [...]
revision_instructions: []
Resources
references/review_criteria.md— Detailed scoring rubric for C1-C8references/overfitting_checklist.md— Overfitting detection heuristics
Signals
- GitHub stars
- 122
- Forks
- 960
- Last commit
- Sep 2026
Advanced
- Catalog kind
- skill
- Gateway key
edge-strategy-reviewer- Source
- github.com/baggat236/ai-trading-skills