/capture-eval-issues

SkillAI & models

Capture noteworthy review violations for the eval framework. Use when validator-run finds review failures — judges violations and saves notable ones to evals/inventory.yml.

Available today. Use it from your connected AI after setup.

Connect ahel once, and every AI you use reads what you have installed.

Then ask your AI: use the /capture-eval-issues skill

What this skill tells your AI

The instructions your AI receives, as published by codagent-ai/agent-validator in .agents/skills/capture-eval-issues/SKILL.md and read by ahel’s review.

Capture noteworthy review violations into the eval inventory.

Input

This skill receives one or more review JSON file paths as arguments (space-separated). Example: /capture-eval-issues validator_logs/review_src_claude@1.0.json validator_logs/review_src_gemini@2.0.json

Procedure

  1. Read judge-prompt.md from this skill's directory
  2. Spawn a subagent to judge and capture violations:
    • Task tool: Task with subagent_type="general-purpose", model="sonnet", prompt= judge-prompt content + "\n\nReview JSON files: <file paths>\n\nSkill directory: <this skill's directory path>"
    • The subagent handles everything: reading files, judging, calling the append script
  3. Report the subagent's capture summary (the CAPTURED: line)

Signals

GitHub stars
29
Forks
2
Last commit
Sep 2026
Advanced
Catalog kind
skill
Gateway key
capture-eval-issues
Source
github.com/codagent-ai/agent-validator