Agent Harness

SkillAI & models

This skill lets your AI turn a goal into a task plan and carry it out step by step. It runs each task using the tools already in your skills folder, checks every step with automated verification, and only declares the work done once everything passes. If it hits its retry limits, it hands the problem back to you instead of pushing through on its own.

Available today. Use it from your connected AI after setup.

After adding it, point your AI at a folder of skills for the domain you want to work in and give it a goal. It will build the plan, work through each task, and check its own results along the way.

Then ask your AI: use the Agent Harness skill

What your AI can do with it

  • Turn a goal into a task plan with checkable steps
  • Execute tasks using the tools in your skills folder
  • Verify every task with automated checks before moving on
  • Retry failed tasks up to a set limit instead of looping endlessly
  • Ask a human to step in when its budget runs out
  • Hold off on calling the work finished until all tasks are verified

What this skill tells your AI

The instructions your AI receives, as published by alirezarezvani/claude-skills in .gemini/skills/agent-harness/SKILL.md and read by ahel’s review.

You are a harness operator, not a hero. The loop — not your optimism — decides when work is done. Your job: compile the goal into tasks with checks, execute one task at a time, let the controller adjudicate verification, and stop when the state machine says stop.

The contract

GOAL → goal_compiler → PLAN → loop_controller: [execute → verify]* → CLOSE
                                     ↑______retry (≤ max_attempts, changed approach)
                                     └── ESCALATE on exhausted budgets — never fake success

Three layers, all JSON: a committed per-domain manifest (what skills/tools/checks exist), a per-goal plan (which tasks, which verifications, what "done" means), and a per-run state file (the single source of truth; a fresh session resumes from it alone).

Quick start

# 0. Pick the domain manifest (18 committed under assets/harnesses/, e.g. engineering-team.json)
ls assets/harnesses/

# 1. Compile the goal (refuses vague goals with exit 3 + forcing questions)
python3 scripts/goal_compiler.py \
  --goal "audit the payments service and design an SLO with an error budget" \
  --manifest assets/harnesses/engineering.json --out plan.json

# 2. Initialize the loop state
python3 scripts/loop_controller.py init --plan plan.json --state .agent-harness/state.json

# 3. Drive the loop — repeat until directive is "close" or "escalate"
python3 scripts/loop_controller.py next --state .agent-harness/state.json
#    → {"action": "execute", "task": "T1", ...}: open the task's skill (SKILL.md at
#      skill_path), do the work with its tools, then:
python3 scripts/loop_controller.py record --state .agent-harness/state.json \
  --task T1 --phase execute --exit-code 0
#    → the controller runs the task's checks ITSELF (subprocess, timeout, evidence log):
python3 scripts/loop_controller.py verify --state .agent-harness/state.json --task T1 --cwd <repo-root>

# 4. Close — refused (exit 4) while any task is unverified and unwaived
python3 scripts/loop_controller.py close --state .agent-harness/state.json

Regenerate a manifest after skills change (diff-stable, CI-checkable):

python3 scripts/harness_manifest_builder.py --domain engineering-team \
  --repo-root <repo-root> --out-dir assets/harnesses --no-timestamp

Hard rules

  1. Never adjudicate your own verification. verify runs the checks via subprocess; a passing record --phase verify without --evidence is rejected (exit 6). You do not get to declare a task verified.
  2. Never modify a gate you are judged by. Check commands come from the manifest/plan. Editing a check to make it pass is the reward-hacking failure mode (see references/verification_discipline.md) — same invariant as autoresearch-agent's locked evaluator.
  3. One task at a time, writes serialized. Parallelize reading and judging, never two tasks writing the same artifact (references/agentic_loop_canon.md).
  4. Retry means a changed approach. Same command + same input = same failure. The retry directive says so; honor it.
  5. Budgets are terminal states, not suggestions. max_attempts_per_task → escalated (exit 2); max_loop_iterations → escalate (exit 5). Exhausted budgets are never reported as success — a human waives (close --waive T3 --reason "..."), you don't.
  6. Fresh context beats long context. Every next directive is executable by a new session reading only the plan + state files. Long-running goals: run each iteration as its own session against the durable state.
  7. State lives in .agent-harness/ — never in .agenthub/, .autoresearch/, or docs/TC/ (those belong to sibling skills).
  8. Plan and state files are a trust boundary. verify shell-executes each task's check command; only run the harness on plan/state files you or goal_compiler.py produced, never on files from untrusted input (see references/verification_discipline.md).

Forcing questions (ask before compiling; one per turn, with a recommended answer)

#QuestionRecommended answerWhy (canon)
1What single observable outcome means DONE?A named artifact + a command that exits 0 against itVerifier's law: invest in verifiability first
2Which domain harness applies?The domain whose skills name the deliverable; if two, run two sequential loopsOrchestrator-workers: scoped objectives beat mega-goals
3What must NOT change?List no-touch paths; put them in the goal text so the compiler's plan inherits themBoundaries are part of a subagent spec
4Who reviews escalations, and how fast?A named human; escalations block the loop by designApproval-required is a terminal state, not a nuisance
5What is the iteration budget?Default 12 loop iterations / 3 attempts per task; raise only with a reasonCaps are runtime errors, not advice (OpenAI SDK max_turns)

Exit codes (branch on these mechanically)

CodeToolMeaning
0allOK / directive emitted
2loop_controllerEscalation required — a human must review the evidence log
3goal_compilerGoal too vague — answer the forcing questions, recompile
4goal_compiler / loop_controllerNo skill matched / close refused (unverified tasks)
5loop_controllerGlobal iteration cap reached
6loop_controllerInvalid transition (recording on verified task, evidence missing, unknown task)

Verifiable success

  • python3 scripts/harness_manifest_builder.py --sample, scripts/goal_compiler.py --sample, and scripts/loop_controller.py --sample all exit 0.
  • A vague goal (--goal "make it better") exits 3 and prints forcing questions.
  • loop_controller.py close on a state with an unverified task exits 4.
  • The demo loop in loop_controller.py --sample shows a verify failure consuming an attempt and the loop still closing only after a passing verify with evidence.

Related skills

  • workflow-builder: authoring deterministic .js scripts for Claude Code's Workflow tool. NOT for goal-to-close loop state (this skill).
  • agenthub: N parallel agents competing on ONE task in git worktrees. Use it inside a harness task that wants competing attempts.
  • autoresearch-agent: metric optimization of a single file against a locked evaluator. Use it when a task's done_when is "metric improves".
  • tc-tracker: per-code-change lifecycle records. Use for change bookkeeping; the harness state file is per-goal, not per-change.
  • loop-library: discover/audit published loop recipes conversationally. This skill is the executable enforcement of that vocabulary.
  • ship-gate / self-eval / spec-driven-workflow: plug in as close-time checks inside a task's verification[].

See references/domain_harness_design.md for the three-layer architecture, the reuse map, and how to raise a domain's harness quality.

Signals

GitHub stars
26k
Forks
4k
Last commit
Aug 2026
Advanced
Catalog kind
skill
Gateway key
agent-harness
Source
github.com/alirezarezvani/claude-skills