NeMo Agent Toolkit Evaluation
SkillDatabases & dataLets your agent design, run, and troubleshoot evaluations that measure how well your NeMo Agent Toolkit agents perform.
Then ask your AI: use the NeMo Agent Toolkit Evaluation skill
Details
Instructions available. Your AI can read the instructions. Execution depends on the setup they require.
Account requirements not reviewed. Check the skill instructions before use; Ahel provides instructions and does not run this skill.
No other account needed.
Add it as a step in a pipeline you build on Ahel, or connect Ahel to Claude, ChatGPT, Cursor, Claude Code or Codex and ask your AI to use it.
About this skill
Use when designing, configuring, running, or troubleshooting NeMo Agent Toolkit evaluations, datasets, evaluator selection, ATIF surfaces, quality gates, custom evaluators, and `nat eval`.
What this skill tells your AI
The instructions your AI receives, as published by nvidia/nemo-agent-toolkit in skills/nat-evaluation/SKILL.md and read by Ahel’s review.
Use this skill for measuring agent quality and behavior.
Workflow
- Decide the evaluation surface and output format.
- Decompose quality goals into separate evaluators.
- Choose built-in evaluators before writing custom evaluators.
- Keep datasets small and explicit for local validation.
- Run
nat evaland inspect generated artifacts.
References
references/operating-mode.mdreferences/methodology.mdreferences/agent-eval-framework.mdreferences/evaluation-surfaces.mdreferences/evaluation-contract.mdreferences/evaluators/references/code-patterns.md
Signals
- GitHub stars
- 3k
- Forks
- 780
- Last commit
- Oct 2026
Ahel review
K1binfo
installs-packages (in references/code-patterns.md)K1binfo
installs-packages (in references/evaluators/evaluator-langsmith-judge.md)K1binfo
installs-packages (in references/evaluators/evaluator-langsmith.md)
Automated review, not a security audit. Ruleset v1+k2.
Advanced
- Item type
- skill
- Key
nat-evaluation- Source
- github.com/nvidia/nemo-agent-toolkit
github.com/nvidia/nemo-agent-toolkit
More in Databases & data
Skill · coreyhaines31
More in Databases & datasupabase
Skill · supabase
More in Databases & dataconnect
Skill · composiohq
More in Databases & dataazure-kusto
Skill · microsoft
More in Databases & datarevops
Skill · coreyhaines31
More in Databases & datadjango-security
Skill · affaan-m
More in Databases & data