Run experiments

SkillDev tools

Lets your agent preview and run time-series forecasting experiments and hyperparameter sweeps.

Instructions available. Your AI can read the instructions. Execution depends on the setup they require.

Add ahel to your AI once: Claude, ChatGPT, Cursor, Claude Code or Codex. Then ask it to use this.

Then ask your AI: use the Run experiments skill

About this skill

Preview and run one or more ModernTSF experiment or sweep configurations. Use for training, evaluation, ablations, hyperparameter grids, concurrency, or GPU assignment; not for quick contract-only checks.

What this skill tells your AI

The instructions your AI receives, as published by diaugeia/moderntsf in .agents/skills/run-experiment/SKILL.md and read by ahel’s review.

The Agent owns the design and interpretation. Use the library for config validation, execution, budgets and recovery; do not reimplement these guarantees with ad hoc subprocesses or manually edited manifests. Call Python APIs when available; CLI examples below are equivalent optional adapters.

Preview before launch:

uv run tsf run configs/runs/<run>.toml --dry-run --json
uv run tsf run configs/runs/<run>.toml [--round <round-id>]

Associate a run with a research round when one was supplied; do not create a round for a one-off run unless the task asks for persistent research context. Use --jobs N for independent configs and --gpus 0,1 only after checking memory and device intent. Keep sweeps in TOML. Before long runs, verify data, output location, seeds, horizons, strategy, and profiling. Report successful/failed configs and work_dirs/ artifacts; do not silently restart or overwrite costly runs.

Route failed, unstable, or suspect runs to diagnose-experiment. Route compatible, complete outputs to analyze-results; execution itself does not establish a fair comparison.

For GIFT-Eval, inspect uv run tsf dataset gift-download --help, obtain only the requested data, and preview configs/runs/gift_eval_sweep.toml before launch. Record dataset versions, horizons, model compatibility, compute budget, and the missing-series policy; incomplete cells must remain visible during analysis.

For optional budgets, GPU queueing, tracking, cancellation, or interrupted-run recovery, read execution controls. Do not load advanced controls for an ordinary one-off experiment.

Signals

GitHub stars
65
Forks
8
Last commit
Sep 2026
Advanced
Item type
skill
Key
run-experiment-diaugeia
Source
github.com/diaugeia/moderntsf