Run experiments
SkillDev toolsPreview and run one or more ModernTSF experiment or sweep configurations. Use for training, evaluation, ablations, hyperparameter grids, concurrency, or GPU assignment; not for quick contract-only checks.
Available today. Use it from your connected AI after setup.
No other account needed.
Connect ahel once, and every AI you use reads what you have installed.
Then ask your AI: use the Run experiments skill
What this skill tells your AI
The instructions your AI receives, as published by diaugeia/moderntsf in .agents/skills/run-experiment/SKILL.md and read by ahel’s review.
The Agent owns the design and interpretation. Use the library for config validation, execution, budgets and recovery; do not reimplement these guarantees with ad hoc subprocesses or manually edited manifests. Call Python APIs when available; CLI examples below are equivalent optional adapters.
Preview before launch:
uv run tsf run configs/runs/<run>.toml --dry-run --json
uv run tsf run configs/runs/<run>.toml [--round <round-id>]
Associate a run with a research round when one was supplied; do not create a
round for a one-off run unless the task asks for persistent research context.
Use --jobs N for independent configs and --gpus 0,1 only after checking memory and device intent. Keep sweeps in TOML. Before long runs, verify data, output location, seeds, horizons, strategy, and profiling. Report successful/failed configs and work_dirs/ artifacts; do not silently restart or overwrite costly runs.
Route failed, unstable, or suspect runs to diagnose-experiment. Route compatible,
complete outputs to analyze-results; execution itself does not establish a fair
comparison.
For GIFT-Eval, inspect uv run tsf dataset gift-download --help, obtain only the
requested data, and preview configs/runs/gift_eval_sweep.toml before launch.
Record dataset versions, horizons, model compatibility, compute budget, and the
missing-series policy; incomplete cells must remain visible during analysis.
For optional budgets, GPU queueing, tracking, cancellation, or interrupted-run recovery, read execution controls. Do not load advanced controls for an ordinary one-off experiment.
Signals
- GitHub stars
- 65
- Forks
- 8
- Last commit
- Sep 2026
Advanced
- Catalog kind
- skill
- Gateway key
run-experiment- Source
- github.com/diaugeia/moderntsf