Compositional Sim2Real engine

SkillFiles & storage

Use when navigating, reviewing, or changing the compositional Sim2Real workflow, stateless stage adapters, durable standard-runtime resume, ComponentRecords, and S3 lineage.

Available today. Use it from your connected AI after setup.

Connect ahel once, and every AI you use reads what you have installed.

Then ask your AI: use the Compositional Sim2Real engine skill

What this skill tells your AI

The instructions your AI receives, as published by nebius/nebius-physical-ai in skills/workbench/sim2real-engine/SKILL.md and read by ahel’s review.

The canonical engine surface is the ordinary workflow workflows/main/sim2real.yaml. Its leaf states call npa.workflows.sim2real.workflow_stage; S3/content-addressed evidence primitives live in workflow_io. The shared npa_workflow interpreter/runtime owns loops, parallel waves, SkyPilot jobs, ledger persistence, and resume.

The small engine.py facade and bounded legacy_* modules remain compatibility surfaces for archived runs. New canonical states must never call run_preamble, run_inner_loop, run_single_outer_iteration, run_finalize, or spawn sibling Jobs.

Stage map

StageCanonical recordAdapter boundary
1stage_01_triggertask-aligned trigger/seed validation
2stage_02_assetstask/assets/camera/strict-success contract
3stage_03_augmentreal Cosmos Transfer 2.5
4stage_04_envs_rawparallel raw EnvGen shards
5stage_05_envs_trainsealed train/validation/gold split
6stage_06_tokensexplicit S3 token/scenario manifest
7stage_07_actions_trainreal Isaac multi-camera rollout
8stage_08_vlm_eval_trainsingle hosted Token Factory CPU evaluator
9stage_09_training_signaltemporal merge, real PPO, validation selection
10stage_10_eval_heldoutexact-checkpoint untouched-gold Isaac eval
11stage_11_outer_loopstrict metric + standard decision artifact
12stage_12_external_validationdesigned external SEAM
13stage_13_retriggerretrigger/loop record
14stage_14_rerun_vizfinal report, RRD, and MCAP

Invariants

  • Use named {{loop.*}} tokens for iteration-scoped S3 paths.
  • Every real stage publishes WORKS; Stage 12 alone publishes SEAM. Canonical pointers have immutable content-addressed history.
  • GPU images are immutable and source-attested. Isaac rollout/train/eval use NPA_SIM2REAL_INLINE_TASK=1 inside the workflow-owned GPU task.
  • The hosted evaluator uses MiniMaxAI/MiniMax-M3 through Token Factory, receives NEBIUS_TOKEN_FACTORY_KEY by secret name, requests no GPU, and publishes evaluator tokens/latency/retries/request IDs/cost separately from model-agent accounting. Stage 9 must reject missing, duplicate, or extra evaluations or a mismatched configured model/family by comparing that single result with the authoritative Stage 7 rollout set before PPO or checkpoint selection.
  • The cosmos3_model config key, cosmos3.json artifact, and evaluator schema/lane names are retained for compatibility; the actual model and reason_family identify MiniMax or an explicitly selected legacy Cosmos3 endpoint. Changing the model or upgrading the evaluator contract requires a new run.
  • Train, validation, and gold digests are disjoint. Checkpoint ranking reads validation only; Stage 10 reads gold only and preserves exact render lineage.
  • Temporal rewards remain bounded and simulator-grounded. Strict success remains stable placement within 5 cm. Pipeline success and policy quality are distinct.
  • Final RRD/MCAP use configured capture FPS and contain non-empty multi-camera, progress, policy, and evaluation evidence.

Verify

Validate and plan the canonical YAML, run the focused compositional workflow and Isaac payload tests, then run repository-required lint/type/docs/guardrails. A live proof must use the same standard workflow submit --runtime path.

Signals

GitHub stars
28
Forks
15
Last commit
Sep 2026
Advanced
Catalog kind
skill
Gateway key
sim2real-engine
Source
github.com/nebius/nebius-physical-ai