roboticgrounding — Whole-Body (G1 / SONIC) Pointer
SkillProductivityPointer skill for the robotic_grounding G1 WHOLE-BODY humanoid pipeline (SONIC controller + RL residuals). Orients the user on the two reference-motion sources and the SonicG1 Isaac Lab tasks, then points at the authoritative source READMEs for exact commands. Use this skill whenever the user works with the G1 humanoid or whole-body motion: "retarget SOMA to G1", "run the whole-body planner", "SonicG1", "ReconBody / ReconHand", "train the G1 whole-body policy", "g1_planner", "whole-body eval", or mentions the G1 robot / SONIC controller. For the floating-hand (Sharpa Wave / Dex3) pipeline use robotic_grounding_run; for failures use robotic_grounding_doctor.
Available today. Use it from your connected AI after setup.
No other account needed.
Connect ahel once, and every AI you use reads what you have installed.
Then ask your AI: use the roboticgrounding — Whole-Body (G1 / SONIC) Pointer skill
What this skill tells your AI
The instructions your AI receives, as published by nvidia-isaac/video_to_data in .claude/skills/robotic_grounding_whole_body/SKILL.md and read by ahel’s review.
The G1 whole-body humanoid pipeline (SONIC controller + RL residuals) is separate from the floating-hand (Sharpa/Dex3) pipeline and is only lightly covered in this release. This skill orients you and hands off to the authoritative source docs for exact commands.
Authoritative references (read these for commands):
- Tasks / environments / training / eval:
source/robotic_grounding/robotic_grounding/tasks/v2d_whole_body/README.md - EE → whole-body planner:
source/robotic_grounding/robotic_grounding/planner/README.md
For the floating-hand pipeline, use robotic_grounding_run instead.
Two sources of G1 reference motion
Ask which the user has / wants — it determines the task and the docs to open:
| Source | Entry point | Feeds task | Notes |
|---|---|---|---|
| SOMA → G1 (body-accurate, mocap/video reconstruction) | scripts/retarget/soma_to_g1.py | SonicG1-ReconBody-v0 | Direct whole-body retarget |
| EE → whole-body planner (from V2D floating-hand output) | python -m robotic_grounding.planner.g1_planner | SonicG1-ReconHand-v0 | Learned motion model; v0.2 has known foot-skating artifacts |
Registered G1 tasks
| Task ID | Reference source | Notes |
|---|---|---|
SonicG1-v0 | — | Base env; reward weights zeroed. Scaffold for custom reward configs, not train-ready as-is |
SonicG1-ReconBody-v0 | SOMA→G1 | Body-accurate tracking |
SonicG1-ReconHand-v0 | planner | Hand-accurate tracking |
SonicG1-ReconHand-EpisodeTimeout-v0 | planner | ReconHand with a fixed episode-length timeout |
How to help
- Confirm the reference source and matching task from the tables above.
- For exact retarget/plan/replay/support/train/eval commands, open the source README that matches the stage (task README for RL + eval; planner README for the EE-planner). Don't invent commands here — those READMEs are the source of truth.
- Same host/container split as the rest of the repo: whole-body scripts run inside the
robotic-groundingcontainer (wrap from the host with./workflow/run.sh exec latest 0 -- <cmd>). - RL uses the shipped
scripts/rsl_rl/train.py/eval.pywith aSonicG1-*--task. The task README also shows anexperiments/run_experiment.pyrunner, butexperiments/is not shipped in this release. - On failure, hand off to
robotic_grounding_doctor(its Isaac/GPU/asset sections apply to G1 too).
Signals
- GitHub stars
- 587
- Forks
- 57
- Last commit
- Sep 2026
Advanced
- Catalog kind
- skill
- Gateway key
robotic-grounding-whole-body- Source
- github.com/nvidia-isaac/video_to_data