geometry
SkillDev toolsPure-math 3D geometry toolbox — back-project masks and depth to
Available today. Use it from your connected AI after setup.
No other account needed.
Connect ahel once, and every AI you use reads what you have installed.
Then ask your AI: use the geometry skill
What this skill tells your AI
The instructions your AI receives, as published by graph-robots/open-robot-skills in tools/geometry/SKILL.md and read by ahel’s review.
Pure-math perception/planning geometry as in-process typed tools, from
mask back-projection through OBB fitting to grasp-candidate generation,
plus the two scalar helpers (geometry.iou, geometry.pose_distance).
Fully CPU — no model weights, no GPU.
When to use
- Turning a segmentation mask + depth + camera calibration into world-frame
points (
mask_to_world_points) and an object OBB (filter_and_compute_obb). - Deriving grasp poses from an OBB:
top_down_grasp_candidatesfor tabletop pick (feed the full list tocurobo.plan_to_grasp_posesas a goalset),front_grasp_from_obbfor horizontal interactions (drawer/door handles). - Building the collision world for the planner:
build_world_configwith the target's mask inobject_masksso the planner canignore_obstacle_namesit.
Install
uv sync --extra geometry # open3d + scikit-learn (cv2/scipy come with gap core)
# (pip: pip install -e ".[geometry]")
The module imports lazily — the bundle loads (and the light tools work) without the extra; only OBB fitting, DBSCAN filtering and world reconstruction need open3d/sklearn/cv2.
Gotchas (carried over from the service)
- OBB
extentis HALF-extents (gap.types convention, same as the proto).compute_obbis upright-only: rotation is around world Z (no 3D tilt), and extents use the 2nd/98th percentile of points, not strict min/max. - Single-camera clouds are 2.5D: only camera-facing surfaces are observed, so
OBB centers carry a few cm of depth bias on opaque objects. (The service's
rehearsal-sandbox ground-truth snap that compensated for this in-container
was deliberately NOT ported — it depended on a
/appsandbox file.) top_down_grasp_candidatesdefaultz_offset=-0.04: fingertip 4 cm below the OBB top. Withz_offset=0.0the fingers close above the object (silent empty grip). Grasp Z is clamped to -0.05 m (table-clearance floor; LIBERO table top is at world z=0).mask_to_world_pointskeeps only depths in [0.015, 20.0] m (HyRL bounds); invalid/zero-depth pixels are dropped.filter_noisereturns the ORIGINAL cloud unchanged when DBSCAN labels everything noise (defensive fallback, mirrors HyRL).build_world_config: table removal only runs whentable_z_threshold != 0(typical -0.01); robot-point exclusion is Franka-only (simplified DH FK) and skips non-7-DOF joint states; prefer explicitobject_masksover thetarget_obbprojection fallback — masks are pixel-accurate, the OBB projection is a corner-AABB approximation inflated by 2 cm.top_down_grasp_from_obbyaw is NOT derived from the OBB — fingers may close across the wide axis; use the candidate fan when orientation matters.
Signals
- GitHub stars
- 41
- Forks
- 7
- Last commit
- Sep 2026
Advanced
- Catalog kind
- skill
- Gateway key
geometry- Source
- github.com/graph-robots/open-robot-skills