Deliver four distinct outputs
Validate appearance, metric geometry, physical/semantic assets, and task configuration separately. 3DGS can represent appearance, collision proxies support physical interaction, USD describes objects and references, and manifests define navigation episodes. Opening a PLY or USD file does not establish scale, contact, or traversability.
Official-tutorial supplement: reconstruct before converting
COLMAP separates feature matching, geometric verification, and sparse SfM from dense MVS reconstruction and emphasizes overlapping views. Capture stable exposure, diverse viewpoints, and sufficient texture around important passages. Inspect motion blur, reflective surfaces, and moving people separately.
1 | calibrated / sufficiently overlapping frames |
This is an intended pipeline; validate each tool’s capabilities and formats at a specified version. Monocular geometry typically needs a scale reference. Mark generative completion explicitly instead of treating unobserved rooms as measured facts.
Merge recordings with geometric constraints
Use overlapping regions, common control points, or reliable localization. If scales differ, estimate the similarity transform xB = s·R·xA + t, not only rotation and translation. Inspect duplicate walls, shifted floors, narrowed doorways, and drift. Without sufficient constraints, retain separate submaps and their uncertainty.
Validate physical and navigation assets
Separate visible meshes from simplified colliders and verify aligned transforms. Static floors, walls, and furniture differ from dynamic bodies in backend support. NavMesh does not replace contact geometry. Measure doorway and corridor clearance, floor level, and obstacle boundaries using the intended robot dimensions.
Remove moving people from static background reconstruction where appropriate, then add controllable crowds. Public visual examples also need appropriate authorization and removal of faces, plates, location metadata, and private-place clues. ViPE, depth estimation, Lyra, and SAGE-3D remain optional routes; this guide does not claim their complete interchange or physics-import pipeline was tested.