原子からビットへ:自律ロボットインタラクションによるデジタルツイン構築
AuRA: From Atoms to Bits through Autonomous Robot Interaction
ロボットが物体を自律的に操作してデータを収集し、物理に基づくデジタルツインを再構築するシステムAuRAを提案。人間の作業と収集時間を大幅に削減しつつ、従来と同等の再構築品質を実現した。
著者: Xinchen Yu, Yoonkyo Jung, Haoran Chen, Zikui Cai, Aayush Talreja, Seungjae Lee, Hyunjin Kim, Furong Huang
分類: cs.RO
原文アブストラクト
Simulation enables robot-learning experiments at scale, but acquiring physics-informed digital twins often requires human manipulation and manual annotation of recorded interactions. To reduce this reliance on human effort, we present AuRA, a system that automates robot interaction and data preparation for digital-twin reconstruction. AuRA combines execution-aware grasp selection, gripper-motion measurements derived from robot states, and registered pre-interaction geometry and appearance priors. These choices enable autonomous collection, avoid reliance on visual gripper tracking, and recover object information obscured by the robot. Across 13 deformable objects, AuRA reduces active human labor and wall-clock collection time per successfully reconstructed asset by 88.5% and 55.4%, respectively. Relative to the human-collected PhysTwin baseline, AuRA improves seven of nine metrics for future prediction under known gripper motion, including a 28.1% reduction in one-way $L_1$ Chamfer distance. It also achieves similar mean silhouette IoU and Chamfer distance under the evaluated unseen interactions. These results highlight the potential of autonomous robot interaction to support more efficient digital-twin acquisition with comparable reconstruction quality.
関連論文
- SceneAgent: 3D/4Dキャプチャからシミュレーション環境を構築するエージェントパイプラインsim2real
- 実機データ不要で汎化可能なヒューマノイド全身移動操作を実現するZero-HLMsim2real
- HumanoidNDM:ヒューマノイド神経力学モデルによる動作追従の訓練-実環境ギャップの解消sim2real
- 未ラベル軌跡から対人配慮の経路補正を学習するLiDARベースsim2real GNNフレームワークsim2real
- 差分パッチで実現するドメインランダム化シミュレーションのリソース共有sim2real
- 遅延ランダム化が学習済みヒューマノイド動作追従の遅延マージンを広げるsim2real