TRR: ロボットシミュレーションとRGBTデータ生成のための熱相互作用エンジン
TRR: A Thermal Interaction Engine for Robot Simulation and RGBT Data Generation
接触・運搬・分離に伴う熱の保持や移動を空間的・深さ方向に追跡し、RGBと熱画像の同期観測データを生成する熱シミュレータTRRを提案。熱履歴が接触結果に与える影響を学習させるベンチマークを構築した。
詳しい要約
1. どんなもの?
2. 先行研究と比べてどこがすごい?
3. 技術・手法の肝は?
4. どうやって有効だと検証した?
5. 議論はある?
6. 次に読むべき論文は?
※ AIが要旨から生成した要約です。正確性は原文をご確認ください。
著者: Biwen Yang, Zhe Cao, Jin Zhang, Haoyang Sun, Zonglu Hu, Jintao Zhao, Zhehao Zhang, Kaizheng Chen, Chengyi Liu, Chengyu Wei, Siyuan Wu, Ruiheng Zhang
分類: cs.CV, cs.RO
原文アブストラクト
A robot's actions change the thermal conditions of its next interaction: heat retained after release, carried with objects or stored beneath the surface can change a later contact's outcome despite similar current temperatures. Training trajectories must capture how these effects connect earlier actions to later observations and task outcomes. We present TRR, a \emph{Thermal Robot Renderer} that attaches spatial and depth-resolved thermal state to both contact partners, updates local heat exchange through contact, transport and separation, and generates synchronized RGB--thermal (RGBT) observations and event-local task checks on one execution clock. Controlled interventions show why retained heat, spatial transport and internal storage matter for subsequent contact outcomes. From the same state, TRR produces a paired six-task benchmark of 2,224 static--dynamic pairs, that is, 4,448 trajectories with synchronized dual-view observations, states and actions. Visible thermal history raises safe contact-site selection from 75.0\% to 91.7\% on a dedicated learning corpus, and training on dynamic histories raises simulated transfer completion by 50 percentage points under a new heating procedure with shared feedback execution. We demonstrate RGBT observation adapters on MuJoCo and Isaac Sim, report an engineering inventory of ten prepared robot configurations and six demonstrated camera viewpoints, and describe a developer workflow that carries an existing robot scene to exported RGBT records. The benchmark, the workflow and the platform resources described in Section 6 form the first items of a planned public release. Demonstrations and resource updates are available on the project page.
関連論文
- ROS 2とNav2による部屋情報を介した物体目標ナビゲーションのsim-to-real展開sim2real
- DynLimit: 動特性が重要な計画・制御のためのシミュレーションベンチマークsim2real
- DAPPT: 手続き的軌道からドメイン認識方策を学習するシミュレーション・実機転移フレームワークsim2real
- 残差強化学習による視覚サーボ制御とゼロショットsim-to-real転移sim2real
- Ego2Sim2Humanoid: ロボット実演なしで移動操作VLAを学習するエージェント型実世界→シミュレーション変換sim2real
- ヘビーメタル・アクロバティクス:スキッドステアローダーの動的制御を学習するsim2real
