状態依存的な目的調整による二輪倒立ロボットのバランスとナビゲーションの統合制御
State-Dependent Objective Coordination for End-to-End Balance and Navigation
二輪倒立ロボットのバランス安定化とナビゲーションを、ピッチ角に応じて目的の重みを調整する軽量な手法で統合し、シミュレーション訓練から実機へゼロショット展開できる強化学習ポリシーを実現した。
詳しい要約
1. どんなもの?
2. 先行研究と比べてどこがすごい?
3. 技術・手法の肝は?
4. どうやって有効だと検証した?
5. 議論はある?
6. 次に読むべき論文は?
※ AIが要旨から生成した要約です。正確性は原文をご確認ください。
著者: Xuhao Huang, Xitao Xu, Yuxin Zheng, Yunfan Ren, Zheng Gong
分類: cs.RO
原文アブストラクト
Traditional robotic navigation systems separate mapping, planning, and low-level control through cascaded modules, introducing computational overhead and accumulated latency. End-to-end reinforcement learning offers a compact unified policy that maps onboard observations directly to control actions. However, on inherently unstable platforms such as two-wheeled inverted-pendulum robots, navigation progress and obstacle avoidance can conflict with attitude stabilization in a strongly state-dependent manner. We propose a lightweight state-dependent objective coordination method for integrated navigation and control. A pitch-conditioned scalarization coefficient $β(s)\in[0,1]$ adjusts the relative contributions of balance stabilization and navigation objectives during training, without extra control hierarchies or auxiliary attitude-stabilization controllers, such as proportional-integral-derivative (PID) or linear-quadratic regulator (LQR) controllers. To support zero-shot deployment, simulation training models execution delay, action hold, asynchronous and noisy observations, and dynamics uncertainty. Gradient analysis reveals persistent directional interference and state-dependent variation in the objectives' relative scales. Comparisons with alternative reward-weighting, constraint, training, and control-structure strategies show that PPO+$β(s)$, where PPO denotes proximal policy optimization, achieves 98% and 95% success rates with small attitude excursions on the fixed obstacle map and the randomly generated high-obstacle-density map, respectively. Zero-shot hardware experiments further demonstrate bounded attitude behavior and consistent obstacle avoidance using only onboard observations. Training and evaluation code will be made publicly available upon acceptance.
関連論文
- 超機動車両:走行・バランス・ジャンプを実現する自転車ロボットのシステム設計歩行・バランス制御
- シンプルな二輪自己平衡ロボットの実装歩行・バランス制御
- Wheelbot:跳躍する反動ホイール一輪車歩行・バランス制御
- Epersist: PID制御と深層強化学習を用いた自己平衡ロボット歩行・バランス制御