πR²:リアクティブなリアルタイムフローポリシー
$π\mathbf{R}^2$: Reactive Real-time Flow Policies
大規模な事前学習済みバックボーンを用いたアクションチャンキング型の操作ポリシーを、リアクティブかつリアルタイムに動作させる手法を提案。高速な proprioception チャネルと非同期の視覚言語チャネルを分離し、遅延適応型フロースケジュールにより、実行中の感覚入力に即応しつつ、既存アーキテクチャへの最小限の変更で事前学習済みポリシーからファインチューニング可能。
著者: Sungjae Park, Shubham Tulsiani
分類: cs.RO, cs.AI, cs.LG
原文アブストラクト
Generalist manipulation policies increasingly take the form of action-chunking flow policies built on large pretrained backbones. Such chunks run open-loop, so the policy cannot react to sensory input arriving mid-execution, sacrificing \emph{reactivity}. Replanning more often would restore it, but the perception-to-action pipeline (a large backbone plus multiple denoising steps) is too slow: this \emph{latency} forbids frequent replanning and leaves committed actions stale, making such policies ill-suited for dynamic, closed-loop control. We present $π\mathbf{R}^2$, which makes these policies reactive and real-time while retaining large backbones, expressive multi-modal policies, and multi-action prediction. Built on the per-position noise schedule of diffusion forcing, $π\mathbf{R}^2$ contributes two ideas. First, it splits conditioning into a fast channel (proprioception, fresh every tick) and an asynchronously updated slow channel (vision-language features), so the policy reacts to proprioception within a chunk while tolerating stale vision. Second, a latency-adaptive flow schedule treats in-flight actions as inpainting conditioning and emits actions in one denoising step per call, letting one trained model adapt to varying hardware latency. Requiring minimal modification to existing architectures, $π\mathbf{R}^2$ can be finetuned from a pretrained policy: applied to GR00T-N1.7 on a real xArm6+XHand platform, it replans closed-loop roughly $4\times$ faster than the base policy (~$25$Hz on an A5000 GPU), acting on a fresh observation every $40$ms. Across simulation and real-world manipulation tasks, $π\mathbf{R}^2$ improves the success rate by up to $23\%$ in simulation and $30\%$ in the real world over the strongest baseline. Project page: https://pi-r2-flow.github.io/
関連論文
- Peg-in-Bench: 高精度ロボット挿入のためのモジュール式ベンチマークマニピュレーション
- 否定制約付き器用把持のためのポテンシャル誘導粒子ステアリングマニピュレーション
- Facet-0: 接触を伴う精密操作のためのロボット基盤モデルマニピュレーション
- Motus2: 巧みな操作のための自己進化型汎用世界モデルマニピュレーション
- Zeva: 文脈内因果学習による汎用身体操作の実現マニピュレーション
- SUN: 言語に基づく制御から学習、実機への永続的プログラムマニピュレーション