日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

週刊ニュースレター購読
VLAarXiv:2609.29166

HarnessPAI:物理AIのための進化するハーネス

HarnessPAI: An Evolving Harness for Physical AI

シェア:XThreadsFacebookLINEはてブBluesky

物理AI向けに、コードを実行可能で進化可能なインターフェースとして扱い、ロールアウト内では固定プログラムで実行し、ロールアウト間では実行フィードバックでプログラムを進化させるモデル・身体非依存のフレームワークを提案。

詳しい要約

1. どんなもの?

- Physical AI のための model- and embodiment-agnostic な Harness framework - code を executable かつ evolvable な interface として扱い、action primitive を組織化 - 対象は desktop robot arms, household robots, robot vacuum, legged walking agent - 2つの timescale を分離: rollout 内は open-loop で program 実行、rollout 間は closed-loop で program を進化 - 公式サイト: https://darwin-agent.github.io/HarnessPAI

2. 先行研究と比べてどこがすごい?

- 従来は action model (観測→低レベル制御) に偏り、perception と reasoning が劣化しやすい - HarnessPAI は underlying model を再学習せずに改善 - pure action models と code-as-policy baselines の両方を上回る - LIBERO-PRO で $π_{0.5}$ 比 +61.6 points - RoboCasa atomic tasks で WorldDreamer 比 +27.2 points - program 選択後は rollout 実行に online high-level LLM deliberation が不要

3. 技術・手法の肝は?

- code を executable/evolvable interface とし action primitive を統合 - rollout 内: program level で open-loop 実行、固定 program が実行を guide/check - rollout 間: execution feedback で program を revise する closed-loop 進化 - 失敗を reusable skills として distill - model- and embodiment-agnostic な設計 - 収束した program は expert-data collector としても機能

4. どうやって有効だと検証した?

- desktop robot arms, household robots, robot vacuum, legged walking agent で評価 - pure action models と code-as-policy baselines と比較 - LIBERO-PRO: $π_{0.5}$ 比 +61.6 points - RoboCasa atomic tasks: WorldDreamer 比 +27.2 points - 収集 expert data で $π_{0.5}$ を fine-tune し LIBERO-PRO 成功率 +38.8 points

5. 議論はある?

- Physical AI の frontier は強い action model だけでなく executable harness にも依存すると主張 - perception, task understanding and reasoning, action execution を unified, verifiable, feedback-driven system に統合する必要性を議論 - 限界や失敗事例、計算コスト、program 進化の収束性などは要旨からは不明

6. 次に読むべき論文は?

- $π_{0.5} - WorldDreamer - LIBERO-PRO - RoboCasa - code-as-policy baselines - Physical AI における action model 関連研究

※ AIが要旨から生成した要約です。正確性は原文をご確認ください。

著者: Xin Wang, Wenhao Wu, Menghao Zhang, Zhi Wang, Kun Shao, Jian Luan, Yang Li, Qing Li, Shangding Gu, Huichi Zhou, Shuqing Shi, Fei Ni, Shuo Lu, Weicheng Meng, Kang Li, Jin Wu, Kang Zhao, Shangmin Guo, Gen Li, Yongqiang Tang, Zhizhong Zhang, Yuan Xie, Heng Qu

分類: cs.RO, cs.AI

原文アブストラクト

Physical AI aims to build embodied agents that perceive the world, understand and reason about it, and decide how to act. Yet the field has focused primarily on the last component: the action model that maps observations to low-level controls. The prevailing training recipe can erode the perceptual and reasoning capabilities needed for robust behavior, leaving even strong action models vulnerable to scene perturbations and long-horizon tasks. We introduce HarnessPAI, a model- and embodiment-agnostic Harness framework for Physical AI that treats code as the executable and evolvable interface that organizes the underlying action primitive. The framework separates two timescales: within a rollout, it executes open-loop at the program level, with a fixed program guiding and checking execution; across rollouts, it evolves closed-loop, using execution feedback to revise the program and distill failures into reusable skills. Across desktop robot arms, household robots, a robot vacuum, and a legged walking agent, HarnessPAI improves on both pure action models and code-as-policy baselines without retraining the underlying model: a 61.6-point gain over $π_{0.5}$ on LIBERO-PRO and a 27.2-point gain over WorldDreamer on RoboCasa atomic tasks. Once a program is selected, rollout execution requires no online high-level LLM deliberation. Beyond execution, the converged program is also a cheap and reliable expert-data collector, and fine-tuning $π_{0.5}$ on collected expert data lifts success rate on LIBERO-PRO by 38.8 points. Our results suggest that the frontier of Physical AI depends not only on stronger action models, but also on executable harnesses that integrate perception, task understanding and reasoning, and action execution into a unified, verifiable, and feedback-driven system. Website: https://darwin-agent.github.io/HarnessPAI

関連論文

PR本紙発行元 EmplifAI