日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

週刊ニュースレター購読
視線操作arXiv:2609.00478v1

物体選択を超えて:マーカーレス視線による任意位置へのロボット配置

Beyond Object Selection:Markerless Gaze-based Robot Placement at Arbitrary Position

シェア:XThreadsFacebookLINEはてブBluesky

視線ベースの支援操作で、物体選択だけでなく任意位置への配置を可能にするマーカーレスフレームワークを提案し、タスク指向の評価指標GSIEを導入した。

著者: Yuzhi Lai, William Marx, Shenghai Yuan, Peizheng Li, Zhuoyu Ran, Andreas Zell

分類: cs.RO

原文アブストラクト

Gaze-based assistive manipulation typically supports object selection, while arbitrary-position placement requires accurate spatial alignment between the headset and robot. However, for gaze-based manipulation, pose accuracy does not necessarily translate into task accuracy: translational and rotational errors jointly affect the transformed gaze ray and may compensate for each other. To study cross-device alignment from this task-oriented perspective, we present a markerless interaction framework and a dedicated cross-device dataset. We propose Graph-based Reference Selection to address sparse robot references. We further develop and benchmark multiple task-specific alignment pipelines under a unified protocol. Specifically, we introduce Gaze--Surface Intersection Error (GSIE), which directly measures the spatial error of the gaze-specified target. Experiments show that alignment methods ranked highly by conventional pose metrics are not always optimal in GSIE, demonstrating the importance of evaluating gaze-based manipulation at the task level.