組み込みsim-to-real視覚サーボ：学習によるリーチングと力誘導配置
Embedded Sim-to-Real Visual Servoing: Learned Reaching and Force-Guided Placement
Jetson上でYOLOと深度推定による視覚目標と、シミュレーションから転送したPPO方策・力誘導スパイラル探索を組み合わせ、ロボットのリーチングと穴への配置を実機で検証した。
著者: Dezhi Sun, Duy Khang Banh, Kenan Niu
分類: cs.RO
原文アブストラクト
Embedded perception-to-control systems must combine visual targeting with reliable contact handling under tight computational constraints. We present a shared architecture on an NVIDIA Jetson AGX Orin controlling a Franka Research 3 through Cartesian impedance control. RealSense D435i observations, YOLO11-seg segmentation, depth back-projection, and hand--eye calibration provide metric robot-frame targets. We compare two strategies: compact proximal policy optimization (PPO) policies transferred from simulation for object- and hole-region reaching, and force-guided Cartesian placement using approximately 2 N normal contact and spiral search. The PPO policies achieved 87.2% and 83.1% success over 1000 simulation episodes each. Across 50 real-robot trials per strategy, the learned hybrid and force-guided analytical pipelines achieved 70.0% and 74.0% completion, respectively. Mean perception latency with TensorRT was 34.55 ms. These results support an embedded architecture combining learned free-space reaching with explicit contact correction.