GelSight Miniセンサ間での力マップ推定のゼロショット転移
Zero-Shot Transfer of Force Map Estimation Across GelSight Mini Sensors
異なるGelSight Miniセンサ個体間で3D力マップ推定を一般化する手法を提案。入力触覚画像をUniTベースモデルで共通表現に再構成し、U-Netで力マップを推定する。
著者: Julio Castaño Amoros, Pablo Gil
分類: cs.CV, cs.RO
原文アブストラクト
Despite the rapid industrialization of the touch sensor manufacturing process, most of these sensors are still handmade in research laboratories. This complicates standardizing their performance, requiring the repetition of data collection and training models for each unit produced. To address this problem, this paper presents a method that can generalize the estimation of 3D force maps across different GelSight Mini sensor units, regardless of the sensor version. Specifically, the method consists of two stages: a domain adaptation stage, in which the input tactile image is reconstructed as a general tactile image using a UniT-based model; and a stage for estimating 3D force maps employing a U-Net network. Our proposal achieves promising results in both steps, such as an SSIM of 0.9338 +- 0.0358 in the image reconstruction phase and an MAE_F of 1.1294 +- 1.5934(N) in the force estimation phase.