日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

週刊ニュースレター購読
sim2realarXiv:2603.28670

合成データを用いたシミュレーションから実世界への果物検出:Isaac Simによる定量的評価と組み込み展開

Sim-to-Real Fruit Detection Using Synthetic Data: Quantitative Evaluation and Embedded Deployment with Isaac Sim

シェア:XThreadsFacebookLINEはてブBluesky

NVIDIA Isaac Simで生成した合成データと実画像を組み合わせてYOLOモデルを訓練し、果物検出のsim-to-real性能を評価。ハイブリッド訓練が実データのみに近い精度を達成し、Jetson Orin NX上でリアルタイム推論を実現した。

著者: Martina Hutter-Mironovova

分類: cs.CV, cs.RO

原文アブストラクト

This study investigates the effectiveness of synthetic data for sim-to-real transfer in object detection under constrained data conditions and embedded deployment requirements. Synthetic datasets were generated in NVIDIA Isaac Sim and combined with limited real-world fruit images to train YOLO-based detection models under real-only, synthetic-only, and hybrid regimes. Performance was evaluated on two test datasets: an in-domain dataset with conditions matching the training data and a domain shift dataset containing real fruit and different background conditions. Results show that models trained exclusively on real data achieve the highest accuracy, while synthetic-only models exhibit reduced performance due to a domain gap. Hybrid training strategies significantly improve performance compared to synthetic-only approaches and achieve results close to real-only training while reducing the need for manual annotation. Under domain shift conditions, all models show performance degradation, with hybrid models providing improved robustness. The trained models were successfully deployed on a Jetson Orin NX using TensorRT optimization, achieving real-time inference performance. The findings highlight that synthetic data is most effective when used in combination with real data and that deployment constraints must be considered alongside detection accuracy.

関連論文