PAANI: 河川ロボットシミュレーションのためのオンデバイス視覚証拠融合と説明可能ガイダンス
PAANI : On Device Visual Evidence Fusion and Explainable Guidance for River Robot Simulation
Arduino UNO Q上でYOLO11n検出器とMobileNetV3-Smallセグメンタを融合し、河川監視ロボット向けに証拠と方針理由を提示する説明可能な知覚・誘導パイプラインを構築した。
著者: Savio Cardoz, Santhiya Rajan
分類: cs.AI
原文アブストラクト
Mobile river monitoring robots must interpret obstacles and water boundaries that geographic waypoints alone cannot describe. On resource constrained platforms, converting imperfect visual predictions into timely and inspectable guidance is a distinct challenge. An object label or steering command does not explain which evidence supports a decision or when that evidence is unreliable. We present PAANI, an on-device perception to guidance architecture that combines a project trained YOLO11n detector and a custom MobileNetV3 Small semantic segmenter with timestamp aligned evidence fusion on Arduino UNO Q. Bounded tracking supplies object persistence, while an explicit corridor policy combines surface labels, accepted detections, urgency and mask uncertainty. Each final advisory exposes its contributing evidence and policy reasons. ROS 2 interfaces connect the local AI pipeline to a separate Gazebo vessel, localization and control testbed. Training uses 10,000 WaterScenes images for four-class detection and 1,127 MaSTr1325 images for segmentation, including 198 segmentation validation images. The selected FP32 ONNX models occupy 14.817 MB. Detector checkpoint test mAP at 0.5 IoU is 0.7388, while the separately evaluated rectangular ONNX export achieves validation mAP at 0.5 IoU of 0.7367. Segmentation ONNX validation mIoU is 0.9750. A five-minute UNO Q recording produced median and 95th percentile pipeline latencies of 467.8 ms and 580.3 ms at a configured 0.5 Hz cadence. The evaluation also identifies black input misclassification and a sampling rate mismatch that prevents the diagnostic apparent motion estimator from collecting sufficient evidence. These results support an inspectable and reusable edge robotics foundation while clearly distinguishing model accuracy and on-board execution from validated on-water collision avoidance.
関連論文
- OpenFlyScan:民生ドローン向け品質誘導型空中再構成システムsim2real
- Uranus: 身体性AIのための次世代シミュレーション基盤の構築sim2real
- H2RBench:人間からロボットへの転移を評価するReal-to-Simベンチマークsim2real
- AquaOrbit: 断続的な視覚フィードバック下での水中ターゲット周回のためのSim-to-Real強化学習sim2real
- AnalogDepth: アナログ映像伝送下のFPVドローンによる多視点幾何sim2real
- ARSTAG: タスク特化型ロボットデータ生成のためのエージェント型Real2Sim2Realシステムsim2real