異種移動ロボットにおける非接触呼吸モニタリング:マルチモーダルエッジコンピューティングフレームワーク
Contactless Respiratory Monitoring on Heterogeneous Mobile Robots: A Multimodal Edge-Computing Framework
異なる移動ロボットプラットフォーム上で、RGB・熱・近赤外・低照度カメラを適応的に切り替え、姿勢変化に頑健な非接触呼吸数モニタリングを実現するエッジコンピューティングフレームワークを提案・評価した。
著者: Milind Rampure, Shadman Sakib, Haley Patel, Zahid Hasan, Nirmalya Roy
分類: cs.RO, cs.CV
原文アブストラクト
Respiratory-rate (RR) monitoring is a critical component of remote triage and victim assessment in emergency response, disaster recovery, and infectious-disease scenarios, where minimizing physical contact can reduce responder risk and improve operational safety. However, field deployment of contactless RR monitoring remains challenging due to variable illumination, posture changes, platform heterogeneity, and the impracticality of wearable sensors in hazardous environments. In this paper, we present a modality-adaptive contactless RR monitoring framework for heterogeneous mobile robots with onboard edge computing. The proposed system combines brightness-adaptive sensor selection across RGB, thermal, near-infrared (NIR), and low-light cameras, keypoint-guided chest ROI extraction for posture-robust monitoring, and a signal-quality-index (SQI)-based filtering mechanism for reliable respiratory estimation. We implement and evaluate the framework on three robotic platforms spanning quadruped and wheeled locomotion and multiple edge-computing architectures. Experiments conducted across diverse lighting conditions, subject poses, and robot-to-subject distances demonstrate that the framework generalizes across platforms without per-platform algorithmic retuning, while revealing modality-specific operational boundaries. RGB provides the broadest coverage up to 8m, NIR remains effective up to 6m, thermal is reliable only at short range, and low-light sensing supports monitoring in complete darkness up to 8m. Overall, the results demonstrate the feasibility of multimodal contactless RR monitoring on mobile robots and support its use as a foundation for autonomous triage and victim assessment in hazardous search-and-rescue settings.
関連論文
- ソーシャルロボットによる身体的フレイルと転倒リスク指標の評価:高齢者を対象とした実地評価ヘルスケアロボティクス