日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

週刊ニュースレター購読
手術ビデオ解析arXiv:2608.01058v1

拡張KAFR:手術ビデオの効率的解析のための運動適応パラダイム

Extended KAFR: A kinematic-adaptive paradigm for the efficient analysis of surgical video

シェア:XThreadsFacebookLINEはてブBluesky

手術ビデオ解析の計算負荷を減らすため、ツールの動きに基づいて重要なフレームだけを選ぶKAFR法を腹腔鏡手術に拡張し、わずか0.58%のフレームで高い精度を達成した。

著者: Huu Phong Nguyen, Shekhar Madhav Khairnar, Ganesh Sankaranarayanan

分類: cs.CV

原文アブストラクト

Artificial Intelligence is increasingly applied to surgical video analysis for phase segmentation, skill assessment, and workflow optimization. A key challenge is the length of surgical recordings, often one to several hours, creating substantial computational burden. We previously developed Kinematics-Adaptive Frame Recognition (KAFR) for robotic surgery, showing that tracking tool motion effectively identifies informative frames while filtering redundant content. However, laparoscopic surgery introduces additional challenges: manual camera control causes frequent motion artifacts, and image quality is generally lower than robotic systems. This study evaluates whether KAFR generalizes to laparoscopic surgery using the Cholec80 benchmark, comprising 80 laparoscopic cholecystectomy procedures annotated for seven surgical phases. KAFR operates in three stages: a fine-tuned YOLO model detects and segments surgical tools; frames are adaptively selected based on tool displacement or velocity variation; and an X3D model classifies selected frames into surgical phases. KAFR achieved a 91.0\% F1 score using only 0.58\% of frames for phase classification, representing an approximately seven-fold reduction compared to typical 4\% frame sampling, while maintaining performance comparable to LoViT (90.2\%) and Trans-SVNet (89.7\%). These results demonstrate that kinematics-based frame selection transfers effectively to the challenging laparoscopic environment.