日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

複合現実/手術遠隔支援arXiv:2104.06316

複合現実を用いた消化器・口腔顎顔面外科遠隔支援のための3D平均値クローニング法

A Novel Solution of Using Mixed Reality in Bowel and Oral and Maxillofacial Surgical Telepresence: 3D Mean Value Cloning algorithm

シェア:XThreadsFacebookLINEはてブBluesky

遠隔手術支援の複合現実映像で生じる境界のずれや時空間的不整合を抑えるため、3D平均値座標と改良補間を導入した拡張クローニング法を提案し、重畳誤差・処理時間を改善した。

著者: Arjina Maharjan, Abeer Alsadoon, P. W. C. Prasad, Nada AlSallami, Tarik A. Rashid, Ahmad Alrubaie, Sami Haddad

分類: physics.med-ph, cs.CV, cs.GR, cs.RO

原文アブストラクト

Background and aim: Most of the Mixed Reality models used in the surgical telepresence are suffering from discrepancies in the boundary area and spatial-temporal inconsistency due to the illumination variation in the video frames. The aim behind this work is to propose a new solution that helps produce the composite video by merging the augmented video of the surgery site and the virtual hand of the remote expertise surgeon. The purpose of the proposed solution is to decrease the processing time and enhance the accuracy of merged video by decreasing the overlay and visualization error and removing occlusion and artefacts. Methodology: The proposed system enhanced the mean value cloning algorithm that helps to maintain the spatial-temporal consistency of the final composite video. The enhanced algorithm includes the 3D mean value coordinates and improvised mean value interpolant in the image cloning process, which helps to reduce the sawtooth, smudging and discolouration artefacts around the blending region. Results: As compared to the state of the art solution, the accuracy in terms of overlay error of the proposed solution is improved from 1.01mm to 0.80mm whereas the accuracy in terms of visualization error is improved from 98.8% to 99.4%. The processing time is reduced to 0.173 seconds from 0.211 seconds. Conclusion: Our solution helps make the object of interest consistent with the light intensity of the target image by adding the space distance that helps maintain the spatial consistency in the final merged video.

  1. 1Boston Dynamics、車輪付きAtlasの研究試作機を紹介研究・技術
  2. 2Hugging Face、ロボット学習基盤「LeRobot v0.7.0」を公開 対話操作と大規模データ学習に対応新製品・発表
  3. 3AGIBOTのG2 6台、上海のコンビニで24時間試験 1,730タスクを実施量産・展開
  4. 4Agility Robotics、ナスダックで取引開始 米国初の人型ロボット専業上場企業と報道業界動向
  5. 5UC BerkeleyとNVIDIAの研究者、AIエージェントでロボット制御コードを仮想環境で改善研究・技術
PR本紙発行元 EmplifAI