[1]汪 祥,陈 柏,鞠 锋.机器人辅助腹腔镜手术中的视觉测量方法研究[J].机械与电子,2021,(09):60-65.
　WANG Xiang,CHEN Bai,JU Feng.Research on the Method of Visual Measurementin Robot-assisted Laparoscopic Surgery[J].Machinery & Electronics,2021,(09):60-65.
点击复制

机器人辅助腹腔镜手术中的视觉测量方法研究()
分享到：

机械与电子[ISSN:1001-2257/CN:52-1052/TH]

卷:
期数:
2021年09期
页码:
60-65
栏目:
智能工程
出版日期:
2021-09-24

文章信息/Info

Title:
Research on the Method of Visual Measurementin Robot-assisted Laparoscopic Surgery
文章编号:
１００１-２２５７ ( ２０２１ ) ０９-００６０-０６
作者:
汪 祥; 陈 柏; 鞠 锋
南京航空航天大学机电学院,江苏 南京 ２１００１６
Author(s):
WANG Xiang ;  CHEN Bai ;  JU Feng
( College of Mechanical and Electrical Engineering , Nanjing University of Aeronautics and Astronautics , Nanjing ２１００１６ , China )
关键词:
机器人视觉; 视觉测量; 视觉追踪; 腹腔镜
Keywords:
robot vision ;  visual measurement ;  visual tracking ;  laparoscope
分类号:
TP２４２.6
文献标志码:
A
摘要:
针对目前机器人辅助腹腔镜手术中内窥镜仅被用于二维的视觉监测而缺乏三维位姿检测功能的缺陷,提出了一种基于求解共线 P n P (Perspective-n-Point )问题的手术器械位姿测量方案,测试了所提出的测量方法的精度并进行了误差分析.方案包括相机标定及畸变校正、标记设计、图像处理、标记点三维坐标计算和手术器械的三维表达.经测试,手术器械中心线的固定位置和单位方向向量的测量值的偏差低、精度较高.
Abstract:
In view of the status that currently the endoscope in robot-assisted laparoscopic surgery is only used for two-dimensional visual monitoring but lacks the function of detecting three-dimensional displacement and orientation , an approach of measuring the position of surgical instruments based on the solution of colinear PnP ( Perspective-n-Point ) problem was proposed , the precision of the method was tested and the error was analysed．The approach includes camera calibration and distortion correction , mark design , image processing , three-dimensional coordinate calculation of mark points , and three-dimensional expression of surgical instruments．After testing , the measurements of the fixed position on the center line of the surgical instrument and the unit direction vector of the center line are low-deviation and high-precision．

参考文献/References:

[１] 于凌涛,郑红杰 ． 手术微器械盲孔特征的腹腔镜视野自动调节方法[ J ] ． 哈尔滨工程大学学报,２０１９ , ４０ ( ８ ):１４９５-１５０１．

[２] KRUPA A , GANGLOFF J , DOIGNON C , et al．Autonomous ３-D positioning of surgical instruments in robotized laparoscopic surgery using visual servoing[ J ] ．IEEE Transactions on robotics and automation ,２００３ , １９ ( ５ ): ８４２-８５３．
[３] KRUPA A , DOIGNON C , GANGLOFF J , et al．Combined image-based and depth visual servoing applied to robotized laparoscopic surgery [ C ]// IEEE / RSJ International Conference on Intelligent Robots and Systems , ２００２ : ３２３-３２９．
[４] SPEIDEL S , KUHN E , BODENSTEDT S , et al．Visual tracking of da Vinci instruments for laparoscopic surgery [ C ]// Medical Imaging ２０１４ : Image-Guided Procedures , Robotic Interventions , and Modeling , ２０１４ : ９０３６０８-１-９０３６０８－６．
[５] HAASE S , WASZA J , KILGUS T , et al．Laparoscopic instrument localization using a ３-D Time-of-Flight / RGB endoscope [ C ]// ２０１３ IEEE Workshop on Applications of Computer Vision , ２０１３ : ４４９-４５４．
[６] KHOIY K A , MIRBAGHERI A , FARAHMAND F．Automatic tracking of laparoscopic instruments for autonomous control of a cameraman robot [ J ] ．Minimally invasive therapy and allied technologies , ２０１６ , ２５ ( ３ ): １２１-１２８．
[７] SHIN S , KIM Y , CHO H , et al．A single camera tracking system for３D position , grasper angle , and rolling angle of laparoscopic instruments [ J ] ．International journal of precision engineering and manufacturing , ２０１４ , １５ ( １０ ): ２１５５-２１６０．
[８] 潘晗倩 ． 基于图像引导的穿刺手术机器人导航系统研究[ D ] ． 杭州:浙江大学,２０１８．
[9] 刘大鹏,张巍,徐子昂 ． 单目视觉手术导航的系统设计[ J ] ． 中国数字医学, ２０１６ , １１ ( ６ ): １２-１３ , １７．
[１０] 胡天策,蔡俊锋,徐榕,等 ． 基于内窥镜单目视觉手术导航的测距方法[ J ] ． 中国组织工程研究与临床康复,２００８ , １２ ( ２２ ): ４２４１-４２４５．
[１１] ZHAO Z J．Real-time ３D visual tracking of laparoscopic instruments for robotized endoscope holder[ C ]// Proceeding of the １１th World Congress on Intelligent Control and Automation , ２０１４ : ６１４５-６１５０．
[１２] 于凌涛,王正雨,于鹏,等 ． 基于动态视觉引导的外科手术机 器 人器 械 臂 运 动 方 法 [ J ] ． 机 器 人, ２０１３ , ３５(２ ): １６２-１７０．
[１３] YU L T , WANG Z Y , YU P , et al．Research on the kinematic method of ３D visual window for surgical robot in dynamic vision [ C ]// ２０１２ IEEE International Conference on Mechatronics and Automation , ２０１２ :２０３７-２０４２．
[１４] FISCHLER M A , BOLLES R C．Random sample consensus : a paradigm for model fitting with applications to image analysis and automated cartography [ J ] ．Communications of the ACM , １９８１ , ２４ ( ６ ): ３８１-３９５．
[１５] BOUGUET J Y．Camera calibration toolbox for Matlab [ EB / OL ] ．(２０１５ １０ １４ )[ ２０２０ ０８ １０ ] ． http:// www．vision．caltech． edu / bouguetj / calib _ doc / index． html．

备注/Memo

备注/Memo:
收稿日期: ２０２１-０５-２７
基金项目:国家自然科学基金项目( ５１５７５２５６ );国家自然科学基金项目(６１９７３３３５ );江苏省自然科学基金项目( BK２０１９１２７２ )
作者简介:汪 祥 ( １９９６－ ),男,安徽六安人,硕士研究生,研究方向为手术机器人、视觉伺服;陈 柏 ( １９７８－ ),男,江苏泰州人,博士,教授,研究方向为医疗机器人,通信作者.
更新日期/Last Update: 2021-10-08