Robot-assisted microsurgery is gaining increasing attention in procedures requiring super-human dexterity and accuracy. In addition to challenges in micro-operation instrument design, defocus blur is a major obstacle in microsurgical robotics due to the shallow depth-of-field of microscopes and the dynamic nature of the scene. Different approaches to autofocusing have been explored, but thus far, they have mainly been limited to microscopes for cells and standard cameras. This article presents a real-time 3-D tracking framework for addressing unique defocusing challenges of surgical microscopes, including the dynamic instrument-tissue interaction, the severe reflection, and the paucity of surface features in an in vivo environment. In specific, novel order constraints are introduced for accurate defocus estimation. Based on defocus estimation, a nonblind virtual refocusing method is integrated into region-of-interest (ROI) tracking. Extensive offline and online experiments were performed, demonstrating the superior performance of defocus estimation and ROI tracking, and the effectiveness of the whole framework for autofocusing.
基金:
Shanghai Municipal Science and Technology Major Project [2021SHZDZX]; National Natural and Science Foundation of China [62203296]; Science and Technology Commission of Shanghai Municipality [20DZ2220400]; Shanghai Pilot Program for Basic Research-Shanghai Jiao Tong University [21TQ1400203]
语种:
外文
WOS:
中科院(CAS)分区:
出版当年[2025]版:
大类|1 区工程技术
小类|1 区工程:机械2 区自动化与控制系统2 区工程:电子与电气2 区工程:制造
最新[2025]版:
大类|1 区工程技术
小类|1 区工程:机械2 区自动化与控制系统2 区工程:电子与电气2 区工程:制造
JCR分区:
出版当年[2023]版:
Q1AUTOMATION & CONTROL SYSTEMSQ1ENGINEERING, ELECTRICAL & ELECTRONICQ1ENGINEERING, MANUFACTURINGQ1ENGINEERING, MECHANICAL
最新[2024]版:
Q1AUTOMATION & CONTROL SYSTEMSQ1ENGINEERING, ELECTRICAL & ELECTRONICQ1ENGINEERING, MANUFACTURINGQ1ENGINEERING, MECHANICAL
第一作者机构:[1]Shanghai Jiao Tong Univ, Inst Med Robot, Sch Biomed Engn, Shanghai 200240, Peoples R China[2]Shanghai Jiao Tong Univ, Tongren Hosp, Inst Med Robot, Shanghai Key Lab Flexible Med Robot, Shanghai 200240, Peoples R China
通讯作者:
通讯机构:[1]Shanghai Jiao Tong Univ, Inst Med Robot, Sch Biomed Engn, Shanghai 200240, Peoples R China[2]Shanghai Jiao Tong Univ, Tongren Hosp, Inst Med Robot, Shanghai Key Lab Flexible Med Robot, Shanghai 200240, Peoples R China
推荐引用方式(GB/T 7714):
Luan Yunfei,Luo Yating,Liu Yuxuan,et al.Autofocusing With 3-D Tracking for Robot-Assisted Microsurgery[J].IEEE-ASME TRANSACTIONS ON MECHATRONICS.2025,doi:10.1109/TMECH.2025.3585533.
APA:
Luan, Yunfei,Luo, Yating,Liu, Yuxuan,Zhang, Musen,An, Yujian...&Yang, Guang-Zhong.(2025).Autofocusing With 3-D Tracking for Robot-Assisted Microsurgery.IEEE-ASME TRANSACTIONS ON MECHATRONICS,,
MLA:
Luan, Yunfei,et al."Autofocusing With 3-D Tracking for Robot-Assisted Microsurgery".IEEE-ASME TRANSACTIONS ON MECHATRONICS .(2025)