高级检索
当前位置: 首页 > 详情页

Real-time segmentation and tracking of excised corneal contour by deep neural networks for DALK surgical navigation

文献详情

资源类型:
WOS体系:
Pubmed体系:

收录情况: ◇ SCIE ◇ EI

机构: [a]State Key Laboratory of Virtual Reality Technology and Systems, Beihang University, Beijing, China [b]Peng Cheng Lab, Shenzhen, China [c]Faculty of Media and Communication, Bournemouth University, Bournemouth, United Kingdom [d]Shenzhen Kechuang GuangTai Technology Co.,Ltd., Shenzhen, China [e]Shandong Eye Institute Shandong Eye Hospital, Jinan, China [f]Beijing Tongren Eye Center, Beijing Tongren Hospital, Capital Medical University, Beijing Ophthalmology and Visual Sciences Key Laboratory, Beijing, China [g]Department of Computer Science, Stony Brook University, New York, United States
出处:
ISSN:

关键词: AR-based surgical navigation Contour tracking DALK Optical flow inpainting Semantic segmentation

摘要:
Objective: Corneal disease is one of the main causes of blindness for humans globally nowadays, and deep anterior lamellar keratoplasty (DALK) is a widely applied technique for corneal transplantation. However, the position of stitch points highly influences the success rate of such surgery, which would require accurate control and manipulation of surgical instruments. Methods: In this paper, we present a deep learning framework for augmented reality (AR) based surgery navigation to guide the suturing in DALK. It can robustly track the excised corneal contour by semantic segmentation and the reconstruction of occlusion. We propose a novel optical flow inpainting network to recover the missing motion caused by occlusion. The occluded regions are detected by weakly supervised segmentation of surgical instruments and reconstructed by key frame warping along the completed optical flow. Then we introduce two types of loss function to adapt the inpainting network in the optical flow space. Results: Our techniques are tested and evaluated by a number of real surgery videos from Shandong Eye Hospital in China. We compare our approaches with other typical methods in the corneal contour segmentation, optical flow inpainting and occlusion regions reconstruction. The tracking accuracy reachs 99.2% in average and PSNR reaches 25.52 for the reconstruction of the occluded frames. Conclusion: From the experimental evaluations and user study, both the qualitative and quantitative results indicate that our techniques can achieve accurate detection and tracking of corneal contour under complex disturbance in real-time surgical scenes. Our prototype AR navigation system would be highly useful in clinical practice. © 2020 Elsevier B.V.

基金:
语种:
被引次数:
WOS:
PubmedID:
中科院(CAS)分区:
出版当年[2019]版:
大类 | 3 区 医学
小类 | 2 区 计算机:理论方法 3 区 计算机:跨学科应用 3 区 工程:生物医学 3 区 医学:信息
最新[2025]版:
大类 | 2 区 医学
小类 | 2 区 计算机:跨学科应用 2 区 计算机:理论方法 2 区 工程:生物医学 3 区 医学:信息
JCR分区:
出版当年[2018]版:
Q1 COMPUTER SCIENCE, THEORY & METHODS Q1 MEDICAL INFORMATICS Q1 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Q2 ENGINEERING, BIOMEDICAL
最新[2023]版:
Q1 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Q1 COMPUTER SCIENCE, THEORY & METHODS Q1 ENGINEERING, BIOMEDICAL Q1 MEDICAL INFORMATICS

影响因子: 最新[2023版] 最新五年平均 出版当年[2018版] 出版当年五年平均 出版前一年[2017版] 出版后一年[2019版]

第一作者:
第一作者机构: [a]State Key Laboratory of Virtual Reality Technology and Systems, Beihang University, Beijing, China [b]Peng Cheng Lab, Shenzhen, China [c]Faculty of Media and Communication, Bournemouth University, Bournemouth, United Kingdom [*1]State Key Laboratory of Virtual Reality Technology and Systems, Beihang University, Beijing, China.
通讯作者:
通讯机构: [a]State Key Laboratory of Virtual Reality Technology and Systems, Beihang University, Beijing, China [b]Peng Cheng Lab, Shenzhen, China [c]Faculty of Media and Communication, Bournemouth University, Bournemouth, United Kingdom [*1]State Key Laboratory of Virtual Reality Technology and Systems, Beihang University, Beijing, China.
推荐引用方式(GB/T 7714):
APA:
MLA:

资源点击量:23549 今日访问量:0 总访问量:1282 更新日期:2025-04-01 建议使用谷歌、火狐浏览器 常见问题

版权所有©2020 首都医科大学附属北京同仁医院 技术支持:重庆聚合科技有限公司 地址:北京市东城区东交民巷1号(100730)