机构:[1]Beijing Inst Technol, Beijing 100081, Peoples R China[2]Univ Liverpool, Dept Eye & Vis Sci, Liverpool L7 8TX, England[3]Capital Med Univ, Beijing Tongren Hosp, Beijing Inst Ophthalmol, Beijing 100054, Peoples R China研究所眼科研究所首都医科大学附属北京同仁医院首都医科大学附属同仁医院[4]Henan Prov Acad Med Sci, Zhengzhou 450046, Peoples R China
Anomaly detection is an important task for medical image analysis, which can alleviate the reliance of supervised methods on large labelled datasets. Most existing methods use a pixel-wise self-reconstruction framework for anomaly detection. However, there are two challenges of these studies: 1) they tend to overfit learning an identity mapping between the input and output, which leads to failure in detecting abnormal samples; 2) the reconstruction considers the pixel-wise differences which may lead to an undesirable result. To mitigate the above problems, we propose a novel heterogeneous Auto-Encoder (Hetero-AE) for medical anomaly detection. Our model utilizes a convolutional neural network (CNN) as the encoder and a hybrid CNN-Transformer network as the decoder. The heterogeneous structure enables the model to learn the intrinsic information of normal data and enlarge the difference on abnormal samples. To fully exploit the effectiveness of Transformer in the hybrid network, a multi-scale sparse Transformer block is proposed to trade off modelling long-range feature dependencies and high computational costs. Moreover, the multi-stage feature comparison is introduced to reduce the noise of pixel-wise comparison. Extensive experiments on four public datasets (i.e., retinal OCT, chest X-ray, brain MRI, and COVID-19) verify the effectiveness of our method on different imaging modalities for anomaly detection. Additionally, our method can accurately detect tumors in brain MRI and lesions in retinal OCT with interpretable heatmaps to locate lesion areas, assisting clinicians in diagnosing abnormalities efficiently.
基金:
National Natural Science Foundation of China (NSFC)
第一作者机构:[1]Beijing Inst Technol, Beijing 100081, Peoples R China
通讯作者:
通讯机构:[1]Beijing Inst Technol, Beijing 100081, Peoples R China[2]Univ Liverpool, Dept Eye & Vis Sci, Liverpool L7 8TX, England
推荐引用方式(GB/T 7714):
Lu Shuai,Zhang Weihang,Zhao He,et al.Anomaly Detection for Medical Images Using Heterogeneous Auto-Encoder[J].IEEE TRANSACTIONS ON IMAGE PROCESSING.2024,33:2770-2782.doi:10.1109/TIP.2024.3381435.
APA:
Lu, Shuai,Zhang, Weihang,Zhao, He,Liu, Hanruo,Wang, Ningli&Li, Huiqi.(2024).Anomaly Detection for Medical Images Using Heterogeneous Auto-Encoder.IEEE TRANSACTIONS ON IMAGE PROCESSING,33,
MLA:
Lu, Shuai,et al."Anomaly Detection for Medical Images Using Heterogeneous Auto-Encoder".IEEE TRANSACTIONS ON IMAGE PROCESSING 33.(2024):2770-2782