Robustly detecting mpox and non-mpox using a deep learning framework based on image inpainting

Robustly detecting mpox and non-mpox using a deep learning framework based on image inpainting

Abstract Due to the lack of efficient mpox diagnostic technology, mpox cases continue to increase. Recently, the great potential of deep learning models in detecting mpox and non-mpox has been proven. However, existing methods are susceptible to interference from various noises in real-world setting...

Full description

Saved in:
Bibliographic Details
Main Authors: Yujun Cao, Yubiao Yue, Xiaoming Ma, Di Liu, Rongkai Ni, Haihua Liang, Zhenzhang Li
Format: Article
Language:English
Published: Nature Portfolio 2025-01-01
Series:Scientific Reports
Subjects:
Mpox Detection
Deep learning
Novelty detection
Image Inpainting
Generative model
Online Access:https://doi.org/10.1038/s41598-025-85771-z
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Abstract Due to the lack of efficient mpox diagnostic technology, mpox cases continue to increase. Recently, the great potential of deep learning models in detecting mpox and non-mpox has been proven. However, existing methods are susceptible to interference from various noises in real-world settings, require diverse non-mpox images, and fail to detect abnormal input, which makes them unsuitable for practical deployment and application. To address these challenges, we proposed a novel strategy based on image inpainting called “Mask, Inpainting, and Measure” (MIM). In MIM’s pipeline, a generative adversarial network learns feature representations of mpox images by inpainting the masked mpox images. On this basis, MIM measure the similarity between the inpainted image and the original image to detect mpox and non-mpox. Compared with multi-class classification models, MIM can handle unknown categories and abnormal inputs more effectively. We used the recognized mpox dataset (MSLD) and a dataset containing 18 categories of non-mpox skin diseases to verify the effectiveness and robustness of MIM. Experimental results show that the average AUROC of MIM achieves 0.8237. In addition, external clinical testing further demonstrates the robustness of MIM. Importantly, we developed a free smartphone app to help the public and healthcare professionals detect mpox more conveniently.
ISSN:2045-2322

Similar Items