Single-Step Sampling Approach for Unsupervised Anomaly Detection of Brain MRI Using Denoising Diffusion Models
Generative models, especially diffusion models, have gained traction in image generation for their high-quality image synthesis, surpassing generative adversarial networks (GANs). They have shown to excel in anomaly detection by modeling healthy reference data for scoring anomalies. However, one maj...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wiley
2024-01-01
|
| Series: | International Journal of Biomedical Imaging |
| Online Access: | http://dx.doi.org/10.1155/ijbi/2352602 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850098641575870464 |
|---|---|
| author | Mohammed Z. Damudi Anita S. Kini |
| author_facet | Mohammed Z. Damudi Anita S. Kini |
| author_sort | Mohammed Z. Damudi |
| collection | DOAJ |
| description | Generative models, especially diffusion models, have gained traction in image generation for their high-quality image synthesis, surpassing generative adversarial networks (GANs). They have shown to excel in anomaly detection by modeling healthy reference data for scoring anomalies. However, one major disadvantage of these models is its sampling speed, which so far has made it unsuitable for use in time-sensitive scenarios. The time taken to generate a single image using the iterative sampling procedure introduced in denoising diffusion probabilistic model (DDPM) is quite significant. To address this, we propose a novel single-step sampling procedure that hugely improves the sampling speed while generating images of comparable quality. While DDPMs usually denoise images containing pure noise to generate an original image, we utilize a partial diffusion approach to preserve the image structure. In anomaly detection, we want the reconstructed image to have a structure similar to the original anomalous image, so that we can compare the pixel-level difference between them in order to segment the anomaly. The original DDPM algorithm suggests an iterative sampling procedure where the model slowly reduces the noise, until we have a noise-free image. Our single-step sampling approach attempts to remove all the noise in the image within a single step, while still being able to repair the anomaly and achieve comparable results. The output is a binary image showing the predicted anomalous regions, which is then compared to the ground truth to evaluate its segmentation performance. We find that, while it does achieve slightly better anomaly masks, the main improvement is in sampling speed, where our approach was found to perform significantly faster as compared to the iterative procedure. Our work is mainly focused on anomaly detection in brain MR volumes, and therefore, this approach could be used by radiologists in a clinical setting to find anomalies in large quantities of brain MRI. |
| format | Article |
| id | doaj-art-80b1817659934aaab472d619f383d60a |
| institution | DOAJ |
| issn | 1687-4196 |
| language | English |
| publishDate | 2024-01-01 |
| publisher | Wiley |
| record_format | Article |
| series | International Journal of Biomedical Imaging |
| spelling | doaj-art-80b1817659934aaab472d619f383d60a2025-08-20T02:40:40ZengWileyInternational Journal of Biomedical Imaging1687-41962024-01-01202410.1155/ijbi/2352602Single-Step Sampling Approach for Unsupervised Anomaly Detection of Brain MRI Using Denoising Diffusion ModelsMohammed Z. Damudi0Anita S. Kini1Department of Computer Science & EngineeringDepartment of Computer Science & EngineeringGenerative models, especially diffusion models, have gained traction in image generation for their high-quality image synthesis, surpassing generative adversarial networks (GANs). They have shown to excel in anomaly detection by modeling healthy reference data for scoring anomalies. However, one major disadvantage of these models is its sampling speed, which so far has made it unsuitable for use in time-sensitive scenarios. The time taken to generate a single image using the iterative sampling procedure introduced in denoising diffusion probabilistic model (DDPM) is quite significant. To address this, we propose a novel single-step sampling procedure that hugely improves the sampling speed while generating images of comparable quality. While DDPMs usually denoise images containing pure noise to generate an original image, we utilize a partial diffusion approach to preserve the image structure. In anomaly detection, we want the reconstructed image to have a structure similar to the original anomalous image, so that we can compare the pixel-level difference between them in order to segment the anomaly. The original DDPM algorithm suggests an iterative sampling procedure where the model slowly reduces the noise, until we have a noise-free image. Our single-step sampling approach attempts to remove all the noise in the image within a single step, while still being able to repair the anomaly and achieve comparable results. The output is a binary image showing the predicted anomalous regions, which is then compared to the ground truth to evaluate its segmentation performance. We find that, while it does achieve slightly better anomaly masks, the main improvement is in sampling speed, where our approach was found to perform significantly faster as compared to the iterative procedure. Our work is mainly focused on anomaly detection in brain MR volumes, and therefore, this approach could be used by radiologists in a clinical setting to find anomalies in large quantities of brain MRI.http://dx.doi.org/10.1155/ijbi/2352602 |
| spellingShingle | Mohammed Z. Damudi Anita S. Kini Single-Step Sampling Approach for Unsupervised Anomaly Detection of Brain MRI Using Denoising Diffusion Models International Journal of Biomedical Imaging |
| title | Single-Step Sampling Approach for Unsupervised Anomaly Detection of Brain MRI Using Denoising Diffusion Models |
| title_full | Single-Step Sampling Approach for Unsupervised Anomaly Detection of Brain MRI Using Denoising Diffusion Models |
| title_fullStr | Single-Step Sampling Approach for Unsupervised Anomaly Detection of Brain MRI Using Denoising Diffusion Models |
| title_full_unstemmed | Single-Step Sampling Approach for Unsupervised Anomaly Detection of Brain MRI Using Denoising Diffusion Models |
| title_short | Single-Step Sampling Approach for Unsupervised Anomaly Detection of Brain MRI Using Denoising Diffusion Models |
| title_sort | single step sampling approach for unsupervised anomaly detection of brain mri using denoising diffusion models |
| url | http://dx.doi.org/10.1155/ijbi/2352602 |
| work_keys_str_mv | AT mohammedzdamudi singlestepsamplingapproachforunsupervisedanomalydetectionofbrainmriusingdenoisingdiffusionmodels AT anitaskini singlestepsamplingapproachforunsupervisedanomalydetectionofbrainmriusingdenoisingdiffusionmodels |