Deep learning-based automatic image quality assessment in ultra-widefield fundus photographs
Objective With a growing need for ultra-widefield fundus (UWF) fundus photographs in clinics and AI development, image quality assessment (IQA) of UWF fundus photographs is an important preceding step for accurate diagnosis and clinical interpretation. This study developed deep learning (DL) models...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMJ Publishing Group
2025-05-01
|
| Series: | BMJ Open |
| Online Access: | https://bmjopen.bmj.com/content/15/5/e100058.full |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849716136624521216 |
|---|---|
| author | Sang Jun Park Kyu Hyung Park Chang Ki Yoon Richul Oh Un Chul Park |
| author_facet | Sang Jun Park Kyu Hyung Park Chang Ki Yoon Richul Oh Un Chul Park |
| author_sort | Sang Jun Park |
| collection | DOAJ |
| description | Objective With a growing need for ultra-widefield fundus (UWF) fundus photographs in clinics and AI development, image quality assessment (IQA) of UWF fundus photographs is an important preceding step for accurate diagnosis and clinical interpretation. This study developed deep learning (DL) models for automated IQA of UWF fundus photographs (UWF-IQA model) and investigated intergrader agreements in the IQA of UWF fundus photographs.Methods and analysis We included 4749 UWF images of 2124 patients to set the UWF-IQA dataset. Three independent board-certified ophthalmologists manually assessed each UWF image on four grading criteria (field of view, peripheral visualisation, details of posterior pole and centring of the image) and a final IQA grading using a five-point scale. The UWF-IQA model was developed to predict IQA scores with EfficientNet-B3 as the backbone model. For the test dataset, Cohen’s quadratic weighted kappa score was calculated to evaluate intergrader agreements and agreements between predicted IQA scores and manual gradings.Results Development and test dataset consisted of 3790 images from 1699 patients and 959 images of 425 patients, respectively, without statistical differences in IQA gradings. The average agreement between the UWF-IQA model and manual graders was 0.731, while the average of intergrader agreements among manual graders was 0.603 (Cohen’s weighted kappa score). Posterior pole grading showed the highest average agreements (0.838) between the UWF-IQA model and manual graders, followed by final grading (0.788), centring of the image (0.754), peripheral visualisation (0.754) and field of view (0.535).Conclusion Predicted IQA scores using the UWF-IQA model showed better agreements with manual graders compared with intergrader agreements. The automated UWF-IQA model offers robust and efficient IQA predictions with the final and subcategory gradings. |
| format | Article |
| id | doaj-art-52f5d0b233274b74b3034fa47b397ef4 |
| institution | DOAJ |
| issn | 2044-6055 |
| language | English |
| publishDate | 2025-05-01 |
| publisher | BMJ Publishing Group |
| record_format | Article |
| series | BMJ Open |
| spelling | doaj-art-52f5d0b233274b74b3034fa47b397ef42025-08-20T03:13:07ZengBMJ Publishing GroupBMJ Open2044-60552025-05-0115510.1136/bmjopen-2025-100058Deep learning-based automatic image quality assessment in ultra-widefield fundus photographsSang Jun Park0Kyu Hyung Park1Chang Ki Yoon2Richul Oh3Un Chul Park41 Department of Ophthalmology, Seoul National University College of Medicine, Jongno-gu, Korea (the Republic of)1 Department of Ophthalmology, Seoul National University College of Medicine, Jongno-gu, Korea (the Republic of)1 Department of Ophthalmology, Seoul National University College of Medicine, Jongno-gu, Korea (the Republic of)1 Department of Ophthalmology, Seoul National University College of Medicine, Jongno-gu, Korea (the Republic of)1 Department of Ophthalmology, Seoul National University College of Medicine, Jongno-gu, Korea (the Republic of)Objective With a growing need for ultra-widefield fundus (UWF) fundus photographs in clinics and AI development, image quality assessment (IQA) of UWF fundus photographs is an important preceding step for accurate diagnosis and clinical interpretation. This study developed deep learning (DL) models for automated IQA of UWF fundus photographs (UWF-IQA model) and investigated intergrader agreements in the IQA of UWF fundus photographs.Methods and analysis We included 4749 UWF images of 2124 patients to set the UWF-IQA dataset. Three independent board-certified ophthalmologists manually assessed each UWF image on four grading criteria (field of view, peripheral visualisation, details of posterior pole and centring of the image) and a final IQA grading using a five-point scale. The UWF-IQA model was developed to predict IQA scores with EfficientNet-B3 as the backbone model. For the test dataset, Cohen’s quadratic weighted kappa score was calculated to evaluate intergrader agreements and agreements between predicted IQA scores and manual gradings.Results Development and test dataset consisted of 3790 images from 1699 patients and 959 images of 425 patients, respectively, without statistical differences in IQA gradings. The average agreement between the UWF-IQA model and manual graders was 0.731, while the average of intergrader agreements among manual graders was 0.603 (Cohen’s weighted kappa score). Posterior pole grading showed the highest average agreements (0.838) between the UWF-IQA model and manual graders, followed by final grading (0.788), centring of the image (0.754), peripheral visualisation (0.754) and field of view (0.535).Conclusion Predicted IQA scores using the UWF-IQA model showed better agreements with manual graders compared with intergrader agreements. The automated UWF-IQA model offers robust and efficient IQA predictions with the final and subcategory gradings.https://bmjopen.bmj.com/content/15/5/e100058.full |
| spellingShingle | Sang Jun Park Kyu Hyung Park Chang Ki Yoon Richul Oh Un Chul Park Deep learning-based automatic image quality assessment in ultra-widefield fundus photographs BMJ Open |
| title | Deep learning-based automatic image quality assessment in ultra-widefield fundus photographs |
| title_full | Deep learning-based automatic image quality assessment in ultra-widefield fundus photographs |
| title_fullStr | Deep learning-based automatic image quality assessment in ultra-widefield fundus photographs |
| title_full_unstemmed | Deep learning-based automatic image quality assessment in ultra-widefield fundus photographs |
| title_short | Deep learning-based automatic image quality assessment in ultra-widefield fundus photographs |
| title_sort | deep learning based automatic image quality assessment in ultra widefield fundus photographs |
| url | https://bmjopen.bmj.com/content/15/5/e100058.full |
| work_keys_str_mv | AT sangjunpark deeplearningbasedautomaticimagequalityassessmentinultrawidefieldfundusphotographs AT kyuhyungpark deeplearningbasedautomaticimagequalityassessmentinultrawidefieldfundusphotographs AT changkiyoon deeplearningbasedautomaticimagequalityassessmentinultrawidefieldfundusphotographs AT richuloh deeplearningbasedautomaticimagequalityassessmentinultrawidefieldfundusphotographs AT unchulpark deeplearningbasedautomaticimagequalityassessmentinultrawidefieldfundusphotographs |