Research on recognition of diabetic retinopathy hemorrhage lesions based on fine tuning of segment anything model
Abstract Diabetic Retinopathy (DR) demands precise hemorrhage detection for early diagnosis, yet manual identification faces challenges due to hemorrhagic lesions’ varied sizes, complex shapes, and color similarities to surrounding tissues, which obscure boundaries and reduce contrast. To address th...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Nature Portfolio
2025-03-01
|
| Series: | Scientific Reports |
| Subjects: | |
| Online Access: | https://doi.org/10.1038/s41598-025-92665-7 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850208729313574912 |
|---|---|
| author | Sujuan Tang Qingwen Wu |
| author_facet | Sujuan Tang Qingwen Wu |
| author_sort | Sujuan Tang |
| collection | DOAJ |
| description | Abstract Diabetic Retinopathy (DR) demands precise hemorrhage detection for early diagnosis, yet manual identification faces challenges due to hemorrhagic lesions’ varied sizes, complex shapes, and color similarities to surrounding tissues, which obscure boundaries and reduce contrast. To address this, we propose SAM-ada-Res, a novel dual-encoder model integrating a pre-trained Segment Anything Model (SAM) and ResNet101. SAM captures global semantic context to distinguish ambiguous lesions from vessels, while ResNet101 extracts fine-grained details through its deep hierarchical layers. Feature maps from both encoders are fused via channel-wise concatenation, enabling the decoder to localize lesions with high precision. A lightweight Adapter fine-tunes SAM for retinal tasks without retraining its backbone, ensuring task-specific adaptation. Evaluated on three datasets (OIA-DDR, IDRiD, JYFY-HE), SAM-ada-Res outperforms state-of-the-art methods in nDice (0.6040 on JYFY-HE) and nIoU (0.4182 on IDRiD), demonstrating superior generalization and robustness. An online platform further streamlines clinical deployment, enhancing diagnostic efficiency. By synergizing SAM’s generalizable vision capabilities with ResNet’s localized feature extraction, SAM-ada-Res overcomes key challenges in DR hemorrhage detection, offering a robust tool for early intervention. This work bridges technical innovation and clinical practicality, advancing automated DR diagnosis. |
| format | Article |
| id | doaj-art-d2a411696c394b8d980c3bb55539db45 |
| institution | OA Journals |
| issn | 2045-2322 |
| language | English |
| publishDate | 2025-03-01 |
| publisher | Nature Portfolio |
| record_format | Article |
| series | Scientific Reports |
| spelling | doaj-art-d2a411696c394b8d980c3bb55539db452025-08-20T02:10:10ZengNature PortfolioScientific Reports2045-23222025-03-0115111110.1038/s41598-025-92665-7Research on recognition of diabetic retinopathy hemorrhage lesions based on fine tuning of segment anything modelSujuan Tang0Qingwen Wu1Department of Neurological Intensive Care Unit, Affiliated Hospital of Jining Medical UniversityDepartment of Data Center, Affiliated Hospital of Jining Medical UniversityAbstract Diabetic Retinopathy (DR) demands precise hemorrhage detection for early diagnosis, yet manual identification faces challenges due to hemorrhagic lesions’ varied sizes, complex shapes, and color similarities to surrounding tissues, which obscure boundaries and reduce contrast. To address this, we propose SAM-ada-Res, a novel dual-encoder model integrating a pre-trained Segment Anything Model (SAM) and ResNet101. SAM captures global semantic context to distinguish ambiguous lesions from vessels, while ResNet101 extracts fine-grained details through its deep hierarchical layers. Feature maps from both encoders are fused via channel-wise concatenation, enabling the decoder to localize lesions with high precision. A lightweight Adapter fine-tunes SAM for retinal tasks without retraining its backbone, ensuring task-specific adaptation. Evaluated on three datasets (OIA-DDR, IDRiD, JYFY-HE), SAM-ada-Res outperforms state-of-the-art methods in nDice (0.6040 on JYFY-HE) and nIoU (0.4182 on IDRiD), demonstrating superior generalization and robustness. An online platform further streamlines clinical deployment, enhancing diagnostic efficiency. By synergizing SAM’s generalizable vision capabilities with ResNet’s localized feature extraction, SAM-ada-Res overcomes key challenges in DR hemorrhage detection, offering a robust tool for early intervention. This work bridges technical innovation and clinical practicality, advancing automated DR diagnosis.https://doi.org/10.1038/s41598-025-92665-7Segment anything modelDiabetic retinopathyHemorrhageAdapter tuning |
| spellingShingle | Sujuan Tang Qingwen Wu Research on recognition of diabetic retinopathy hemorrhage lesions based on fine tuning of segment anything model Scientific Reports Segment anything model Diabetic retinopathy Hemorrhage Adapter tuning |
| title | Research on recognition of diabetic retinopathy hemorrhage lesions based on fine tuning of segment anything model |
| title_full | Research on recognition of diabetic retinopathy hemorrhage lesions based on fine tuning of segment anything model |
| title_fullStr | Research on recognition of diabetic retinopathy hemorrhage lesions based on fine tuning of segment anything model |
| title_full_unstemmed | Research on recognition of diabetic retinopathy hemorrhage lesions based on fine tuning of segment anything model |
| title_short | Research on recognition of diabetic retinopathy hemorrhage lesions based on fine tuning of segment anything model |
| title_sort | research on recognition of diabetic retinopathy hemorrhage lesions based on fine tuning of segment anything model |
| topic | Segment anything model Diabetic retinopathy Hemorrhage Adapter tuning |
| url | https://doi.org/10.1038/s41598-025-92665-7 |
| work_keys_str_mv | AT sujuantang researchonrecognitionofdiabeticretinopathyhemorrhagelesionsbasedonfinetuningofsegmentanythingmodel AT qingwenwu researchonrecognitionofdiabeticretinopathyhemorrhagelesionsbasedonfinetuningofsegmentanythingmodel |