Multivendor Spectral-Domain Optical Coherence Tomography Dataset, Observer Annotation Performance Evaluation, and Standardized Evaluation Framework for Intraretinal Cystoid Fluid Segmentation
Development of image analysis and machine learning methods for segmentation of clinically significant pathology in retinal spectral-domain optical coherence tomography (SD-OCT), used in disease detection and prediction, is limited due to the availability of expertly annotated reference data. Retinal...
Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wiley
2016-01-01
|
| Series: | Journal of Ophthalmology |
| Online Access: | http://dx.doi.org/10.1155/2016/3898750 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832564527167700992 |
|---|---|
| author | Jing Wu Ana-Maria Philip Dominika Podkowinski Bianca S. Gerendas Georg Langs Christian Simader Sebastian M. Waldstein Ursula M. Schmidt-Erfurth |
| author_facet | Jing Wu Ana-Maria Philip Dominika Podkowinski Bianca S. Gerendas Georg Langs Christian Simader Sebastian M. Waldstein Ursula M. Schmidt-Erfurth |
| author_sort | Jing Wu |
| collection | DOAJ |
| description | Development of image analysis and machine learning methods for segmentation of clinically significant pathology in retinal spectral-domain optical coherence tomography (SD-OCT), used in disease detection and prediction, is limited due to the availability of expertly annotated reference data. Retinal segmentation methods use datasets that either are not publicly available, come from only one device, or use different evaluation methodologies making them difficult to compare. Thus we present and evaluate a multiple expert annotated reference dataset for the problem of intraretinal cystoid fluid (IRF) segmentation, a key indicator in exudative macular disease. In addition, a standardized framework for segmentation accuracy evaluation, applicable to other pathological structures, is presented. Integral to this work is the dataset used which must be fit for purpose for IRF segmentation algorithm training and testing. We describe here a multivendor dataset comprised of 30 scans. Each OCT scan for system training has been annotated by multiple graders using a proprietary system. Evaluation of the intergrader annotations shows a good correlation, thus making the reproducibly annotated scans suitable for the training and validation of image processing and machine learning based segmentation methods. The dataset will be made publicly available in the form of a segmentation Grand Challenge. |
| format | Article |
| id | doaj-art-382e56dc360e4962936fefecb5a6799b |
| institution | Kabale University |
| issn | 2090-004X 2090-0058 |
| language | English |
| publishDate | 2016-01-01 |
| publisher | Wiley |
| record_format | Article |
| series | Journal of Ophthalmology |
| spelling | doaj-art-382e56dc360e4962936fefecb5a6799b2025-02-03T01:10:46ZengWileyJournal of Ophthalmology2090-004X2090-00582016-01-01201610.1155/2016/38987503898750Multivendor Spectral-Domain Optical Coherence Tomography Dataset, Observer Annotation Performance Evaluation, and Standardized Evaluation Framework for Intraretinal Cystoid Fluid SegmentationJing Wu0Ana-Maria Philip1Dominika Podkowinski2Bianca S. Gerendas3Georg Langs4Christian Simader5Sebastian M. Waldstein6Ursula M. Schmidt-Erfurth7Christian Doppler Laboratory for Ophthalmic Image Analysis, Department of Ophthalmology and Optometry, Medical University of Vienna, Vienna, AustriaChristian Doppler Laboratory for Ophthalmic Image Analysis, Department of Ophthalmology and Optometry, Medical University of Vienna, Vienna, AustriaChristian Doppler Laboratory for Ophthalmic Image Analysis, Department of Ophthalmology and Optometry, Medical University of Vienna, Vienna, AustriaChristian Doppler Laboratory for Ophthalmic Image Analysis, Department of Ophthalmology and Optometry, Medical University of Vienna, Vienna, AustriaChristian Doppler Laboratory for Ophthalmic Image Analysis, Computational Imaging Research Lab, Department of Biomedical Imaging and Image-Guided Therapy, Medical University of Vienna, Vienna, AustriaChristian Doppler Laboratory for Ophthalmic Image Analysis, Department of Ophthalmology and Optometry, Medical University of Vienna, Vienna, AustriaChristian Doppler Laboratory for Ophthalmic Image Analysis, Department of Ophthalmology and Optometry, Medical University of Vienna, Vienna, AustriaChristian Doppler Laboratory for Ophthalmic Image Analysis, Department of Ophthalmology and Optometry, Medical University of Vienna, Vienna, AustriaDevelopment of image analysis and machine learning methods for segmentation of clinically significant pathology in retinal spectral-domain optical coherence tomography (SD-OCT), used in disease detection and prediction, is limited due to the availability of expertly annotated reference data. Retinal segmentation methods use datasets that either are not publicly available, come from only one device, or use different evaluation methodologies making them difficult to compare. Thus we present and evaluate a multiple expert annotated reference dataset for the problem of intraretinal cystoid fluid (IRF) segmentation, a key indicator in exudative macular disease. In addition, a standardized framework for segmentation accuracy evaluation, applicable to other pathological structures, is presented. Integral to this work is the dataset used which must be fit for purpose for IRF segmentation algorithm training and testing. We describe here a multivendor dataset comprised of 30 scans. Each OCT scan for system training has been annotated by multiple graders using a proprietary system. Evaluation of the intergrader annotations shows a good correlation, thus making the reproducibly annotated scans suitable for the training and validation of image processing and machine learning based segmentation methods. The dataset will be made publicly available in the form of a segmentation Grand Challenge.http://dx.doi.org/10.1155/2016/3898750 |
| spellingShingle | Jing Wu Ana-Maria Philip Dominika Podkowinski Bianca S. Gerendas Georg Langs Christian Simader Sebastian M. Waldstein Ursula M. Schmidt-Erfurth Multivendor Spectral-Domain Optical Coherence Tomography Dataset, Observer Annotation Performance Evaluation, and Standardized Evaluation Framework for Intraretinal Cystoid Fluid Segmentation Journal of Ophthalmology |
| title | Multivendor Spectral-Domain Optical Coherence Tomography Dataset, Observer Annotation Performance Evaluation, and Standardized Evaluation Framework for Intraretinal Cystoid Fluid Segmentation |
| title_full | Multivendor Spectral-Domain Optical Coherence Tomography Dataset, Observer Annotation Performance Evaluation, and Standardized Evaluation Framework for Intraretinal Cystoid Fluid Segmentation |
| title_fullStr | Multivendor Spectral-Domain Optical Coherence Tomography Dataset, Observer Annotation Performance Evaluation, and Standardized Evaluation Framework for Intraretinal Cystoid Fluid Segmentation |
| title_full_unstemmed | Multivendor Spectral-Domain Optical Coherence Tomography Dataset, Observer Annotation Performance Evaluation, and Standardized Evaluation Framework for Intraretinal Cystoid Fluid Segmentation |
| title_short | Multivendor Spectral-Domain Optical Coherence Tomography Dataset, Observer Annotation Performance Evaluation, and Standardized Evaluation Framework for Intraretinal Cystoid Fluid Segmentation |
| title_sort | multivendor spectral domain optical coherence tomography dataset observer annotation performance evaluation and standardized evaluation framework for intraretinal cystoid fluid segmentation |
| url | http://dx.doi.org/10.1155/2016/3898750 |
| work_keys_str_mv | AT jingwu multivendorspectraldomainopticalcoherencetomographydatasetobserverannotationperformanceevaluationandstandardizedevaluationframeworkforintraretinalcystoidfluidsegmentation AT anamariaphilip multivendorspectraldomainopticalcoherencetomographydatasetobserverannotationperformanceevaluationandstandardizedevaluationframeworkforintraretinalcystoidfluidsegmentation AT dominikapodkowinski multivendorspectraldomainopticalcoherencetomographydatasetobserverannotationperformanceevaluationandstandardizedevaluationframeworkforintraretinalcystoidfluidsegmentation AT biancasgerendas multivendorspectraldomainopticalcoherencetomographydatasetobserverannotationperformanceevaluationandstandardizedevaluationframeworkforintraretinalcystoidfluidsegmentation AT georglangs multivendorspectraldomainopticalcoherencetomographydatasetobserverannotationperformanceevaluationandstandardizedevaluationframeworkforintraretinalcystoidfluidsegmentation AT christiansimader multivendorspectraldomainopticalcoherencetomographydatasetobserverannotationperformanceevaluationandstandardizedevaluationframeworkforintraretinalcystoidfluidsegmentation AT sebastianmwaldstein multivendorspectraldomainopticalcoherencetomographydatasetobserverannotationperformanceevaluationandstandardizedevaluationframeworkforintraretinalcystoidfluidsegmentation AT ursulamschmidterfurth multivendorspectraldomainopticalcoherencetomographydatasetobserverannotationperformanceevaluationandstandardizedevaluationframeworkforintraretinalcystoidfluidsegmentation |