Validation of a deep learning computer aided system for CT based lung nodule detection, classification, and growth rate estimation in a routine clinical population.
<h4>Objective</h4>In this study, we evaluated a commercially available computer assisted diagnosis system (CAD). The deep learning algorithm of the CAD was trained with a lung cancer screening cohort and developed for detection, classification, quantification, and growth of actionable pu...
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Public Library of Science (PLoS)
2022-01-01
|
| Series: | PLoS ONE |
| Online Access: | https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0266799&type=printable |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850128396208570368 |
|---|---|
| author | John T Murchison Gillian Ritchie David Senyszak Jeroen H Nijwening Gerben van Veenendaal Joris Wakkie Edwin J R van Beek |
| author_facet | John T Murchison Gillian Ritchie David Senyszak Jeroen H Nijwening Gerben van Veenendaal Joris Wakkie Edwin J R van Beek |
| author_sort | John T Murchison |
| collection | DOAJ |
| description | <h4>Objective</h4>In this study, we evaluated a commercially available computer assisted diagnosis system (CAD). The deep learning algorithm of the CAD was trained with a lung cancer screening cohort and developed for detection, classification, quantification, and growth of actionable pulmonary nodules on chest CT scans. Here, we evaluated the CAD in a retrospective cohort of a routine clinical population.<h4>Materials and methods</h4>In total, a number of 337 scans of 314 different subjects with reported nodules of 3-30 mm in size were included into the evaluation. Two independent thoracic radiologists alternately reviewed scans with or without CAD assistance to detect, classify, segment, and register pulmonary nodules. A third, more experienced, radiologist served as an adjudicator. In addition, the cohort was analyzed by the CAD alone. The study cohort was divided into five different groups: 1) 178 CT studies without reported pulmonary nodules, 2) 95 studies with 1-10 pulmonary nodules, 23 studies from the same patients with 3) baseline and 4) follow-up studies, and 5) 18 CT studies with subsolid nodules. A reference standard for nodules was based on majority consensus with the third thoracic radiologist as required. Sensitivity, false positive (FP) rate and Dice inter-reader coefficient were calculated.<h4>Results</h4>After analysis of 470 pulmonary nodules, the sensitivity readings for radiologists without CAD and radiologist with CAD, were 71.9% (95% CI: 66.0%, 77.0%) and 80.3% (95% CI: 75.2%, 85.0%) (p < 0.01), with average FP rate of 0.11 and 0.16 per CT scan, respectively. Accuracy and kappa of CAD for classifying solid vs sub-solid nodules was 94.2% and 0.77, respectively. Average inter-reader Dice coefficient for nodule segmentation was 0.83 (95% CI: 0.39, 0.96) and 0.86 (95% CI: 0.51, 0.95) for CAD versus readers. Mean growth percentage discrepancy of readers and CAD alone was 1.30 (95% CI: 1.02, 2.21) and 1.35 (95% CI: 1.01, 4.99), respectively.<h4>Conclusion</h4>The applied CAD significantly increased radiologist's detection of actionable nodules yet also minimally increasing the false positive rate. The CAD can automatically classify and quantify nodules and calculate nodule growth rate in a cohort of a routine clinical population. Results suggest this Deep Learning software has the potential to assist chest radiologists in the tasks of pulmonary nodule detection and management within their routine clinical practice. |
| format | Article |
| id | doaj-art-dda50ba892db4a93ab260a7746c0954e |
| institution | OA Journals |
| issn | 1932-6203 |
| language | English |
| publishDate | 2022-01-01 |
| publisher | Public Library of Science (PLoS) |
| record_format | Article |
| series | PLoS ONE |
| spelling | doaj-art-dda50ba892db4a93ab260a7746c0954e2025-08-20T02:33:19ZengPublic Library of Science (PLoS)PLoS ONE1932-62032022-01-01175e026679910.1371/journal.pone.0266799Validation of a deep learning computer aided system for CT based lung nodule detection, classification, and growth rate estimation in a routine clinical population.John T MurchisonGillian RitchieDavid SenyszakJeroen H NijweningGerben van VeenendaalJoris WakkieEdwin J R van Beek<h4>Objective</h4>In this study, we evaluated a commercially available computer assisted diagnosis system (CAD). The deep learning algorithm of the CAD was trained with a lung cancer screening cohort and developed for detection, classification, quantification, and growth of actionable pulmonary nodules on chest CT scans. Here, we evaluated the CAD in a retrospective cohort of a routine clinical population.<h4>Materials and methods</h4>In total, a number of 337 scans of 314 different subjects with reported nodules of 3-30 mm in size were included into the evaluation. Two independent thoracic radiologists alternately reviewed scans with or without CAD assistance to detect, classify, segment, and register pulmonary nodules. A third, more experienced, radiologist served as an adjudicator. In addition, the cohort was analyzed by the CAD alone. The study cohort was divided into five different groups: 1) 178 CT studies without reported pulmonary nodules, 2) 95 studies with 1-10 pulmonary nodules, 23 studies from the same patients with 3) baseline and 4) follow-up studies, and 5) 18 CT studies with subsolid nodules. A reference standard for nodules was based on majority consensus with the third thoracic radiologist as required. Sensitivity, false positive (FP) rate and Dice inter-reader coefficient were calculated.<h4>Results</h4>After analysis of 470 pulmonary nodules, the sensitivity readings for radiologists without CAD and radiologist with CAD, were 71.9% (95% CI: 66.0%, 77.0%) and 80.3% (95% CI: 75.2%, 85.0%) (p < 0.01), with average FP rate of 0.11 and 0.16 per CT scan, respectively. Accuracy and kappa of CAD for classifying solid vs sub-solid nodules was 94.2% and 0.77, respectively. Average inter-reader Dice coefficient for nodule segmentation was 0.83 (95% CI: 0.39, 0.96) and 0.86 (95% CI: 0.51, 0.95) for CAD versus readers. Mean growth percentage discrepancy of readers and CAD alone was 1.30 (95% CI: 1.02, 2.21) and 1.35 (95% CI: 1.01, 4.99), respectively.<h4>Conclusion</h4>The applied CAD significantly increased radiologist's detection of actionable nodules yet also minimally increasing the false positive rate. The CAD can automatically classify and quantify nodules and calculate nodule growth rate in a cohort of a routine clinical population. Results suggest this Deep Learning software has the potential to assist chest radiologists in the tasks of pulmonary nodule detection and management within their routine clinical practice.https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0266799&type=printable |
| spellingShingle | John T Murchison Gillian Ritchie David Senyszak Jeroen H Nijwening Gerben van Veenendaal Joris Wakkie Edwin J R van Beek Validation of a deep learning computer aided system for CT based lung nodule detection, classification, and growth rate estimation in a routine clinical population. PLoS ONE |
| title | Validation of a deep learning computer aided system for CT based lung nodule detection, classification, and growth rate estimation in a routine clinical population. |
| title_full | Validation of a deep learning computer aided system for CT based lung nodule detection, classification, and growth rate estimation in a routine clinical population. |
| title_fullStr | Validation of a deep learning computer aided system for CT based lung nodule detection, classification, and growth rate estimation in a routine clinical population. |
| title_full_unstemmed | Validation of a deep learning computer aided system for CT based lung nodule detection, classification, and growth rate estimation in a routine clinical population. |
| title_short | Validation of a deep learning computer aided system for CT based lung nodule detection, classification, and growth rate estimation in a routine clinical population. |
| title_sort | validation of a deep learning computer aided system for ct based lung nodule detection classification and growth rate estimation in a routine clinical population |
| url | https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0266799&type=printable |
| work_keys_str_mv | AT johntmurchison validationofadeeplearningcomputeraidedsystemforctbasedlungnoduledetectionclassificationandgrowthrateestimationinaroutineclinicalpopulation AT gillianritchie validationofadeeplearningcomputeraidedsystemforctbasedlungnoduledetectionclassificationandgrowthrateestimationinaroutineclinicalpopulation AT davidsenyszak validationofadeeplearningcomputeraidedsystemforctbasedlungnoduledetectionclassificationandgrowthrateestimationinaroutineclinicalpopulation AT jeroenhnijwening validationofadeeplearningcomputeraidedsystemforctbasedlungnoduledetectionclassificationandgrowthrateestimationinaroutineclinicalpopulation AT gerbenvanveenendaal validationofadeeplearningcomputeraidedsystemforctbasedlungnoduledetectionclassificationandgrowthrateestimationinaroutineclinicalpopulation AT joriswakkie validationofadeeplearningcomputeraidedsystemforctbasedlungnoduledetectionclassificationandgrowthrateestimationinaroutineclinicalpopulation AT edwinjrvanbeek validationofadeeplearningcomputeraidedsystemforctbasedlungnoduledetectionclassificationandgrowthrateestimationinaroutineclinicalpopulation |