Observer Performance in the Use of Digital and Optical Microscopy for the Interpretation of Tissue-Based Biomarkers
Background. We conducted a validation study of digital pathology for the quantitative assessment of tissue-based biomarkers with immunohistochemistry. Objective. To examine observer agreement as a function of viewing modality (digital versus optical microscopy), whole slide versus tissue microarray...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wiley
2014-01-01
|
| Series: | Analytical Cellular Pathology |
| Online Access: | http://dx.doi.org/10.1155/2014/157308 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832550819973562368 |
|---|---|
| author | Marios A. Gavrielides Catherine Conway Neil O’Flaherty Brandon D. Gallas Stephen M. Hewitt |
| author_facet | Marios A. Gavrielides Catherine Conway Neil O’Flaherty Brandon D. Gallas Stephen M. Hewitt |
| author_sort | Marios A. Gavrielides |
| collection | DOAJ |
| description | Background. We conducted a validation study of digital pathology for the quantitative assessment of tissue-based biomarkers with immunohistochemistry. Objective. To examine observer agreement as a function of viewing modality (digital versus optical microscopy), whole slide versus tissue microarray (TMA) review, biomarker type (HER2 incorporating membranous staining and Ki-67 with nuclear staining), and data type (continuous and categorical). Methods. Eight pathologists reviewed 50 breast cancer whole slides (25 stained with HER2 and 25 with Ki-67) and 2 TMAs (1 stained with HER2, 1 with Ki-67, each containing 97 cores), using digital and optical microscopy. Results. Results showed relatively high overall interobserver and intermodality agreement, with different patterns specific to biomarker type. For HER2, there was better interobserver agreement for optical compared to digital microscopy for whole slides as well as better interobserver and intermodality agreement for TMAs. For Ki-67, those patterns were not observed. Conclusions. The differences in agreement patterns when examining different biomarkers and different scoring methods and reviewing whole slides compared to TMA stress the need for validation studies focused on specific pathology tasks to eliminate sources of variability that might dilute findings. The statistical uncertainty observed in our analyses calls for adequate sampling for each individual task rather than pooling cases. |
| format | Article |
| id | doaj-art-27e052b017a342adb16571518d840cb6 |
| institution | Kabale University |
| issn | 2210-7177 2210-7185 |
| language | English |
| publishDate | 2014-01-01 |
| publisher | Wiley |
| record_format | Article |
| series | Analytical Cellular Pathology |
| spelling | doaj-art-27e052b017a342adb16571518d840cb62025-02-03T06:05:38ZengWileyAnalytical Cellular Pathology2210-71772210-71852014-01-01201410.1155/2014/157308157308Observer Performance in the Use of Digital and Optical Microscopy for the Interpretation of Tissue-Based BiomarkersMarios A. Gavrielides0Catherine Conway1Neil O’Flaherty2Brandon D. Gallas3Stephen M. Hewitt4Division of Imaging, Diagnostics, and Software Reliability, Office of Science and Engineering Laboratories, Center for Devices and Radiological Health, U.S. Food and Drug Administration, Silver Spring, MD 20993, USALaboratory of Pathology, Center for Cancer Research, National Cancer Institute, National Institutes of Health, Bethesda, MD 20892, USADivision of Imaging, Diagnostics, and Software Reliability, Office of Science and Engineering Laboratories, Center for Devices and Radiological Health, U.S. Food and Drug Administration, Silver Spring, MD 20993, USADivision of Imaging, Diagnostics, and Software Reliability, Office of Science and Engineering Laboratories, Center for Devices and Radiological Health, U.S. Food and Drug Administration, Silver Spring, MD 20993, USALaboratory of Pathology, Center for Cancer Research, National Cancer Institute, National Institutes of Health, Bethesda, MD 20892, USABackground. We conducted a validation study of digital pathology for the quantitative assessment of tissue-based biomarkers with immunohistochemistry. Objective. To examine observer agreement as a function of viewing modality (digital versus optical microscopy), whole slide versus tissue microarray (TMA) review, biomarker type (HER2 incorporating membranous staining and Ki-67 with nuclear staining), and data type (continuous and categorical). Methods. Eight pathologists reviewed 50 breast cancer whole slides (25 stained with HER2 and 25 with Ki-67) and 2 TMAs (1 stained with HER2, 1 with Ki-67, each containing 97 cores), using digital and optical microscopy. Results. Results showed relatively high overall interobserver and intermodality agreement, with different patterns specific to biomarker type. For HER2, there was better interobserver agreement for optical compared to digital microscopy for whole slides as well as better interobserver and intermodality agreement for TMAs. For Ki-67, those patterns were not observed. Conclusions. The differences in agreement patterns when examining different biomarkers and different scoring methods and reviewing whole slides compared to TMA stress the need for validation studies focused on specific pathology tasks to eliminate sources of variability that might dilute findings. The statistical uncertainty observed in our analyses calls for adequate sampling for each individual task rather than pooling cases.http://dx.doi.org/10.1155/2014/157308 |
| spellingShingle | Marios A. Gavrielides Catherine Conway Neil O’Flaherty Brandon D. Gallas Stephen M. Hewitt Observer Performance in the Use of Digital and Optical Microscopy for the Interpretation of Tissue-Based Biomarkers Analytical Cellular Pathology |
| title | Observer Performance in the Use of Digital and Optical Microscopy for the Interpretation of Tissue-Based Biomarkers |
| title_full | Observer Performance in the Use of Digital and Optical Microscopy for the Interpretation of Tissue-Based Biomarkers |
| title_fullStr | Observer Performance in the Use of Digital and Optical Microscopy for the Interpretation of Tissue-Based Biomarkers |
| title_full_unstemmed | Observer Performance in the Use of Digital and Optical Microscopy for the Interpretation of Tissue-Based Biomarkers |
| title_short | Observer Performance in the Use of Digital and Optical Microscopy for the Interpretation of Tissue-Based Biomarkers |
| title_sort | observer performance in the use of digital and optical microscopy for the interpretation of tissue based biomarkers |
| url | http://dx.doi.org/10.1155/2014/157308 |
| work_keys_str_mv | AT mariosagavrielides observerperformanceintheuseofdigitalandopticalmicroscopyfortheinterpretationoftissuebasedbiomarkers AT catherineconway observerperformanceintheuseofdigitalandopticalmicroscopyfortheinterpretationoftissuebasedbiomarkers AT neiloflaherty observerperformanceintheuseofdigitalandopticalmicroscopyfortheinterpretationoftissuebasedbiomarkers AT brandondgallas observerperformanceintheuseofdigitalandopticalmicroscopyfortheinterpretationoftissuebasedbiomarkers AT stephenmhewitt observerperformanceintheuseofdigitalandopticalmicroscopyfortheinterpretationoftissuebasedbiomarkers |