Predicting Response to Neoadjuvant Chemotherapy with PET Imaging Using Convolutional Neural Networks.

Imaging of cancer with 18F-fluorodeoxyglucose positron emission tomography (18F-FDG PET) has become a standard component of diagnosis and staging in oncology, and is becoming more important as a quantitative monitor of individual response to therapy. In this article we investigate the challenging pr...

Full description

Saved in:
Bibliographic Details
Main Authors: Petros-Pavlos Ypsilantis, Musib Siddique, Hyon-Mok Sohn, Andrew Davies, Gary Cook, Vicky Goh, Giovanni Montana
Format: Article
Language:English
Published: Public Library of Science (PLoS) 2015-01-01
Series:PLoS ONE
Online Access:https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0137036&type=printable
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1849332356050059264
author Petros-Pavlos Ypsilantis
Musib Siddique
Hyon-Mok Sohn
Andrew Davies
Gary Cook
Vicky Goh
Giovanni Montana
author_facet Petros-Pavlos Ypsilantis
Musib Siddique
Hyon-Mok Sohn
Andrew Davies
Gary Cook
Vicky Goh
Giovanni Montana
author_sort Petros-Pavlos Ypsilantis
collection DOAJ
description Imaging of cancer with 18F-fluorodeoxyglucose positron emission tomography (18F-FDG PET) has become a standard component of diagnosis and staging in oncology, and is becoming more important as a quantitative monitor of individual response to therapy. In this article we investigate the challenging problem of predicting a patient's response to neoadjuvant chemotherapy from a single 18F-FDG PET scan taken prior to treatment. We take a "radiomics" approach whereby a large amount of quantitative features is automatically extracted from pretherapy PET images in order to build a comprehensive quantification of the tumor phenotype. While the dominant methodology relies on hand-crafted texture features, we explore the potential of automatically learning low- to high-level features directly from PET scans. We report on a study that compares the performance of two competing radiomics strategies: an approach based on state-of-the-art statistical classifiers using over 100 quantitative imaging descriptors, including texture features as well as standardized uptake values, and a convolutional neural network, 3S-CNN, trained directly from PET scans by taking sets of adjacent intra-tumor slices. Our experimental results, based on a sample of 107 patients with esophageal cancer, provide initial evidence that convolutional neural networks have the potential to extract PET imaging representations that are highly predictive of response to therapy. On this dataset, 3S-CNN achieves an average 80.7% sensitivity and 81.6% specificity in predicting non-responders, and outperforms other competing predictive models.
format Article
id doaj-art-2857ca773ffd49deb320efc871bd1b88
institution Kabale University
issn 1932-6203
language English
publishDate 2015-01-01
publisher Public Library of Science (PLoS)
record_format Article
series PLoS ONE
spelling doaj-art-2857ca773ffd49deb320efc871bd1b882025-08-20T03:46:13ZengPublic Library of Science (PLoS)PLoS ONE1932-62032015-01-01109e013703610.1371/journal.pone.0137036Predicting Response to Neoadjuvant Chemotherapy with PET Imaging Using Convolutional Neural Networks.Petros-Pavlos YpsilantisMusib SiddiqueHyon-Mok SohnAndrew DaviesGary CookVicky GohGiovanni MontanaImaging of cancer with 18F-fluorodeoxyglucose positron emission tomography (18F-FDG PET) has become a standard component of diagnosis and staging in oncology, and is becoming more important as a quantitative monitor of individual response to therapy. In this article we investigate the challenging problem of predicting a patient's response to neoadjuvant chemotherapy from a single 18F-FDG PET scan taken prior to treatment. We take a "radiomics" approach whereby a large amount of quantitative features is automatically extracted from pretherapy PET images in order to build a comprehensive quantification of the tumor phenotype. While the dominant methodology relies on hand-crafted texture features, we explore the potential of automatically learning low- to high-level features directly from PET scans. We report on a study that compares the performance of two competing radiomics strategies: an approach based on state-of-the-art statistical classifiers using over 100 quantitative imaging descriptors, including texture features as well as standardized uptake values, and a convolutional neural network, 3S-CNN, trained directly from PET scans by taking sets of adjacent intra-tumor slices. Our experimental results, based on a sample of 107 patients with esophageal cancer, provide initial evidence that convolutional neural networks have the potential to extract PET imaging representations that are highly predictive of response to therapy. On this dataset, 3S-CNN achieves an average 80.7% sensitivity and 81.6% specificity in predicting non-responders, and outperforms other competing predictive models.https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0137036&type=printable
spellingShingle Petros-Pavlos Ypsilantis
Musib Siddique
Hyon-Mok Sohn
Andrew Davies
Gary Cook
Vicky Goh
Giovanni Montana
Predicting Response to Neoadjuvant Chemotherapy with PET Imaging Using Convolutional Neural Networks.
PLoS ONE
title Predicting Response to Neoadjuvant Chemotherapy with PET Imaging Using Convolutional Neural Networks.
title_full Predicting Response to Neoadjuvant Chemotherapy with PET Imaging Using Convolutional Neural Networks.
title_fullStr Predicting Response to Neoadjuvant Chemotherapy with PET Imaging Using Convolutional Neural Networks.
title_full_unstemmed Predicting Response to Neoadjuvant Chemotherapy with PET Imaging Using Convolutional Neural Networks.
title_short Predicting Response to Neoadjuvant Chemotherapy with PET Imaging Using Convolutional Neural Networks.
title_sort predicting response to neoadjuvant chemotherapy with pet imaging using convolutional neural networks
url https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0137036&type=printable
work_keys_str_mv AT petrospavlosypsilantis predictingresponsetoneoadjuvantchemotherapywithpetimagingusingconvolutionalneuralnetworks
AT musibsiddique predictingresponsetoneoadjuvantchemotherapywithpetimagingusingconvolutionalneuralnetworks
AT hyonmoksohn predictingresponsetoneoadjuvantchemotherapywithpetimagingusingconvolutionalneuralnetworks
AT andrewdavies predictingresponsetoneoadjuvantchemotherapywithpetimagingusingconvolutionalneuralnetworks
AT garycook predictingresponsetoneoadjuvantchemotherapywithpetimagingusingconvolutionalneuralnetworks
AT vickygoh predictingresponsetoneoadjuvantchemotherapywithpetimagingusingconvolutionalneuralnetworks
AT giovannimontana predictingresponsetoneoadjuvantchemotherapywithpetimagingusingconvolutionalneuralnetworks