Analytical validation of the Percepta Nasal Swab classifier; an RNA next-generation sequencing assay for the assessment of lung cancer risk in pulmonary nodules

Abstract Background A novel molecular diagnostic test, Percepta Nasal Swab (PNS), was developed as a noninvasive lung cancer biomarker to aid in risk assessment for indeterminate pulmonary nodules in individuals who smoke or have previously smoked. Prior research has shown that exposure of the airwa...

Full description

Saved in:
Bibliographic Details
Main Authors: Shuyang Wu, Ruochen Jiang, Grazyna Fedorowicz, Mei Wong, Janna S. Chamberlin, Lori Lofaro, P. Sean Walsh, Giulia C. Kennedy, Yangyang Hao, Jing Huang, Bill Bulman
Format: Article
Language:English
Published: BMC 2025-03-01
Series:BMC Cancer
Subjects:
Online Access:https://doi.org/10.1186/s12885-025-13683-2
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1849734834427002880
author Shuyang Wu
Ruochen Jiang
Grazyna Fedorowicz
Mei Wong
Janna S. Chamberlin
Lori Lofaro
P. Sean Walsh
Giulia C. Kennedy
Yangyang Hao
Jing Huang
Bill Bulman
author_facet Shuyang Wu
Ruochen Jiang
Grazyna Fedorowicz
Mei Wong
Janna S. Chamberlin
Lori Lofaro
P. Sean Walsh
Giulia C. Kennedy
Yangyang Hao
Jing Huang
Bill Bulman
author_sort Shuyang Wu
collection DOAJ
description Abstract Background A novel molecular diagnostic test, Percepta Nasal Swab (PNS), was developed as a noninvasive lung cancer biomarker to aid in risk assessment for indeterminate pulmonary nodules in individuals who smoke or have previously smoked. Prior research has shown that exposure of the airway epithelium to cigarette smoke results in epithelial gene expression alterations throughout the respiratory tree that reflect the risk of lung cancer in a pulmonary nodule. The PNS classifier leverages this concept using whole transcriptome sequencing (RNASeq) of cells collected from the nasal epithelium and provides “high”, “intermediate” and “low risk” classification calls to help guide clinical management decisions. The clinical validity of the PNS test was established on an independent validation set and demonstrated favorable sensitivity and specificity. This study aims to evaluate the analytical validity of the PNS test performance in our CLIA (Clinical Laboratory Improvement Amendments) laboratory. Methods The reproducibility between RNASeq runs within a laboratory and the accuracy between laboratories were estimated and compared against the performance-based acceptance criterion. The impacts from varying RNA input amount, genomic DNA and blood RNA interference were evaluated to demonstrate the analytical sensitivity and specificity of the PNS test results to known conditions that may occur in routine laboratory processing. Results Based on modeling the impact on clinical sensitivity/specificity, PNS test classifier scores can allow up to 0.776 score units of added noise/variability before any performance metrics drop below the pre-specified requirements. This allowable variability is six-fold higher than the observed variability estimated between runs and between laboratories under routine testing conditions, which are each less than 2% of the 98th percentile score range. In addition, PNS test results are shown to be robust against RNA input variation from 50 ng to 15 ng, up to 30% of genomic DNA by nucleic mass interference, and up to 14% of blood RNA interference. Conclusions This study provided sufficient evidence for the accuracy, reproducibility, sensitivity, and specificity of the PNS molecular test and supported its utilization in clinical testing.
format Article
id doaj-art-e45d2e542b124446bc2e7e646f1b7ce4
institution DOAJ
issn 1471-2407
language English
publishDate 2025-03-01
publisher BMC
record_format Article
series BMC Cancer
spelling doaj-art-e45d2e542b124446bc2e7e646f1b7ce42025-08-20T03:07:41ZengBMCBMC Cancer1471-24072025-03-0125111010.1186/s12885-025-13683-2Analytical validation of the Percepta Nasal Swab classifier; an RNA next-generation sequencing assay for the assessment of lung cancer risk in pulmonary nodulesShuyang Wu0Ruochen Jiang1Grazyna Fedorowicz2Mei Wong3Janna S. Chamberlin4Lori Lofaro5P. Sean Walsh6Giulia C. Kennedy7Yangyang Hao8Jing Huang9Bill Bulman10Veracyte, Inc.Veracyte, Inc.Veracyte, Inc.Veracyte, Inc.Veracyte, Inc.Veracyte, Inc.Veracyte, Inc.Veracyte, Inc.Veracyte, Inc.Veracyte, Inc.Veracyte, Inc.Abstract Background A novel molecular diagnostic test, Percepta Nasal Swab (PNS), was developed as a noninvasive lung cancer biomarker to aid in risk assessment for indeterminate pulmonary nodules in individuals who smoke or have previously smoked. Prior research has shown that exposure of the airway epithelium to cigarette smoke results in epithelial gene expression alterations throughout the respiratory tree that reflect the risk of lung cancer in a pulmonary nodule. The PNS classifier leverages this concept using whole transcriptome sequencing (RNASeq) of cells collected from the nasal epithelium and provides “high”, “intermediate” and “low risk” classification calls to help guide clinical management decisions. The clinical validity of the PNS test was established on an independent validation set and demonstrated favorable sensitivity and specificity. This study aims to evaluate the analytical validity of the PNS test performance in our CLIA (Clinical Laboratory Improvement Amendments) laboratory. Methods The reproducibility between RNASeq runs within a laboratory and the accuracy between laboratories were estimated and compared against the performance-based acceptance criterion. The impacts from varying RNA input amount, genomic DNA and blood RNA interference were evaluated to demonstrate the analytical sensitivity and specificity of the PNS test results to known conditions that may occur in routine laboratory processing. Results Based on modeling the impact on clinical sensitivity/specificity, PNS test classifier scores can allow up to 0.776 score units of added noise/variability before any performance metrics drop below the pre-specified requirements. This allowable variability is six-fold higher than the observed variability estimated between runs and between laboratories under routine testing conditions, which are each less than 2% of the 98th percentile score range. In addition, PNS test results are shown to be robust against RNA input variation from 50 ng to 15 ng, up to 30% of genomic DNA by nucleic mass interference, and up to 14% of blood RNA interference. Conclusions This study provided sufficient evidence for the accuracy, reproducibility, sensitivity, and specificity of the PNS molecular test and supported its utilization in clinical testing.https://doi.org/10.1186/s12885-025-13683-2Nasal Swab classifierAnalytical validationMolecular diagnostic testLung cancer riskPulmonary nodulesGenomics
spellingShingle Shuyang Wu
Ruochen Jiang
Grazyna Fedorowicz
Mei Wong
Janna S. Chamberlin
Lori Lofaro
P. Sean Walsh
Giulia C. Kennedy
Yangyang Hao
Jing Huang
Bill Bulman
Analytical validation of the Percepta Nasal Swab classifier; an RNA next-generation sequencing assay for the assessment of lung cancer risk in pulmonary nodules
BMC Cancer
Nasal Swab classifier
Analytical validation
Molecular diagnostic test
Lung cancer risk
Pulmonary nodules
Genomics
title Analytical validation of the Percepta Nasal Swab classifier; an RNA next-generation sequencing assay for the assessment of lung cancer risk in pulmonary nodules
title_full Analytical validation of the Percepta Nasal Swab classifier; an RNA next-generation sequencing assay for the assessment of lung cancer risk in pulmonary nodules
title_fullStr Analytical validation of the Percepta Nasal Swab classifier; an RNA next-generation sequencing assay for the assessment of lung cancer risk in pulmonary nodules
title_full_unstemmed Analytical validation of the Percepta Nasal Swab classifier; an RNA next-generation sequencing assay for the assessment of lung cancer risk in pulmonary nodules
title_short Analytical validation of the Percepta Nasal Swab classifier; an RNA next-generation sequencing assay for the assessment of lung cancer risk in pulmonary nodules
title_sort analytical validation of the percepta nasal swab classifier an rna next generation sequencing assay for the assessment of lung cancer risk in pulmonary nodules
topic Nasal Swab classifier
Analytical validation
Molecular diagnostic test
Lung cancer risk
Pulmonary nodules
Genomics
url https://doi.org/10.1186/s12885-025-13683-2
work_keys_str_mv AT shuyangwu analyticalvalidationoftheperceptanasalswabclassifieranrnanextgenerationsequencingassayfortheassessmentoflungcancerriskinpulmonarynodules
AT ruochenjiang analyticalvalidationoftheperceptanasalswabclassifieranrnanextgenerationsequencingassayfortheassessmentoflungcancerriskinpulmonarynodules
AT grazynafedorowicz analyticalvalidationoftheperceptanasalswabclassifieranrnanextgenerationsequencingassayfortheassessmentoflungcancerriskinpulmonarynodules
AT meiwong analyticalvalidationoftheperceptanasalswabclassifieranrnanextgenerationsequencingassayfortheassessmentoflungcancerriskinpulmonarynodules
AT jannaschamberlin analyticalvalidationoftheperceptanasalswabclassifieranrnanextgenerationsequencingassayfortheassessmentoflungcancerriskinpulmonarynodules
AT lorilofaro analyticalvalidationoftheperceptanasalswabclassifieranrnanextgenerationsequencingassayfortheassessmentoflungcancerriskinpulmonarynodules
AT pseanwalsh analyticalvalidationoftheperceptanasalswabclassifieranrnanextgenerationsequencingassayfortheassessmentoflungcancerriskinpulmonarynodules
AT giuliackennedy analyticalvalidationoftheperceptanasalswabclassifieranrnanextgenerationsequencingassayfortheassessmentoflungcancerriskinpulmonarynodules
AT yangyanghao analyticalvalidationoftheperceptanasalswabclassifieranrnanextgenerationsequencingassayfortheassessmentoflungcancerriskinpulmonarynodules
AT jinghuang analyticalvalidationoftheperceptanasalswabclassifieranrnanextgenerationsequencingassayfortheassessmentoflungcancerriskinpulmonarynodules
AT billbulman analyticalvalidationoftheperceptanasalswabclassifieranrnanextgenerationsequencingassayfortheassessmentoflungcancerriskinpulmonarynodules