Classifying tumour infiltrating lymphocytes in oral squamous cell carcinoma histopathology using joint learning framework

Abstract Oral squamous cell carcinoma (OSCC) is the most common form of oral cancer, with increasing global incidence and have poor prognosis. Tumour-infiltrating lymphocytes (TILs) are recognized as a key prognostic indicator and play a vital role in OSCC grading. However, current methods for TILs...

Full description

Saved in:
Bibliographic Details
Main Authors: Barun Barua, Genevieve Chyrmang, Kangkana Bora, Gazi N. Ahmed, Lopamudra Kakoti, Manob Jyoti Saikia
Format: Article
Language:English
Published: Nature Portfolio 2025-01-01
Series:Scientific Reports
Online Access:https://doi.org/10.1038/s41598-025-86527-5
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832585718353887232
author Barun Barua
Genevieve Chyrmang
Kangkana Bora
Gazi N. Ahmed
Lopamudra Kakoti
Manob Jyoti Saikia
author_facet Barun Barua
Genevieve Chyrmang
Kangkana Bora
Gazi N. Ahmed
Lopamudra Kakoti
Manob Jyoti Saikia
author_sort Barun Barua
collection DOAJ
description Abstract Oral squamous cell carcinoma (OSCC) is the most common form of oral cancer, with increasing global incidence and have poor prognosis. Tumour-infiltrating lymphocytes (TILs) are recognized as a key prognostic indicator and play a vital role in OSCC grading. However, current methods for TILs quantification are based on subjective visual assessments, leading to inter-observer variability and inconsistent diagnostic reproducibility. Only a few studies have been conducted in automating TILs quantification for OSCC, existing methods use score-based systems that focus only on tissue-level spatial analysis, overlooking essential cellular-level information and do not provide TILs infiltration subcategories required for determining OSCC grading. To address these limitations, we propose OralTILs-ViT, a novel joint representation learning framework that integrates cellular and tissue-level information. Our model employs two parallel encoders: one extracts cellular features from cellular density maps, while the other processes tissue features from H&E-stained tissue images. This dual-encoder approach enables OralTILs-ViT to capture complex tissue-cellular interactions, classifying TILs infiltration categories consistent with Broders’ grading system-“Moderate to Marked”, “Slight” and “None to Very Less.” This approach reflects pathology practices and increases TILs classification accuracy. To generate cellular density maps, we introduce TILSeg-MobileViT, a multiclass segmentation model trained using a weakly supervised method, minimizing the need for manual annotation of cellular masks and overcoming the limitations of previous TILs assessment techniques. An extensive evaluation of our methodology demonstrates that OralTILs-ViT with the configuration (Adam, $$\alpha$$ α = 0.001) outperforms existing approaches, achieving 96.37% accuracy, 96.34% precision, 96.37% recall, and a 96.35% F1 score. Furthermore, TOPSIS analysis confirms that our method ranks first across all TILs infiltration categories. In summary, our proposed methodology outperforms single modality-representation learning approaches for accurate and automated TILs classification.
format Article
id doaj-art-77878f0c775d42458828e034f17490c4
institution Kabale University
issn 2045-2322
language English
publishDate 2025-01-01
publisher Nature Portfolio
record_format Article
series Scientific Reports
spelling doaj-art-77878f0c775d42458828e034f17490c42025-01-26T12:33:10ZengNature PortfolioScientific Reports2045-23222025-01-0115112010.1038/s41598-025-86527-5Classifying tumour infiltrating lymphocytes in oral squamous cell carcinoma histopathology using joint learning frameworkBarun Barua0Genevieve Chyrmang1Kangkana Bora2Gazi N. Ahmed3Lopamudra Kakoti4Manob Jyoti Saikia5Department of Computer Science and IT, Cotton UniversityDepartment of Computer Science and IT, Cotton UniversityDepartment of Computer Science and IT, Cotton UniversityNorth East Cancer Hospital and Research InstituteDr. B Borooah Cancer InstituteElectrical and Computer Engineering Department, University of MemphisAbstract Oral squamous cell carcinoma (OSCC) is the most common form of oral cancer, with increasing global incidence and have poor prognosis. Tumour-infiltrating lymphocytes (TILs) are recognized as a key prognostic indicator and play a vital role in OSCC grading. However, current methods for TILs quantification are based on subjective visual assessments, leading to inter-observer variability and inconsistent diagnostic reproducibility. Only a few studies have been conducted in automating TILs quantification for OSCC, existing methods use score-based systems that focus only on tissue-level spatial analysis, overlooking essential cellular-level information and do not provide TILs infiltration subcategories required for determining OSCC grading. To address these limitations, we propose OralTILs-ViT, a novel joint representation learning framework that integrates cellular and tissue-level information. Our model employs two parallel encoders: one extracts cellular features from cellular density maps, while the other processes tissue features from H&E-stained tissue images. This dual-encoder approach enables OralTILs-ViT to capture complex tissue-cellular interactions, classifying TILs infiltration categories consistent with Broders’ grading system-“Moderate to Marked”, “Slight” and “None to Very Less.” This approach reflects pathology practices and increases TILs classification accuracy. To generate cellular density maps, we introduce TILSeg-MobileViT, a multiclass segmentation model trained using a weakly supervised method, minimizing the need for manual annotation of cellular masks and overcoming the limitations of previous TILs assessment techniques. An extensive evaluation of our methodology demonstrates that OralTILs-ViT with the configuration (Adam, $$\alpha$$ α = 0.001) outperforms existing approaches, achieving 96.37% accuracy, 96.34% precision, 96.37% recall, and a 96.35% F1 score. Furthermore, TOPSIS analysis confirms that our method ranks first across all TILs infiltration categories. In summary, our proposed methodology outperforms single modality-representation learning approaches for accurate and automated TILs classification.https://doi.org/10.1038/s41598-025-86527-5
spellingShingle Barun Barua
Genevieve Chyrmang
Kangkana Bora
Gazi N. Ahmed
Lopamudra Kakoti
Manob Jyoti Saikia
Classifying tumour infiltrating lymphocytes in oral squamous cell carcinoma histopathology using joint learning framework
Scientific Reports
title Classifying tumour infiltrating lymphocytes in oral squamous cell carcinoma histopathology using joint learning framework
title_full Classifying tumour infiltrating lymphocytes in oral squamous cell carcinoma histopathology using joint learning framework
title_fullStr Classifying tumour infiltrating lymphocytes in oral squamous cell carcinoma histopathology using joint learning framework
title_full_unstemmed Classifying tumour infiltrating lymphocytes in oral squamous cell carcinoma histopathology using joint learning framework
title_short Classifying tumour infiltrating lymphocytes in oral squamous cell carcinoma histopathology using joint learning framework
title_sort classifying tumour infiltrating lymphocytes in oral squamous cell carcinoma histopathology using joint learning framework
url https://doi.org/10.1038/s41598-025-86527-5
work_keys_str_mv AT barunbarua classifyingtumourinfiltratinglymphocytesinoralsquamouscellcarcinomahistopathologyusingjointlearningframework
AT genevievechyrmang classifyingtumourinfiltratinglymphocytesinoralsquamouscellcarcinomahistopathologyusingjointlearningframework
AT kangkanabora classifyingtumourinfiltratinglymphocytesinoralsquamouscellcarcinomahistopathologyusingjointlearningframework
AT gazinahmed classifyingtumourinfiltratinglymphocytesinoralsquamouscellcarcinomahistopathologyusingjointlearningframework
AT lopamudrakakoti classifyingtumourinfiltratinglymphocytesinoralsquamouscellcarcinomahistopathologyusingjointlearningframework
AT manobjyotisaikia classifyingtumourinfiltratinglymphocytesinoralsquamouscellcarcinomahistopathologyusingjointlearningframework