Smart neural network and cognitive computing process for multi task nuclei detection segmentation and classification in breast cancer histopathology images

Abstract The detection, segmentation, and differentiation of benign and malignant nuclei from the histopathology images is a challenging task for the early diagnosis of breast cancer. Misinterpretation of True Negative (TN) and False Positive (FP) can generate incorrect results. The proposed Cogniti...

Full description

Saved in:
Bibliographic Details
Main Authors: M. Suriya Begum, S. Kalaivani
Format: Article
Language:English
Published: Nature Portfolio 2025-05-01
Series:Scientific Reports
Subjects:
Online Access:https://doi.org/10.1038/s41598-025-02575-x
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1850231304385200128
author M. Suriya Begum
S. Kalaivani
author_facet M. Suriya Begum
S. Kalaivani
author_sort M. Suriya Begum
collection DOAJ
description Abstract The detection, segmentation, and differentiation of benign and malignant nuclei from the histopathology images is a challenging task for the early diagnosis of breast cancer. Misinterpretation of True Negative (TN) and False Positive (FP) can generate incorrect results. The proposed Cognitive Computing Process (CCP) detects and segments the nuclei using Deep U-Net with Spatial Attention Mechanisms (SAM) and microns-per-pixel measurements to accurately locate and assess nuclei density. To separate the nuclei of benign and malignant, the patches are introduced to leverage the model’s learning process. The proposed Smart Neural Network (SNN) models contain Smart Convolutional Neural Network (SCNN) and Deep Convolutional Neural Network (DCNN) to reduce incorrect results. Proposed CCP and SNN were evaluated using the BreakHis dataset, which contains 5547 images of benign and malignant samples at various magnifications (40×, 100×, 200×, 400×). These images were processed into patches, totaling 11,642, 9282, 9102, and 9678 patches, each 224 × 224 pixels. The CCP model outperformed state-of-the-art models UNet, Residual UNet (ResUNet), and Convolutional Neural Network Long Short-Term Memory (CNN-LSTM) with a Dice coefficient of 99.90%, an F1-score of 99.04%, a precision of 99.80%, and a recall of 99.76%. The learning process began with a learning rate of 0.01 and a decay rate of 0.8, and the SCNN achieved false negative and false positive rates of 0.04 and 0.05 for low-density nuclei at 400× and 40× magnification, respectively. In contrast, the Deep Convolutional Neural Network (DCNN) recorded rates of 0.02 and 0.01. For high-density patches, the SCNN model FN and FP rates of 0.0 and 0.08, while the DCNN reported 0.09 and 0.0. The proposed learning process with Smart Neural Networks (SNN) achieved high precision (77–99%), recall (75–99%), F1-score (75–99%), and an AUC of 86–100%. The combination of CCP and SNN improved accuracy over existing CNN models like ResNet50, VGG19, DenseNet109, DenseNet201, and VGG16. An ablation study showed a p-value of 0.00003 based on the AUC, highlighting the model’s potential to enhance automated breast cancer diagnosis and support clinical decision-making.
format Article
id doaj-art-2a080557a98e48388546b5200e5b4801
institution OA Journals
issn 2045-2322
language English
publishDate 2025-05-01
publisher Nature Portfolio
record_format Article
series Scientific Reports
spelling doaj-art-2a080557a98e48388546b5200e5b48012025-08-20T02:03:35ZengNature PortfolioScientific Reports2045-23222025-05-0115113010.1038/s41598-025-02575-xSmart neural network and cognitive computing process for multi task nuclei detection segmentation and classification in breast cancer histopathology imagesM. Suriya Begum0S. Kalaivani1School of Computer Science Engineering and Information Systems, VITSchool of Computer Science Engineering and Information Systems, VITAbstract The detection, segmentation, and differentiation of benign and malignant nuclei from the histopathology images is a challenging task for the early diagnosis of breast cancer. Misinterpretation of True Negative (TN) and False Positive (FP) can generate incorrect results. The proposed Cognitive Computing Process (CCP) detects and segments the nuclei using Deep U-Net with Spatial Attention Mechanisms (SAM) and microns-per-pixel measurements to accurately locate and assess nuclei density. To separate the nuclei of benign and malignant, the patches are introduced to leverage the model’s learning process. The proposed Smart Neural Network (SNN) models contain Smart Convolutional Neural Network (SCNN) and Deep Convolutional Neural Network (DCNN) to reduce incorrect results. Proposed CCP and SNN were evaluated using the BreakHis dataset, which contains 5547 images of benign and malignant samples at various magnifications (40×, 100×, 200×, 400×). These images were processed into patches, totaling 11,642, 9282, 9102, and 9678 patches, each 224 × 224 pixels. The CCP model outperformed state-of-the-art models UNet, Residual UNet (ResUNet), and Convolutional Neural Network Long Short-Term Memory (CNN-LSTM) with a Dice coefficient of 99.90%, an F1-score of 99.04%, a precision of 99.80%, and a recall of 99.76%. The learning process began with a learning rate of 0.01 and a decay rate of 0.8, and the SCNN achieved false negative and false positive rates of 0.04 and 0.05 for low-density nuclei at 400× and 40× magnification, respectively. In contrast, the Deep Convolutional Neural Network (DCNN) recorded rates of 0.02 and 0.01. For high-density patches, the SCNN model FN and FP rates of 0.0 and 0.08, while the DCNN reported 0.09 and 0.0. The proposed learning process with Smart Neural Networks (SNN) achieved high precision (77–99%), recall (75–99%), F1-score (75–99%), and an AUC of 86–100%. The combination of CCP and SNN improved accuracy over existing CNN models like ResNet50, VGG19, DenseNet109, DenseNet201, and VGG16. An ablation study showed a p-value of 0.00003 based on the AUC, highlighting the model’s potential to enhance automated breast cancer diagnosis and support clinical decision-making.https://doi.org/10.1038/s41598-025-02575-xHistopathology imagesNuclei segmentationDeep learningTransfer learningBreast cancerClassification model
spellingShingle M. Suriya Begum
S. Kalaivani
Smart neural network and cognitive computing process for multi task nuclei detection segmentation and classification in breast cancer histopathology images
Scientific Reports
Histopathology images
Nuclei segmentation
Deep learning
Transfer learning
Breast cancer
Classification model
title Smart neural network and cognitive computing process for multi task nuclei detection segmentation and classification in breast cancer histopathology images
title_full Smart neural network and cognitive computing process for multi task nuclei detection segmentation and classification in breast cancer histopathology images
title_fullStr Smart neural network and cognitive computing process for multi task nuclei detection segmentation and classification in breast cancer histopathology images
title_full_unstemmed Smart neural network and cognitive computing process for multi task nuclei detection segmentation and classification in breast cancer histopathology images
title_short Smart neural network and cognitive computing process for multi task nuclei detection segmentation and classification in breast cancer histopathology images
title_sort smart neural network and cognitive computing process for multi task nuclei detection segmentation and classification in breast cancer histopathology images
topic Histopathology images
Nuclei segmentation
Deep learning
Transfer learning
Breast cancer
Classification model
url https://doi.org/10.1038/s41598-025-02575-x
work_keys_str_mv AT msuriyabegum smartneuralnetworkandcognitivecomputingprocessformultitasknucleidetectionsegmentationandclassificationinbreastcancerhistopathologyimages
AT skalaivani smartneuralnetworkandcognitivecomputingprocessformultitasknucleidetectionsegmentationandclassificationinbreastcancerhistopathologyimages