An Application of 3D Vision Transformers and Explainable AI in Prosthetic Dentistry
ABSTRACT To create and validate a transformer‐based deep neural network architecture for classifying 3D scans of teeth for computer‐assisted manufacturing and dental prosthetic rehabilitation surpassing previously reported validation accuracies obtained with convolutional neural networks (CNNs). Vox...
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wiley
2024-12-01
|
| Series: | Applied AI Letters |
| Subjects: | |
| Online Access: | https://doi.org/10.1002/ail2.101 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850246789995692032 |
|---|---|
| author | Faisal Ahmed Sifat Md Sahadul Hasan Arian Saif Ahmed Taseef Hasan Farook Nabeel Mohammed James Dudley |
| author_facet | Faisal Ahmed Sifat Md Sahadul Hasan Arian Saif Ahmed Taseef Hasan Farook Nabeel Mohammed James Dudley |
| author_sort | Faisal Ahmed Sifat |
| collection | DOAJ |
| description | ABSTRACT To create and validate a transformer‐based deep neural network architecture for classifying 3D scans of teeth for computer‐assisted manufacturing and dental prosthetic rehabilitation surpassing previously reported validation accuracies obtained with convolutional neural networks (CNNs). Voxel‐based representation and encoding input data in a high‐dimensional space forms of preprocessing were investigated using 34 3D models of teeth obtained from intraoral scanning. Independent CNNs and vision transformers (ViTs), and their combination (CNN and ViT hybrid model) were implemented to classify the 3D scans directly from standard tessellation language (.stl) files and an Explainable AI (ExAI) model was generated to qualitatively explore the deterministic patterns that influenced the outcomes of the automation process. The results demonstrate that the CNN and ViT hybrid model architecture surpasses conventional supervised CNN, achieving a consistent validation accuracy of 90% through three‐fold cross‐validation. This process validated our initial findings, where each instance had the opportunity to be part of the validation set, ensuring it remained unseen during training. Furthermore, employing high‐dimensional encoding of input data solely with 3DCNN yields a validation accuracy of 80%. When voxel data preprocessing is utilized, ViT outperforms CNN, achieving validation accuracies of 80% and 50%, respectively. The study also highlighted the saliency map's ability to identify areas of tooth cavity preparation of restorative importance, that can theoretically enable more accurate 3D printed prosthetic outputs. The investigation introduced a CNN and ViT hybrid model for classification of 3D tooth models in digital dentistry, and it was the first to employ ExAI in the efforts to automate the process of dental computer‐assisted manufacturing. |
| format | Article |
| id | doaj-art-685467aed7bd483dade483f0403f96ba |
| institution | OA Journals |
| issn | 2689-5595 |
| language | English |
| publishDate | 2024-12-01 |
| publisher | Wiley |
| record_format | Article |
| series | Applied AI Letters |
| spelling | doaj-art-685467aed7bd483dade483f0403f96ba2025-08-20T01:59:05ZengWileyApplied AI Letters2689-55952024-12-0154n/an/a10.1002/ail2.101An Application of 3D Vision Transformers and Explainable AI in Prosthetic DentistryFaisal Ahmed Sifat0Md Sahadul Hasan Arian1Saif Ahmed2Taseef Hasan Farook3Nabeel Mohammed4James Dudley5Department of Electrical and Computer Engineering North South University Dhaka BangladeshDepartment of Electrical and Computer Engineering North South University Dhaka BangladeshDepartment of Electrical and Computer Engineering North South University Dhaka BangladeshAdelaide Dental School The University of Adelaide Adelaide South Australia AustraliaDepartment of Electrical and Computer Engineering North South University Dhaka BangladeshAdelaide Dental School The University of Adelaide Adelaide South Australia AustraliaABSTRACT To create and validate a transformer‐based deep neural network architecture for classifying 3D scans of teeth for computer‐assisted manufacturing and dental prosthetic rehabilitation surpassing previously reported validation accuracies obtained with convolutional neural networks (CNNs). Voxel‐based representation and encoding input data in a high‐dimensional space forms of preprocessing were investigated using 34 3D models of teeth obtained from intraoral scanning. Independent CNNs and vision transformers (ViTs), and their combination (CNN and ViT hybrid model) were implemented to classify the 3D scans directly from standard tessellation language (.stl) files and an Explainable AI (ExAI) model was generated to qualitatively explore the deterministic patterns that influenced the outcomes of the automation process. The results demonstrate that the CNN and ViT hybrid model architecture surpasses conventional supervised CNN, achieving a consistent validation accuracy of 90% through three‐fold cross‐validation. This process validated our initial findings, where each instance had the opportunity to be part of the validation set, ensuring it remained unseen during training. Furthermore, employing high‐dimensional encoding of input data solely with 3DCNN yields a validation accuracy of 80%. When voxel data preprocessing is utilized, ViT outperforms CNN, achieving validation accuracies of 80% and 50%, respectively. The study also highlighted the saliency map's ability to identify areas of tooth cavity preparation of restorative importance, that can theoretically enable more accurate 3D printed prosthetic outputs. The investigation introduced a CNN and ViT hybrid model for classification of 3D tooth models in digital dentistry, and it was the first to employ ExAI in the efforts to automate the process of dental computer‐assisted manufacturing.https://doi.org/10.1002/ail2.101artificial intelligencedigital dentistryintraoral scanningprosthesesrapid prototyping |
| spellingShingle | Faisal Ahmed Sifat Md Sahadul Hasan Arian Saif Ahmed Taseef Hasan Farook Nabeel Mohammed James Dudley An Application of 3D Vision Transformers and Explainable AI in Prosthetic Dentistry Applied AI Letters artificial intelligence digital dentistry intraoral scanning prostheses rapid prototyping |
| title | An Application of 3D Vision Transformers and Explainable AI in Prosthetic Dentistry |
| title_full | An Application of 3D Vision Transformers and Explainable AI in Prosthetic Dentistry |
| title_fullStr | An Application of 3D Vision Transformers and Explainable AI in Prosthetic Dentistry |
| title_full_unstemmed | An Application of 3D Vision Transformers and Explainable AI in Prosthetic Dentistry |
| title_short | An Application of 3D Vision Transformers and Explainable AI in Prosthetic Dentistry |
| title_sort | application of 3d vision transformers and explainable ai in prosthetic dentistry |
| topic | artificial intelligence digital dentistry intraoral scanning prostheses rapid prototyping |
| url | https://doi.org/10.1002/ail2.101 |
| work_keys_str_mv | AT faisalahmedsifat anapplicationof3dvisiontransformersandexplainableaiinprostheticdentistry AT mdsahadulhasanarian anapplicationof3dvisiontransformersandexplainableaiinprostheticdentistry AT saifahmed anapplicationof3dvisiontransformersandexplainableaiinprostheticdentistry AT taseefhasanfarook anapplicationof3dvisiontransformersandexplainableaiinprostheticdentistry AT nabeelmohammed anapplicationof3dvisiontransformersandexplainableaiinprostheticdentistry AT jamesdudley anapplicationof3dvisiontransformersandexplainableaiinprostheticdentistry AT faisalahmedsifat applicationof3dvisiontransformersandexplainableaiinprostheticdentistry AT mdsahadulhasanarian applicationof3dvisiontransformersandexplainableaiinprostheticdentistry AT saifahmed applicationof3dvisiontransformersandexplainableaiinprostheticdentistry AT taseefhasanfarook applicationof3dvisiontransformersandexplainableaiinprostheticdentistry AT nabeelmohammed applicationof3dvisiontransformersandexplainableaiinprostheticdentistry AT jamesdudley applicationof3dvisiontransformersandexplainableaiinprostheticdentistry |