Assessing the Capabilities of Generative Pretrained Transformer-4 in Addressing Open-Ended Inquiries of Oral Cancer
Introduction and aims: In the face of escalating oral cancer rates, the application of large language models like Generative Pretrained Transformer (GPT)-4 presents a novel pathway for enhancing public awareness about prevention and early detection. This research aims to explore the capabilities and...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Elsevier
2025-02-01
|
| Series: | International Dental Journal |
| Subjects: | |
| Online Access: | http://www.sciencedirect.com/science/article/pii/S0020653924001941 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832592808497643520 |
|---|---|
| author | Kaiyuan Ji Jing Han Guangtao Zhai Jiannan Liu |
| author_facet | Kaiyuan Ji Jing Han Guangtao Zhai Jiannan Liu |
| author_sort | Kaiyuan Ji |
| collection | DOAJ |
| description | Introduction and aims: In the face of escalating oral cancer rates, the application of large language models like Generative Pretrained Transformer (GPT)-4 presents a novel pathway for enhancing public awareness about prevention and early detection. This research aims to explore the capabilities and possibilities of GPT-4 in addressing open-ended inquiries in the field of oral cancer. Methods: Using 60 questions accompanied by reference answers, covering concepts, causes, treatments, nutrition, and other aspects of oral cancer, evaluators from diverse backgrounds were selected to evaluate the capabilities of GPT-4 and a customized version. A P value under .05 was considered significant. Results: Analysis revealed that GPT-4 and its adaptations notably excelled in answering open-ended questions, with the majority of responses receiving high scores. Although the median score for standard GPT-4 was marginally better, statistical tests showed no significant difference in capabilities between the two models (P > .05). Despite statistical significance indicated diverse backgrounds of evaluators have statistically difference (P < .05), a post hoc test and comprehensive analysis demonstrated that both editions of GPT-4 demonstrated equivalent capabilities in answering questions concerning oral cancer. Conclusions: GPT-4 has demonstrated its capability to furnish responses to open-ended inquiries concerning oral cancer. Utilizing this advanced technology to boost public awareness about oral cancer is viable and has much potential. When it's unable to locate pertinent information, it will resort to their inherent knowledge base or recommend consulting professionals after offering some basic information. Therefore, it cannot supplant the expertise and clinical judgment of surgical oncologists and could be used as an adjunctive evaluation tool. |
| format | Article |
| id | doaj-art-a918a6cd36ce4b398ca060d570e3128d |
| institution | Kabale University |
| issn | 0020-6539 |
| language | English |
| publishDate | 2025-02-01 |
| publisher | Elsevier |
| record_format | Article |
| series | International Dental Journal |
| spelling | doaj-art-a918a6cd36ce4b398ca060d570e3128d2025-01-21T04:12:43ZengElsevierInternational Dental Journal0020-65392025-02-01751158165Assessing the Capabilities of Generative Pretrained Transformer-4 in Addressing Open-Ended Inquiries of Oral CancerKaiyuan Ji0Jing Han1Guangtao Zhai2Jiannan Liu3College of Information Science and Technology, Beijing University of Chemical Technology, Beijing, ChinaDepartment of Oral and Maxillofacial Head and Neck Oncology, Shanghai Ninth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, ChinaSchool of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University, Shanghai, China; Corresponding author. School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University, 800 Dongchuan Rd., Minhang District, Shanghai 200241, China.Department of Oral and Maxillofacial Head and Neck Oncology, Shanghai Ninth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China; Department of Oral and Maxillofacial Head and Neck Oncology, Shanghai Ninth People's Hospital, Shanghai Jiao Tong University School of Medicine, 639 Zhizaoju Rd., Huangpu District, Shanghai 200011, China.Introduction and aims: In the face of escalating oral cancer rates, the application of large language models like Generative Pretrained Transformer (GPT)-4 presents a novel pathway for enhancing public awareness about prevention and early detection. This research aims to explore the capabilities and possibilities of GPT-4 in addressing open-ended inquiries in the field of oral cancer. Methods: Using 60 questions accompanied by reference answers, covering concepts, causes, treatments, nutrition, and other aspects of oral cancer, evaluators from diverse backgrounds were selected to evaluate the capabilities of GPT-4 and a customized version. A P value under .05 was considered significant. Results: Analysis revealed that GPT-4 and its adaptations notably excelled in answering open-ended questions, with the majority of responses receiving high scores. Although the median score for standard GPT-4 was marginally better, statistical tests showed no significant difference in capabilities between the two models (P > .05). Despite statistical significance indicated diverse backgrounds of evaluators have statistically difference (P < .05), a post hoc test and comprehensive analysis demonstrated that both editions of GPT-4 demonstrated equivalent capabilities in answering questions concerning oral cancer. Conclusions: GPT-4 has demonstrated its capability to furnish responses to open-ended inquiries concerning oral cancer. Utilizing this advanced technology to boost public awareness about oral cancer is viable and has much potential. When it's unable to locate pertinent information, it will resort to their inherent knowledge base or recommend consulting professionals after offering some basic information. Therefore, it cannot supplant the expertise and clinical judgment of surgical oncologists and could be used as an adjunctive evaluation tool.http://www.sciencedirect.com/science/article/pii/S0020653924001941Artificial intelligenceEducation toolGPT-4Oral cancerOral health |
| spellingShingle | Kaiyuan Ji Jing Han Guangtao Zhai Jiannan Liu Assessing the Capabilities of Generative Pretrained Transformer-4 in Addressing Open-Ended Inquiries of Oral Cancer International Dental Journal Artificial intelligence Education tool GPT-4 Oral cancer Oral health |
| title | Assessing the Capabilities of Generative Pretrained Transformer-4 in Addressing Open-Ended Inquiries of Oral Cancer |
| title_full | Assessing the Capabilities of Generative Pretrained Transformer-4 in Addressing Open-Ended Inquiries of Oral Cancer |
| title_fullStr | Assessing the Capabilities of Generative Pretrained Transformer-4 in Addressing Open-Ended Inquiries of Oral Cancer |
| title_full_unstemmed | Assessing the Capabilities of Generative Pretrained Transformer-4 in Addressing Open-Ended Inquiries of Oral Cancer |
| title_short | Assessing the Capabilities of Generative Pretrained Transformer-4 in Addressing Open-Ended Inquiries of Oral Cancer |
| title_sort | assessing the capabilities of generative pretrained transformer 4 in addressing open ended inquiries of oral cancer |
| topic | Artificial intelligence Education tool GPT-4 Oral cancer Oral health |
| url | http://www.sciencedirect.com/science/article/pii/S0020653924001941 |
| work_keys_str_mv | AT kaiyuanji assessingthecapabilitiesofgenerativepretrainedtransformer4inaddressingopenendedinquiriesoforalcancer AT jinghan assessingthecapabilitiesofgenerativepretrainedtransformer4inaddressingopenendedinquiriesoforalcancer AT guangtaozhai assessingthecapabilitiesofgenerativepretrainedtransformer4inaddressingopenendedinquiriesoforalcancer AT jiannanliu assessingthecapabilitiesofgenerativepretrainedtransformer4inaddressingopenendedinquiriesoforalcancer |