AI Testing for Intelligent Chatbots—A Case Study

The decision tree test method works as a flowchart structure for conversational flow. It has predetermined questions and answers that guide the user through specific tasks. Inspired by principles of the decision tree test method in software engineering, this paper discusses intelligent AI test model...

Full description

Saved in:
Bibliographic Details
Main Authors: Jerry Gao, Radhika Agarwal, Prerna Garsole
Format: Article
Language:English
Published: MDPI AG 2025-05-01
Series:Software
Subjects:
Online Access:https://www.mdpi.com/2674-113X/4/2/12
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1849433775694413824
author Jerry Gao
Radhika Agarwal
Prerna Garsole
author_facet Jerry Gao
Radhika Agarwal
Prerna Garsole
author_sort Jerry Gao
collection DOAJ
description The decision tree test method works as a flowchart structure for conversational flow. It has predetermined questions and answers that guide the user through specific tasks. Inspired by principles of the decision tree test method in software engineering, this paper discusses intelligent AI test modeling chat systems, including basic concepts, quality validation, test generation and augmentation, testing scopes, approaches, and needs. The paper’s novelty lies in an intelligent AI test modeling chatbot system built and implemented based on an innovative 3-dimensional AI test model for AI-powered functions in intelligent mobile apps to support model-based AI function testing, test data generation, and adequate test coverage result analysis. As a result, a case study is provided using a mental health and emotional intelligence chatbot system, Wysa. It helps in tracking and analyzing mood and helps in sentiment analysis.
format Article
id doaj-art-6af435f4ca0545758768de27dbb05df6
institution Kabale University
issn 2674-113X
language English
publishDate 2025-05-01
publisher MDPI AG
record_format Article
series Software
spelling doaj-art-6af435f4ca0545758768de27dbb05df62025-08-20T03:26:55ZengMDPI AGSoftware2674-113X2025-05-01421210.3390/software4020012AI Testing for Intelligent Chatbots—A Case StudyJerry Gao0Radhika Agarwal1Prerna Garsole2Department of Computer Engineering, College of Engineering, San Jose State University, San Jose, CA 95192, USAALPSTouchStone, Inc., San Jose, CA 95134, USADepartment of Computer Engineering, College of Engineering, San Jose State University, San Jose, CA 95192, USAThe decision tree test method works as a flowchart structure for conversational flow. It has predetermined questions and answers that guide the user through specific tasks. Inspired by principles of the decision tree test method in software engineering, this paper discusses intelligent AI test modeling chat systems, including basic concepts, quality validation, test generation and augmentation, testing scopes, approaches, and needs. The paper’s novelty lies in an intelligent AI test modeling chatbot system built and implemented based on an innovative 3-dimensional AI test model for AI-powered functions in intelligent mobile apps to support model-based AI function testing, test data generation, and adequate test coverage result analysis. As a result, a case study is provided using a mental health and emotional intelligence chatbot system, Wysa. It helps in tracking and analyzing mood and helps in sentiment analysis.https://www.mdpi.com/2674-113X/4/2/12chatbotssmart AI chat system testing3D intelligent chat test modelingtest generationdata augmentationAI test result validation
spellingShingle Jerry Gao
Radhika Agarwal
Prerna Garsole
AI Testing for Intelligent Chatbots—A Case Study
Software
chatbots
smart AI chat system testing
3D intelligent chat test modeling
test generation
data augmentation
AI test result validation
title AI Testing for Intelligent Chatbots—A Case Study
title_full AI Testing for Intelligent Chatbots—A Case Study
title_fullStr AI Testing for Intelligent Chatbots—A Case Study
title_full_unstemmed AI Testing for Intelligent Chatbots—A Case Study
title_short AI Testing for Intelligent Chatbots—A Case Study
title_sort ai testing for intelligent chatbots a case study
topic chatbots
smart AI chat system testing
3D intelligent chat test modeling
test generation
data augmentation
AI test result validation
url https://www.mdpi.com/2674-113X/4/2/12
work_keys_str_mv AT jerrygao aitestingforintelligentchatbotsacasestudy
AT radhikaagarwal aitestingforintelligentchatbotsacasestudy
AT prernagarsole aitestingforintelligentchatbotsacasestudy