Comparison of an AI Chatbot With a Nurse Hotline in Reducing Anxiety and Depression Levels in the General Population: Pilot Randomized Controlled Trial
Abstract BackgroundArtificial intelligence (AI) chatbots have been customized to deliver on-demand support for people with mental health problems. However, the effectiveness of AI chatbots in tackling mental health problems among the general public in Hong Kong remains unclear...
Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
JMIR Publications
2025-03-01
|
| Series: | JMIR Human Factors |
| Online Access: | https://humanfactors.jmir.org/2025/1/e65785 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850029765812027392 |
|---|---|
| author | Chen Chen Kok Tai Lam Ka Man Yip Hung Kwan So Terry Yat Sang Lum Ian Chi Kei Wong Jason C Yam Celine Sze Ling Chui Patrick Ip |
| author_facet | Chen Chen Kok Tai Lam Ka Man Yip Hung Kwan So Terry Yat Sang Lum Ian Chi Kei Wong Jason C Yam Celine Sze Ling Chui Patrick Ip |
| author_sort | Chen Chen |
| collection | DOAJ |
| description |
Abstract
BackgroundArtificial intelligence (AI) chatbots have been customized to deliver on-demand support for people with mental health problems. However, the effectiveness of AI chatbots in tackling mental health problems among the general public in Hong Kong remains unclear.
ObjectiveThis study aimed to develop a local AI chatbot and compare the effectiveness of the AI chatbot with a conventional nurse hotline in reducing the level of anxiety and depression among individuals in Hong Kong.
MethodsThis study was a pilot randomized controlled trial conducted from October 2022 to March 2023, involving 124 participants allocated randomly (1:1 ratio) into the AI chatbot and nurse hotline groups. Among these, 62 participants in the AI chatbot group and 41 in the nurse hotline group completed both the pre- and postquestionnaires, including the GAD-7 (Generalized Anxiety Disorder Scale-7), PHQ-9 (Patient Health Questionnaire-9), and satisfaction questionnaire. Comparisons were conducted using independent and paired sample tχ2
ResultsCompared to the mean baseline score of 5.13 (SD 4.623), the mean postdepression score in the chatbot group was 3.68 (SD 4.397), which was significantly lower (PPPPP
ConclusionsThe AI chatbot was comparable to the traditional nurse hotline in alleviating participants’ anxiety and depression after responding to inquiries. Moreover, the AI chatbot has shown potential in alleviating short-term anxiety and depression compared to the nurse hotline. While the AI chatbot presents a promising solution for offering accessible strategies to the public, more extensive randomized controlled studies are necessary to further validate its effectiveness. |
| format | Article |
| id | doaj-art-7fa15ad484e04271a780e094f45ebeee |
| institution | DOAJ |
| issn | 2292-9495 |
| language | English |
| publishDate | 2025-03-01 |
| publisher | JMIR Publications |
| record_format | Article |
| series | JMIR Human Factors |
| spelling | doaj-art-7fa15ad484e04271a780e094f45ebeee2025-08-20T02:59:24ZengJMIR PublicationsJMIR Human Factors2292-94952025-03-0112e65785e6578510.2196/65785Comparison of an AI Chatbot With a Nurse Hotline in Reducing Anxiety and Depression Levels in the General Population: Pilot Randomized Controlled TrialChen Chenhttp://orcid.org/0000-0002-3119-5010Kok Tai Lamhttp://orcid.org/0000-0003-2937-3292Ka Man Yiphttp://orcid.org/0000-0002-1577-3431Hung Kwan Sohttp://orcid.org/0000-0002-6188-7587Terry Yat Sang Lumhttp://orcid.org/0000-0003-1196-5345Ian Chi Kei Wonghttp://orcid.org/0000-0001-8242-0014Jason C Yamhttp://orcid.org/0000-0002-2156-1486Celine Sze Ling Chuihttp://orcid.org/0000-0003-1513-8726Patrick Iphttp://orcid.org/0000-0002-6797-6898 Abstract BackgroundArtificial intelligence (AI) chatbots have been customized to deliver on-demand support for people with mental health problems. However, the effectiveness of AI chatbots in tackling mental health problems among the general public in Hong Kong remains unclear. ObjectiveThis study aimed to develop a local AI chatbot and compare the effectiveness of the AI chatbot with a conventional nurse hotline in reducing the level of anxiety and depression among individuals in Hong Kong. MethodsThis study was a pilot randomized controlled trial conducted from October 2022 to March 2023, involving 124 participants allocated randomly (1:1 ratio) into the AI chatbot and nurse hotline groups. Among these, 62 participants in the AI chatbot group and 41 in the nurse hotline group completed both the pre- and postquestionnaires, including the GAD-7 (Generalized Anxiety Disorder Scale-7), PHQ-9 (Patient Health Questionnaire-9), and satisfaction questionnaire. Comparisons were conducted using independent and paired sample tχ2 ResultsCompared to the mean baseline score of 5.13 (SD 4.623), the mean postdepression score in the chatbot group was 3.68 (SD 4.397), which was significantly lower (PPPPP ConclusionsThe AI chatbot was comparable to the traditional nurse hotline in alleviating participants’ anxiety and depression after responding to inquiries. Moreover, the AI chatbot has shown potential in alleviating short-term anxiety and depression compared to the nurse hotline. While the AI chatbot presents a promising solution for offering accessible strategies to the public, more extensive randomized controlled studies are necessary to further validate its effectiveness.https://humanfactors.jmir.org/2025/1/e65785 |
| spellingShingle | Chen Chen Kok Tai Lam Ka Man Yip Hung Kwan So Terry Yat Sang Lum Ian Chi Kei Wong Jason C Yam Celine Sze Ling Chui Patrick Ip Comparison of an AI Chatbot With a Nurse Hotline in Reducing Anxiety and Depression Levels in the General Population: Pilot Randomized Controlled Trial JMIR Human Factors |
| title | Comparison of an AI Chatbot With a Nurse Hotline in Reducing Anxiety and Depression Levels in the General Population: Pilot Randomized Controlled Trial |
| title_full | Comparison of an AI Chatbot With a Nurse Hotline in Reducing Anxiety and Depression Levels in the General Population: Pilot Randomized Controlled Trial |
| title_fullStr | Comparison of an AI Chatbot With a Nurse Hotline in Reducing Anxiety and Depression Levels in the General Population: Pilot Randomized Controlled Trial |
| title_full_unstemmed | Comparison of an AI Chatbot With a Nurse Hotline in Reducing Anxiety and Depression Levels in the General Population: Pilot Randomized Controlled Trial |
| title_short | Comparison of an AI Chatbot With a Nurse Hotline in Reducing Anxiety and Depression Levels in the General Population: Pilot Randomized Controlled Trial |
| title_sort | comparison of an ai chatbot with a nurse hotline in reducing anxiety and depression levels in the general population pilot randomized controlled trial |
| url | https://humanfactors.jmir.org/2025/1/e65785 |
| work_keys_str_mv | AT chenchen comparisonofanaichatbotwithanursehotlineinreducinganxietyanddepressionlevelsinthegeneralpopulationpilotrandomizedcontrolledtrial AT koktailam comparisonofanaichatbotwithanursehotlineinreducinganxietyanddepressionlevelsinthegeneralpopulationpilotrandomizedcontrolledtrial AT kamanyip comparisonofanaichatbotwithanursehotlineinreducinganxietyanddepressionlevelsinthegeneralpopulationpilotrandomizedcontrolledtrial AT hungkwanso comparisonofanaichatbotwithanursehotlineinreducinganxietyanddepressionlevelsinthegeneralpopulationpilotrandomizedcontrolledtrial AT terryyatsanglum comparisonofanaichatbotwithanursehotlineinreducinganxietyanddepressionlevelsinthegeneralpopulationpilotrandomizedcontrolledtrial AT ianchikeiwong comparisonofanaichatbotwithanursehotlineinreducinganxietyanddepressionlevelsinthegeneralpopulationpilotrandomizedcontrolledtrial AT jasoncyam comparisonofanaichatbotwithanursehotlineinreducinganxietyanddepressionlevelsinthegeneralpopulationpilotrandomizedcontrolledtrial AT celineszelingchui comparisonofanaichatbotwithanursehotlineinreducinganxietyanddepressionlevelsinthegeneralpopulationpilotrandomizedcontrolledtrial AT patrickip comparisonofanaichatbotwithanursehotlineinreducinganxietyanddepressionlevelsinthegeneralpopulationpilotrandomizedcontrolledtrial |