Development and Validation of a Machine Learning Method Using Vocal Biomarkers for Identifying Frailty in Community-Dwelling Older Adults: Cross-Sectional Study
Abstract BackgroundThe two most commonly used methods to identify frailty are the frailty phenotype and the frailty index. However, both methods have limitations in clinical application. In addition, methods for measuring frailty have not yet been standardized. Obj...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
JMIR Publications
2025-01-01
|
| Series: | JMIR Medical Informatics |
| Online Access: | https://medinform.jmir.org/2025/1/e57298 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832585083945484288 |
|---|---|
| author | Taehwan Kim Jung-Yeon Choi Myung Jin Ko Kwang-il Kim |
| author_facet | Taehwan Kim Jung-Yeon Choi Myung Jin Ko Kwang-il Kim |
| author_sort | Taehwan Kim |
| collection | DOAJ |
| description |
Abstract
BackgroundThe two most commonly used methods to identify frailty are the frailty phenotype and the frailty index. However, both methods have limitations in clinical application. In addition, methods for measuring frailty have not yet been standardized.
ObjectiveWe aimed to develop and validate a classification model for predicting frailty status using vocal biomarkers in community-dwelling older adults, based on voice recordings obtained from the picture description task (PDT).
MethodsWe recruited 127 participants aged 50 years and older and collected clinical information through a short form of the Comprehensive Geriatric Assessment scale. Voice recordings were collected with a tablet device during the Korean version of the PDT, and we preprocessed audio data to remove background noise before feature extraction. Three artificial intelligence (AI) models were developed for identifying frailty status: SpeechAI (using speech data only), DemoAI (using demographic data only), and DemoSpeechAI (combining both data types).
ResultsOur models were trained and evaluated on the basis of 5-fold cross-validation for 127 participants and compared. The SpeechAI model, using deep learning–based acoustic features, outperformed in terms of accuracy and area under the receiver operating characteristic curve (AUC), 80.4% (95% CI 76.89%‐83.91%) and 0.89 (95% CI 0.86‐0.92), respectively, while the model using only demographics showed an accuracy of 67.96% (95% CI 67.63%‐68.29%) and an AUC of 0.74 (95% CI 0.73‐0.75). The SpeechAI model outperformed the model using only demographics significantly in AUC (t4Pt4P
ConclusionsOur findings demonstrate that vocal biomarkers derived from deep learning–based acoustic features can be effectively used to predict frailty status in community-dwelling older adults. The SpeechAI model showed promising accuracy and AUC, outperforming models based solely on demographic data or traditional acoustic features. Furthermore, while the combined DemoSpeechAI model showed slightly improved performance over the SpeechAI model, the difference was not statistically significant. These results suggest that speech-based AI models offer a noninvasive, scalable method for frailty detection, potentially streamlining assessments in clinical and community settings. |
| format | Article |
| id | doaj-art-9c502ab9cef24571b43daf34545d1bf3 |
| institution | Kabale University |
| issn | 2291-9694 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | JMIR Publications |
| record_format | Article |
| series | JMIR Medical Informatics |
| spelling | doaj-art-9c502ab9cef24571b43daf34545d1bf32025-01-27T04:39:05ZengJMIR PublicationsJMIR Medical Informatics2291-96942025-01-0113e57298e5729810.2196/57298Development and Validation of a Machine Learning Method Using Vocal Biomarkers for Identifying Frailty in Community-Dwelling Older Adults: Cross-Sectional StudyTaehwan Kimhttp://orcid.org/0000-0002-8030-2863Jung-Yeon Choihttp://orcid.org/0000-0001-5139-5346Myung Jin Kohttp://orcid.org/0000-0001-8371-8744Kwang-il Kimhttp://orcid.org/0000-0002-6658-047X Abstract BackgroundThe two most commonly used methods to identify frailty are the frailty phenotype and the frailty index. However, both methods have limitations in clinical application. In addition, methods for measuring frailty have not yet been standardized. ObjectiveWe aimed to develop and validate a classification model for predicting frailty status using vocal biomarkers in community-dwelling older adults, based on voice recordings obtained from the picture description task (PDT). MethodsWe recruited 127 participants aged 50 years and older and collected clinical information through a short form of the Comprehensive Geriatric Assessment scale. Voice recordings were collected with a tablet device during the Korean version of the PDT, and we preprocessed audio data to remove background noise before feature extraction. Three artificial intelligence (AI) models were developed for identifying frailty status: SpeechAI (using speech data only), DemoAI (using demographic data only), and DemoSpeechAI (combining both data types). ResultsOur models were trained and evaluated on the basis of 5-fold cross-validation for 127 participants and compared. The SpeechAI model, using deep learning–based acoustic features, outperformed in terms of accuracy and area under the receiver operating characteristic curve (AUC), 80.4% (95% CI 76.89%‐83.91%) and 0.89 (95% CI 0.86‐0.92), respectively, while the model using only demographics showed an accuracy of 67.96% (95% CI 67.63%‐68.29%) and an AUC of 0.74 (95% CI 0.73‐0.75). The SpeechAI model outperformed the model using only demographics significantly in AUC (t4Pt4P ConclusionsOur findings demonstrate that vocal biomarkers derived from deep learning–based acoustic features can be effectively used to predict frailty status in community-dwelling older adults. The SpeechAI model showed promising accuracy and AUC, outperforming models based solely on demographic data or traditional acoustic features. Furthermore, while the combined DemoSpeechAI model showed slightly improved performance over the SpeechAI model, the difference was not statistically significant. These results suggest that speech-based AI models offer a noninvasive, scalable method for frailty detection, potentially streamlining assessments in clinical and community settings.https://medinform.jmir.org/2025/1/e57298 |
| spellingShingle | Taehwan Kim Jung-Yeon Choi Myung Jin Ko Kwang-il Kim Development and Validation of a Machine Learning Method Using Vocal Biomarkers for Identifying Frailty in Community-Dwelling Older Adults: Cross-Sectional Study JMIR Medical Informatics |
| title | Development and Validation of a Machine Learning Method Using Vocal Biomarkers for Identifying Frailty in Community-Dwelling Older Adults: Cross-Sectional Study |
| title_full | Development and Validation of a Machine Learning Method Using Vocal Biomarkers for Identifying Frailty in Community-Dwelling Older Adults: Cross-Sectional Study |
| title_fullStr | Development and Validation of a Machine Learning Method Using Vocal Biomarkers for Identifying Frailty in Community-Dwelling Older Adults: Cross-Sectional Study |
| title_full_unstemmed | Development and Validation of a Machine Learning Method Using Vocal Biomarkers for Identifying Frailty in Community-Dwelling Older Adults: Cross-Sectional Study |
| title_short | Development and Validation of a Machine Learning Method Using Vocal Biomarkers for Identifying Frailty in Community-Dwelling Older Adults: Cross-Sectional Study |
| title_sort | development and validation of a machine learning method using vocal biomarkers for identifying frailty in community dwelling older adults cross sectional study |
| url | https://medinform.jmir.org/2025/1/e57298 |
| work_keys_str_mv | AT taehwankim developmentandvalidationofamachinelearningmethodusingvocalbiomarkersforidentifyingfrailtyincommunitydwellingolderadultscrosssectionalstudy AT jungyeonchoi developmentandvalidationofamachinelearningmethodusingvocalbiomarkersforidentifyingfrailtyincommunitydwellingolderadultscrosssectionalstudy AT myungjinko developmentandvalidationofamachinelearningmethodusingvocalbiomarkersforidentifyingfrailtyincommunitydwellingolderadultscrosssectionalstudy AT kwangilkim developmentandvalidationofamachinelearningmethodusingvocalbiomarkersforidentifyingfrailtyincommunitydwellingolderadultscrosssectionalstudy |