Multimodal Detection of Agitation in People With Dementia in Clinical Settings: Observational Pilot Study
Abstract BackgroundDementia is a progressive neurodegenerative condition that affects millions worldwide, often accompanied by agitation and aggression (AA), which contribute to patient distress and increased health care burden. Existing assessment methods for AA rely heavily...
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
JMIR Publications
2025-07-01
|
| Series: | JMIR Aging |
| Online Access: | https://aging.jmir.org/2025/1/e68156 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849303956822425600 |
|---|---|
| author | Abeer Badawi Somayya Elmoghazy Samira Choudhury Sara Elgazzar Khalid Elgazzar Amer M Burhan |
| author_facet | Abeer Badawi Somayya Elmoghazy Samira Choudhury Sara Elgazzar Khalid Elgazzar Amer M Burhan |
| author_sort | Abeer Badawi |
| collection | DOAJ |
| description |
Abstract
BackgroundDementia is a progressive neurodegenerative condition that affects millions worldwide, often accompanied by agitation and aggression (AA), which contribute to patient distress and increased health care burden. Existing assessment methods for AA rely heavily on caregiver reporting, introducing subjectivity and inconsistency.
ObjectiveThis study proposes a novel, multimodal system for predicting AA episodes in individuals with severe dementia, integrating wearable sensor data and privacy-preserving video analytics.
MethodsA pilot study involving 10 participants was conducted at Ontario Shores Mental Health Institute. The system combines digital biomarkers collected from the EmbracePlus (Empatica Inc) wristband with video-based behavioral monitoring. Facial features in video frames were anonymized using a masking tool, and a deep learning model was used for AA detection. To determine optimal performance, various machine learning and deep learning models were evaluated for both wearable and video data streams.
ResultsThe Extra Trees model achieved up to 99% accuracy for personalized wristband data, while the multilayer perceptron model performed best in general models with 98% accuracy. For video analysis, the gated recurrent unit model achieved 95% accuracy and 99% area under the curve, and the long short-term memory model demonstrated superior response time for real-time use. Importantly, the system predicted AA episodes at least 6 minutes in advance in all participants based on wearable data.
ConclusionsThe findings demonstrate the system’s potential to autonomously and accurately detect and predict AA events in real-time. This approach represents a significant advancement in the proactive management of behavioral symptoms in dementia care. |
| format | Article |
| id | doaj-art-7633f36a6f4b40d1a3cd11d70464c9e7 |
| institution | Kabale University |
| issn | 2561-7605 |
| language | English |
| publishDate | 2025-07-01 |
| publisher | JMIR Publications |
| record_format | Article |
| series | JMIR Aging |
| spelling | doaj-art-7633f36a6f4b40d1a3cd11d70464c9e72025-08-20T03:55:53ZengJMIR PublicationsJMIR Aging2561-76052025-07-018e68156e6815610.2196/68156Multimodal Detection of Agitation in People With Dementia in Clinical Settings: Observational Pilot StudyAbeer Badawihttp://orcid.org/0000-0002-0107-9457Somayya Elmoghazyhttp://orcid.org/0009-0001-5816-9939Samira Choudhuryhttp://orcid.org/0000-0002-4184-052XSara Elgazzarhttp://orcid.org/0009-0005-4948-4274Khalid Elgazzarhttp://orcid.org/0000-0002-5892-632XAmer M Burhanhttp://orcid.org/0000-0002-9888-008X Abstract BackgroundDementia is a progressive neurodegenerative condition that affects millions worldwide, often accompanied by agitation and aggression (AA), which contribute to patient distress and increased health care burden. Existing assessment methods for AA rely heavily on caregiver reporting, introducing subjectivity and inconsistency. ObjectiveThis study proposes a novel, multimodal system for predicting AA episodes in individuals with severe dementia, integrating wearable sensor data and privacy-preserving video analytics. MethodsA pilot study involving 10 participants was conducted at Ontario Shores Mental Health Institute. The system combines digital biomarkers collected from the EmbracePlus (Empatica Inc) wristband with video-based behavioral monitoring. Facial features in video frames were anonymized using a masking tool, and a deep learning model was used for AA detection. To determine optimal performance, various machine learning and deep learning models were evaluated for both wearable and video data streams. ResultsThe Extra Trees model achieved up to 99% accuracy for personalized wristband data, while the multilayer perceptron model performed best in general models with 98% accuracy. For video analysis, the gated recurrent unit model achieved 95% accuracy and 99% area under the curve, and the long short-term memory model demonstrated superior response time for real-time use. Importantly, the system predicted AA episodes at least 6 minutes in advance in all participants based on wearable data. ConclusionsThe findings demonstrate the system’s potential to autonomously and accurately detect and predict AA events in real-time. This approach represents a significant advancement in the proactive management of behavioral symptoms in dementia care.https://aging.jmir.org/2025/1/e68156 |
| spellingShingle | Abeer Badawi Somayya Elmoghazy Samira Choudhury Sara Elgazzar Khalid Elgazzar Amer M Burhan Multimodal Detection of Agitation in People With Dementia in Clinical Settings: Observational Pilot Study JMIR Aging |
| title | Multimodal Detection of Agitation in People With Dementia in Clinical Settings: Observational Pilot Study |
| title_full | Multimodal Detection of Agitation in People With Dementia in Clinical Settings: Observational Pilot Study |
| title_fullStr | Multimodal Detection of Agitation in People With Dementia in Clinical Settings: Observational Pilot Study |
| title_full_unstemmed | Multimodal Detection of Agitation in People With Dementia in Clinical Settings: Observational Pilot Study |
| title_short | Multimodal Detection of Agitation in People With Dementia in Clinical Settings: Observational Pilot Study |
| title_sort | multimodal detection of agitation in people with dementia in clinical settings observational pilot study |
| url | https://aging.jmir.org/2025/1/e68156 |
| work_keys_str_mv | AT abeerbadawi multimodaldetectionofagitationinpeoplewithdementiainclinicalsettingsobservationalpilotstudy AT somayyaelmoghazy multimodaldetectionofagitationinpeoplewithdementiainclinicalsettingsobservationalpilotstudy AT samirachoudhury multimodaldetectionofagitationinpeoplewithdementiainclinicalsettingsobservationalpilotstudy AT saraelgazzar multimodaldetectionofagitationinpeoplewithdementiainclinicalsettingsobservationalpilotstudy AT khalidelgazzar multimodaldetectionofagitationinpeoplewithdementiainclinicalsettingsobservationalpilotstudy AT amermburhan multimodaldetectionofagitationinpeoplewithdementiainclinicalsettingsobservationalpilotstudy |