Validation of Ecological Momentary Assessment With Reference to Accelerometer Data: Repeated-Measures Panel Study With Multilevel Modeling

BackgroundThere is growing interest in the real-time assessment of physical activity (PA) and physiological variables. Acceleration, particularly those collected through wearable sensors, has been increasingly adopted as an objective measure of physical activity. However, sen...

Full description

Saved in:
Bibliographic Details
Main Authors: Jung Min Noh, SongHyun Im, JooYong Park, Jae Myung Kim, Miyoung Lee, Ji-Yeob Choi
Format: Article
Language:English
Published: JMIR Publications 2025-04-01
Series:Journal of Medical Internet Research
Online Access:https://www.jmir.org/2025/1/e59878
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1849337879005757440
author Jung Min Noh
SongHyun Im
JooYong Park
Jae Myung Kim
Miyoung Lee
Ji-Yeob Choi
author_facet Jung Min Noh
SongHyun Im
JooYong Park
Jae Myung Kim
Miyoung Lee
Ji-Yeob Choi
author_sort Jung Min Noh
collection DOAJ
description BackgroundThere is growing interest in the real-time assessment of physical activity (PA) and physiological variables. Acceleration, particularly those collected through wearable sensors, has been increasingly adopted as an objective measure of physical activity. However, sensor-based measures often pose challenges for large-scale studies due to their associated costs, inability to capture contextual information, and restricted user populations. Smartphone-delivered ecological momentary assessment (EMA) offers an unobtrusive and undemanding means to measure PA to address these limitations. ObjectiveThis study aimed to evaluate the usability of EMA by comparing its measurement outcomes with 2 self-report assessments of PA: Global Physical Activity Questionnaire (GPAQ) and a modified version of Bouchard Physical Activity Record (BAR). MethodsA total of 235 participants (137 female, 98 male, and 94 repeated) participated in one or more 7-day studies. Waist-worn sensors provided by ActiGraph captured accelerometer data while participants completed 3 self-report measures of PA. The multilevel modeling method was used with EMA, GPAQ, and BAR as separate measures, with 6 subdomains of physiological activity (overall PA, overall excluding occupational, transport, exercise, occupational, and sedentary) to model accelerometer data. In addition, EMA and GPAQ were further compared with 6 domains of PA from the BAR as outcome measures. ResultsAmong the 3 self-reporting instruments, EMA and BAR exhibited better overall performance in modeling the accelerometer data compared to GPAQ (eg EMA daily: β=.387, P<.001; BAR daily: β=.394, P<.001; GPAQ: β=.281, P<.001, based on repeated-only participants with step counts from accelerometer as dependent variables). ConclusionsMultilevel modeling on 3 self-report assessments of PA indicates that smartphone-delivered EMA is a valid and efficient method for assessing PA.
format Article
id doaj-art-0562ebca2ae548e08122ee3c0f77b178
institution Kabale University
issn 1438-8871
language English
publishDate 2025-04-01
publisher JMIR Publications
record_format Article
series Journal of Medical Internet Research
spelling doaj-art-0562ebca2ae548e08122ee3c0f77b1782025-08-20T03:44:33ZengJMIR PublicationsJournal of Medical Internet Research1438-88712025-04-0127e5987810.2196/59878Validation of Ecological Momentary Assessment With Reference to Accelerometer Data: Repeated-Measures Panel Study With Multilevel ModelingJung Min Nohhttps://orcid.org/0000-0002-6127-8036SongHyun Imhttps://orcid.org/0009-0001-7161-868XJooYong Parkhttps://orcid.org/0000-0002-6444-3754Jae Myung Kimhttps://orcid.org/0000-0002-3788-5856Miyoung Leehttps://orcid.org/0000-0001-9193-4340Ji-Yeob Choihttps://orcid.org/0000-0001-5365-8189 BackgroundThere is growing interest in the real-time assessment of physical activity (PA) and physiological variables. Acceleration, particularly those collected through wearable sensors, has been increasingly adopted as an objective measure of physical activity. However, sensor-based measures often pose challenges for large-scale studies due to their associated costs, inability to capture contextual information, and restricted user populations. Smartphone-delivered ecological momentary assessment (EMA) offers an unobtrusive and undemanding means to measure PA to address these limitations. ObjectiveThis study aimed to evaluate the usability of EMA by comparing its measurement outcomes with 2 self-report assessments of PA: Global Physical Activity Questionnaire (GPAQ) and a modified version of Bouchard Physical Activity Record (BAR). MethodsA total of 235 participants (137 female, 98 male, and 94 repeated) participated in one or more 7-day studies. Waist-worn sensors provided by ActiGraph captured accelerometer data while participants completed 3 self-report measures of PA. The multilevel modeling method was used with EMA, GPAQ, and BAR as separate measures, with 6 subdomains of physiological activity (overall PA, overall excluding occupational, transport, exercise, occupational, and sedentary) to model accelerometer data. In addition, EMA and GPAQ were further compared with 6 domains of PA from the BAR as outcome measures. ResultsAmong the 3 self-reporting instruments, EMA and BAR exhibited better overall performance in modeling the accelerometer data compared to GPAQ (eg EMA daily: β=.387, P<.001; BAR daily: β=.394, P<.001; GPAQ: β=.281, P<.001, based on repeated-only participants with step counts from accelerometer as dependent variables). ConclusionsMultilevel modeling on 3 self-report assessments of PA indicates that smartphone-delivered EMA is a valid and efficient method for assessing PA.https://www.jmir.org/2025/1/e59878
spellingShingle Jung Min Noh
SongHyun Im
JooYong Park
Jae Myung Kim
Miyoung Lee
Ji-Yeob Choi
Validation of Ecological Momentary Assessment With Reference to Accelerometer Data: Repeated-Measures Panel Study With Multilevel Modeling
Journal of Medical Internet Research
title Validation of Ecological Momentary Assessment With Reference to Accelerometer Data: Repeated-Measures Panel Study With Multilevel Modeling
title_full Validation of Ecological Momentary Assessment With Reference to Accelerometer Data: Repeated-Measures Panel Study With Multilevel Modeling
title_fullStr Validation of Ecological Momentary Assessment With Reference to Accelerometer Data: Repeated-Measures Panel Study With Multilevel Modeling
title_full_unstemmed Validation of Ecological Momentary Assessment With Reference to Accelerometer Data: Repeated-Measures Panel Study With Multilevel Modeling
title_short Validation of Ecological Momentary Assessment With Reference to Accelerometer Data: Repeated-Measures Panel Study With Multilevel Modeling
title_sort validation of ecological momentary assessment with reference to accelerometer data repeated measures panel study with multilevel modeling
url https://www.jmir.org/2025/1/e59878
work_keys_str_mv AT jungminnoh validationofecologicalmomentaryassessmentwithreferencetoaccelerometerdatarepeatedmeasurespanelstudywithmultilevelmodeling
AT songhyunim validationofecologicalmomentaryassessmentwithreferencetoaccelerometerdatarepeatedmeasurespanelstudywithmultilevelmodeling
AT jooyongpark validationofecologicalmomentaryassessmentwithreferencetoaccelerometerdatarepeatedmeasurespanelstudywithmultilevelmodeling
AT jaemyungkim validationofecologicalmomentaryassessmentwithreferencetoaccelerometerdatarepeatedmeasurespanelstudywithmultilevelmodeling
AT miyounglee validationofecologicalmomentaryassessmentwithreferencetoaccelerometerdatarepeatedmeasurespanelstudywithmultilevelmodeling
AT jiyeobchoi validationofecologicalmomentaryassessmentwithreferencetoaccelerometerdatarepeatedmeasurespanelstudywithmultilevelmodeling