Co-Designing a Web-Based and Tablet App to Evaluate Clinical Outcomes of Early Psychosis Service Users in a Learning Health Care Network: User-Centered Design Workshop and Pilot Study
BackgroundThe Early Psychosis Intervention Network of California project, a learning health care network of California early psychosis intervention (EPI) programs, prioritized incorporation of community partner feedback while designing its eHealth app, Beehive. Though eHealth...
Saved in:
| Main Authors: | , , , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
JMIR Publications
2025-04-01
|
| Series: | JMIR Human Factors |
| Online Access: | https://humanfactors.jmir.org/2025/1/e65889 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849739528255832064 |
|---|---|
| author | Kathleen E Burch Valerie L Tryon Katherine M Pierce Laura M Tully Sabrina Ereshefsky Mark Savill Leigh Smith Adam B Wilcox Christopher Komei Hakusui Viviana E Padilla Amanda P McNamara Merissa Kado-Walton Andrew J Padovani Chelyah Miller Madison J Miles Nitasha Sharma Khanh Linh H Nguyen Yi Zhang Tara A Niendam |
| author_facet | Kathleen E Burch Valerie L Tryon Katherine M Pierce Laura M Tully Sabrina Ereshefsky Mark Savill Leigh Smith Adam B Wilcox Christopher Komei Hakusui Viviana E Padilla Amanda P McNamara Merissa Kado-Walton Andrew J Padovani Chelyah Miller Madison J Miles Nitasha Sharma Khanh Linh H Nguyen Yi Zhang Tara A Niendam |
| author_sort | Kathleen E Burch |
| collection | DOAJ |
| description |
BackgroundThe Early Psychosis Intervention Network of California project, a learning health care network of California early psychosis intervention (EPI) programs, prioritized incorporation of community partner feedback while designing its eHealth app, Beehive. Though eHealth apps can support learning health care network data collection aims, low user acceptance or adoption can pose barriers to successful implementation. Adopting user-centered design (UCD) approaches, such as incorporation of user feedback, prototyping, iterative design, and continuous evaluation, can mitigate these potential barriers.
ObjectiveWe aimed to use UCD during development of a data collection and data visualization web-based and tablet app, Beehive, to promote engagement with Beehive as part of standard EPI care across a diverse user-base.
MethodsOur UCD approach included incorporation of user feedback, prototyping, iterative design, and continuous evaluation. This started with user journey mapping to create storyboards, which were then presented in UCD workshops with service users, their support persons, and EPI providers. We incorporated feedback from these workshops into the alpha version of Beehive, which was also presented in a UCD workshop. Feedback was again incorporated into the beta version of Beehive. We provided Beehive training to 4 EPI programs who then piloted Beehive’s beta version. During piloting, service users, their support persons, and EPI program providers completed Beehive surveys at enrollment and every 6 months after treatment initiation. To examine preliminary user acceptance and adoption during the piloting phase, we assessed rates of participant enrollment and survey completion, with a particular focus on completion of a prioritized survey: the Modified Colorado Symptom Index.
ResultsUCD workshop feedback resulted in the creation of new workflows and interface changes in Beehive to improve the user experience. During piloting, 48 service users, 42 support persons, and 72 EPI program providers enrolled in Beehive. Data were available for 88% (n=42) of service users, including self-reported data for 79% (n=38), collateral-reported data for 42% (n=20), and clinician-entered data for 17% (n=8). The Modified Colorado Symptom Index was completed by 54% (n=26) of service users (total score: mean 24.16, SD 16.81). In addition, 35 service users had a support person who could complete the Modified Colorado Symptom Index, and 56% (n=19) of support persons completed it (mean 26.71, SD 14.43).
ConclusionsImplementing UCD principles while developing the Beehive app resulted in early workflow changes and produced an app that was acceptable and feasible for collection of self-reported clinical outcomes data from service users. Additional support is needed to increase collateral-reported and clinician-entered data. |
| format | Article |
| id | doaj-art-292c7920e88f4b2eaea5ba5e22bf5468 |
| institution | DOAJ |
| issn | 2292-9495 |
| language | English |
| publishDate | 2025-04-01 |
| publisher | JMIR Publications |
| record_format | Article |
| series | JMIR Human Factors |
| spelling | doaj-art-292c7920e88f4b2eaea5ba5e22bf54682025-08-20T03:06:14ZengJMIR PublicationsJMIR Human Factors2292-94952025-04-0112e6588910.2196/65889Co-Designing a Web-Based and Tablet App to Evaluate Clinical Outcomes of Early Psychosis Service Users in a Learning Health Care Network: User-Centered Design Workshop and Pilot StudyKathleen E Burchhttps://orcid.org/0000-0002-4889-3907Valerie L Tryonhttps://orcid.org/0000-0003-3117-3150Katherine M Piercehttps://orcid.org/0000-0002-6820-5649Laura M Tullyhttps://orcid.org/0000-0002-2751-9887Sabrina Ereshefskyhttps://orcid.org/0000-0002-0348-1300Mark Savillhttps://orcid.org/0000-0002-4785-4885Leigh Smithhttps://orcid.org/0000-0001-7414-8380Adam B Wilcoxhttps://orcid.org/0000-0002-6305-735XChristopher Komei Hakusuihttps://orcid.org/0000-0001-7006-5860Viviana E Padillahttps://orcid.org/0009-0004-8454-5020Amanda P McNamarahttps://orcid.org/0000-0002-6079-7694Merissa Kado-Waltonhttps://orcid.org/0000-0002-6042-1996Andrew J Padovanihttps://orcid.org/0000-0002-3116-3078Chelyah Millerhttps://orcid.org/0000-0001-6820-0680Madison J Mileshttps://orcid.org/0000-0001-7371-802XNitasha Sharmahttps://orcid.org/0009-0000-6411-0979Khanh Linh H Nguyenhttps://orcid.org/0000-0002-9563-1838Yi Zhanghttps://orcid.org/0000-0003-0422-3757Tara A Niendamhttps://orcid.org/0000-0003-2285-5002 BackgroundThe Early Psychosis Intervention Network of California project, a learning health care network of California early psychosis intervention (EPI) programs, prioritized incorporation of community partner feedback while designing its eHealth app, Beehive. Though eHealth apps can support learning health care network data collection aims, low user acceptance or adoption can pose barriers to successful implementation. Adopting user-centered design (UCD) approaches, such as incorporation of user feedback, prototyping, iterative design, and continuous evaluation, can mitigate these potential barriers. ObjectiveWe aimed to use UCD during development of a data collection and data visualization web-based and tablet app, Beehive, to promote engagement with Beehive as part of standard EPI care across a diverse user-base. MethodsOur UCD approach included incorporation of user feedback, prototyping, iterative design, and continuous evaluation. This started with user journey mapping to create storyboards, which were then presented in UCD workshops with service users, their support persons, and EPI providers. We incorporated feedback from these workshops into the alpha version of Beehive, which was also presented in a UCD workshop. Feedback was again incorporated into the beta version of Beehive. We provided Beehive training to 4 EPI programs who then piloted Beehive’s beta version. During piloting, service users, their support persons, and EPI program providers completed Beehive surveys at enrollment and every 6 months after treatment initiation. To examine preliminary user acceptance and adoption during the piloting phase, we assessed rates of participant enrollment and survey completion, with a particular focus on completion of a prioritized survey: the Modified Colorado Symptom Index. ResultsUCD workshop feedback resulted in the creation of new workflows and interface changes in Beehive to improve the user experience. During piloting, 48 service users, 42 support persons, and 72 EPI program providers enrolled in Beehive. Data were available for 88% (n=42) of service users, including self-reported data for 79% (n=38), collateral-reported data for 42% (n=20), and clinician-entered data for 17% (n=8). The Modified Colorado Symptom Index was completed by 54% (n=26) of service users (total score: mean 24.16, SD 16.81). In addition, 35 service users had a support person who could complete the Modified Colorado Symptom Index, and 56% (n=19) of support persons completed it (mean 26.71, SD 14.43). ConclusionsImplementing UCD principles while developing the Beehive app resulted in early workflow changes and produced an app that was acceptable and feasible for collection of self-reported clinical outcomes data from service users. Additional support is needed to increase collateral-reported and clinician-entered data.https://humanfactors.jmir.org/2025/1/e65889 |
| spellingShingle | Kathleen E Burch Valerie L Tryon Katherine M Pierce Laura M Tully Sabrina Ereshefsky Mark Savill Leigh Smith Adam B Wilcox Christopher Komei Hakusui Viviana E Padilla Amanda P McNamara Merissa Kado-Walton Andrew J Padovani Chelyah Miller Madison J Miles Nitasha Sharma Khanh Linh H Nguyen Yi Zhang Tara A Niendam Co-Designing a Web-Based and Tablet App to Evaluate Clinical Outcomes of Early Psychosis Service Users in a Learning Health Care Network: User-Centered Design Workshop and Pilot Study JMIR Human Factors |
| title | Co-Designing a Web-Based and Tablet App to Evaluate Clinical Outcomes of Early Psychosis Service Users in a Learning Health Care Network: User-Centered Design Workshop and Pilot Study |
| title_full | Co-Designing a Web-Based and Tablet App to Evaluate Clinical Outcomes of Early Psychosis Service Users in a Learning Health Care Network: User-Centered Design Workshop and Pilot Study |
| title_fullStr | Co-Designing a Web-Based and Tablet App to Evaluate Clinical Outcomes of Early Psychosis Service Users in a Learning Health Care Network: User-Centered Design Workshop and Pilot Study |
| title_full_unstemmed | Co-Designing a Web-Based and Tablet App to Evaluate Clinical Outcomes of Early Psychosis Service Users in a Learning Health Care Network: User-Centered Design Workshop and Pilot Study |
| title_short | Co-Designing a Web-Based and Tablet App to Evaluate Clinical Outcomes of Early Psychosis Service Users in a Learning Health Care Network: User-Centered Design Workshop and Pilot Study |
| title_sort | co designing a web based and tablet app to evaluate clinical outcomes of early psychosis service users in a learning health care network user centered design workshop and pilot study |
| url | https://humanfactors.jmir.org/2025/1/e65889 |
| work_keys_str_mv | AT kathleeneburch codesigningawebbasedandtabletapptoevaluateclinicaloutcomesofearlypsychosisserviceusersinalearninghealthcarenetworkusercentereddesignworkshopandpilotstudy AT valerieltryon codesigningawebbasedandtabletapptoevaluateclinicaloutcomesofearlypsychosisserviceusersinalearninghealthcarenetworkusercentereddesignworkshopandpilotstudy AT katherinempierce codesigningawebbasedandtabletapptoevaluateclinicaloutcomesofearlypsychosisserviceusersinalearninghealthcarenetworkusercentereddesignworkshopandpilotstudy AT lauramtully codesigningawebbasedandtabletapptoevaluateclinicaloutcomesofearlypsychosisserviceusersinalearninghealthcarenetworkusercentereddesignworkshopandpilotstudy AT sabrinaereshefsky codesigningawebbasedandtabletapptoevaluateclinicaloutcomesofearlypsychosisserviceusersinalearninghealthcarenetworkusercentereddesignworkshopandpilotstudy AT marksavill codesigningawebbasedandtabletapptoevaluateclinicaloutcomesofearlypsychosisserviceusersinalearninghealthcarenetworkusercentereddesignworkshopandpilotstudy AT leighsmith codesigningawebbasedandtabletapptoevaluateclinicaloutcomesofearlypsychosisserviceusersinalearninghealthcarenetworkusercentereddesignworkshopandpilotstudy AT adambwilcox codesigningawebbasedandtabletapptoevaluateclinicaloutcomesofearlypsychosisserviceusersinalearninghealthcarenetworkusercentereddesignworkshopandpilotstudy AT christopherkomeihakusui codesigningawebbasedandtabletapptoevaluateclinicaloutcomesofearlypsychosisserviceusersinalearninghealthcarenetworkusercentereddesignworkshopandpilotstudy AT vivianaepadilla codesigningawebbasedandtabletapptoevaluateclinicaloutcomesofearlypsychosisserviceusersinalearninghealthcarenetworkusercentereddesignworkshopandpilotstudy AT amandapmcnamara codesigningawebbasedandtabletapptoevaluateclinicaloutcomesofearlypsychosisserviceusersinalearninghealthcarenetworkusercentereddesignworkshopandpilotstudy AT merissakadowalton codesigningawebbasedandtabletapptoevaluateclinicaloutcomesofearlypsychosisserviceusersinalearninghealthcarenetworkusercentereddesignworkshopandpilotstudy AT andrewjpadovani codesigningawebbasedandtabletapptoevaluateclinicaloutcomesofearlypsychosisserviceusersinalearninghealthcarenetworkusercentereddesignworkshopandpilotstudy AT chelyahmiller codesigningawebbasedandtabletapptoevaluateclinicaloutcomesofearlypsychosisserviceusersinalearninghealthcarenetworkusercentereddesignworkshopandpilotstudy AT madisonjmiles codesigningawebbasedandtabletapptoevaluateclinicaloutcomesofearlypsychosisserviceusersinalearninghealthcarenetworkusercentereddesignworkshopandpilotstudy AT nitashasharma codesigningawebbasedandtabletapptoevaluateclinicaloutcomesofearlypsychosisserviceusersinalearninghealthcarenetworkusercentereddesignworkshopandpilotstudy AT khanhlinhhnguyen codesigningawebbasedandtabletapptoevaluateclinicaloutcomesofearlypsychosisserviceusersinalearninghealthcarenetworkusercentereddesignworkshopandpilotstudy AT yizhang codesigningawebbasedandtabletapptoevaluateclinicaloutcomesofearlypsychosisserviceusersinalearninghealthcarenetworkusercentereddesignworkshopandpilotstudy AT taraaniendam codesigningawebbasedandtabletapptoevaluateclinicaloutcomesofearlypsychosisserviceusersinalearninghealthcarenetworkusercentereddesignworkshopandpilotstudy |