Integrating CEN ISO/TS 82304-2 in the Catalan Health App Assessment Framework: Comparative Case Study
Abstract BackgroundHealth apps are increasingly being used to promote health, manage diseases, and deliver health care services. Still, there is scarce objective information regarding their quality beyond the required Conformité Européenne mark for medical apps, leading to pot...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
JMIR Publications
2025-06-01
|
| Series: | JMIR mHealth and uHealth |
| Online Access: | https://mhealth.jmir.org/2025/1/e67858 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850160821546516480 |
|---|---|
| author | Berta Llebot Casajuana Petra Hoogendoorn Maria Villalobos-Quesada Carme Pratdepàdua Bufill |
| author_facet | Berta Llebot Casajuana Petra Hoogendoorn Maria Villalobos-Quesada Carme Pratdepàdua Bufill |
| author_sort | Berta Llebot Casajuana |
| collection | DOAJ |
| description |
Abstract
BackgroundHealth apps are increasingly being used to promote health, manage diseases, and deliver health care services. Still, there is scarce objective information regarding their quality beyond the required Conformité Européenne mark for medical apps, leading to potential risks for users. To address these challenges, several authorities have developed health app assessment frameworks. In 2017, the TIC Salut Social Foundation (FTSS) in Catalonia developed its own health app assessment framework, which has been in use since that year. The publication of CEN ISO/TS 82304‐2 (abbreviated as 82304‐2)—a Technical Specification for assessing health apps—and the cocreation of the Label2Enable 82304‐2 handbook for certified assessment organizations provide a unique opportunity to harmonize app assessments across the European Union.
ObjectiveThis study aimed to perform a comparative analysis of the FTSS assessment framework with 82304‐2 to explore the integration of 82304‐2 in Catalonia. Our broader aim was to provide this methodology for health authorities elsewhere to consider integrating 82304‐2 or other evaluation frameworks.
MethodsFor the comparative analysis, a mixed methods approach was used, combining a qualitative case study with a quantitative analysis of the 2 frameworks. The qualitative evaluation covered rationale for assessment, framework characteristics, governance, workflows, quality aspects, and quality requirements. For the quantitative analysis, all FTSS and 82304‐2 requirements were translated into concepts and subconcepts. A scoring system identified matches of the frameworks with these subconcepts, with scores ranging from 0 (no match) to 0.5 (partial match) and 1 (full match). Integration was evaluated considering several scenarios, including adopting the Label2Enable 82304‐2 handbook, adopting the 82304‐2 requirements, adapting the 82304‐2 requirements to local needs, and maintaining the current FTSS framework.
ResultsThe main difference between the frameworks was the app usage–based assessment (FTSS) versus evidence- and app usage–based assessment (82304‐2). All 120 FTSS requirements and 74 quality aspect–related 82304‐2 requirements were translated into 78 concepts and 97 subconcepts. Overall, 48% (47/97) of the subconcepts were found in both frameworks, 39% (37.5/97) were specific to 82304‐2, and 13% (12.5/97) were specific to FTSS. All 82304‐2-specific subconcepts and thus all 82304‐2 requirements were found to be relevant to FTSS. FTSS decided to integrate (adopt and adapt) all 74 82304‐2 requirements. In total, 5 FTSS-specific requirements were included in the Label2Enable 82304‐2 handbook, while another 4 rigor-enhancing requirements, 1 scope-expanding requirement, and 1 context-specific requirement would be assessed on top.
ConclusionsThe comprehensive comparative analysis of the FTSS framework and 82304‐2 enabled FTSS decision-making to integrate all 82304‐2 quality requirements and adopt the Label2Enable 82304‐2 handbook in the future. The many new and all relevant 82304‐2 concepts, the rigor of the handbook, and the few remaining FTSS-specific requirements are expected to be indicative of 82304‐2’s potential to make harmonized, robust health app assessments common in Catalonia and elsewhere. FTSS encourages other authorities to perform a similar evaluation. |
| format | Article |
| id | doaj-art-82a02ae31d15442aa7e91d741dcc9679 |
| institution | OA Journals |
| issn | 2291-5222 |
| language | English |
| publishDate | 2025-06-01 |
| publisher | JMIR Publications |
| record_format | Article |
| series | JMIR mHealth and uHealth |
| spelling | doaj-art-82a02ae31d15442aa7e91d741dcc96792025-08-20T02:23:04ZengJMIR PublicationsJMIR mHealth and uHealth2291-52222025-06-0113e67858e6785810.2196/67858Integrating CEN ISO/TS 82304-2 in the Catalan Health App Assessment Framework: Comparative Case StudyBerta Llebot Casajuanahttp://orcid.org/0009-0002-7674-974XPetra Hoogendoornhttp://orcid.org/0000-0003-3824-648XMaria Villalobos-Quesadahttp://orcid.org/0000-0003-4930-1982Carme Pratdepàdua Bufillhttp://orcid.org/0000-0002-2540-7638 Abstract BackgroundHealth apps are increasingly being used to promote health, manage diseases, and deliver health care services. Still, there is scarce objective information regarding their quality beyond the required Conformité Européenne mark for medical apps, leading to potential risks for users. To address these challenges, several authorities have developed health app assessment frameworks. In 2017, the TIC Salut Social Foundation (FTSS) in Catalonia developed its own health app assessment framework, which has been in use since that year. The publication of CEN ISO/TS 82304‐2 (abbreviated as 82304‐2)—a Technical Specification for assessing health apps—and the cocreation of the Label2Enable 82304‐2 handbook for certified assessment organizations provide a unique opportunity to harmonize app assessments across the European Union. ObjectiveThis study aimed to perform a comparative analysis of the FTSS assessment framework with 82304‐2 to explore the integration of 82304‐2 in Catalonia. Our broader aim was to provide this methodology for health authorities elsewhere to consider integrating 82304‐2 or other evaluation frameworks. MethodsFor the comparative analysis, a mixed methods approach was used, combining a qualitative case study with a quantitative analysis of the 2 frameworks. The qualitative evaluation covered rationale for assessment, framework characteristics, governance, workflows, quality aspects, and quality requirements. For the quantitative analysis, all FTSS and 82304‐2 requirements were translated into concepts and subconcepts. A scoring system identified matches of the frameworks with these subconcepts, with scores ranging from 0 (no match) to 0.5 (partial match) and 1 (full match). Integration was evaluated considering several scenarios, including adopting the Label2Enable 82304‐2 handbook, adopting the 82304‐2 requirements, adapting the 82304‐2 requirements to local needs, and maintaining the current FTSS framework. ResultsThe main difference between the frameworks was the app usage–based assessment (FTSS) versus evidence- and app usage–based assessment (82304‐2). All 120 FTSS requirements and 74 quality aspect–related 82304‐2 requirements were translated into 78 concepts and 97 subconcepts. Overall, 48% (47/97) of the subconcepts were found in both frameworks, 39% (37.5/97) were specific to 82304‐2, and 13% (12.5/97) were specific to FTSS. All 82304‐2-specific subconcepts and thus all 82304‐2 requirements were found to be relevant to FTSS. FTSS decided to integrate (adopt and adapt) all 74 82304‐2 requirements. In total, 5 FTSS-specific requirements were included in the Label2Enable 82304‐2 handbook, while another 4 rigor-enhancing requirements, 1 scope-expanding requirement, and 1 context-specific requirement would be assessed on top. ConclusionsThe comprehensive comparative analysis of the FTSS framework and 82304‐2 enabled FTSS decision-making to integrate all 82304‐2 quality requirements and adopt the Label2Enable 82304‐2 handbook in the future. The many new and all relevant 82304‐2 concepts, the rigor of the handbook, and the few remaining FTSS-specific requirements are expected to be indicative of 82304‐2’s potential to make harmonized, robust health app assessments common in Catalonia and elsewhere. FTSS encourages other authorities to perform a similar evaluation.https://mhealth.jmir.org/2025/1/e67858 |
| spellingShingle | Berta Llebot Casajuana Petra Hoogendoorn Maria Villalobos-Quesada Carme Pratdepàdua Bufill Integrating CEN ISO/TS 82304-2 in the Catalan Health App Assessment Framework: Comparative Case Study JMIR mHealth and uHealth |
| title | Integrating CEN ISO/TS 82304-2 in the Catalan Health App Assessment Framework: Comparative Case Study |
| title_full | Integrating CEN ISO/TS 82304-2 in the Catalan Health App Assessment Framework: Comparative Case Study |
| title_fullStr | Integrating CEN ISO/TS 82304-2 in the Catalan Health App Assessment Framework: Comparative Case Study |
| title_full_unstemmed | Integrating CEN ISO/TS 82304-2 in the Catalan Health App Assessment Framework: Comparative Case Study |
| title_short | Integrating CEN ISO/TS 82304-2 in the Catalan Health App Assessment Framework: Comparative Case Study |
| title_sort | integrating cen iso ts 82304 2 in the catalan health app assessment framework comparative case study |
| url | https://mhealth.jmir.org/2025/1/e67858 |
| work_keys_str_mv | AT bertallebotcasajuana integratingcenisots823042inthecatalanhealthappassessmentframeworkcomparativecasestudy AT petrahoogendoorn integratingcenisots823042inthecatalanhealthappassessmentframeworkcomparativecasestudy AT mariavillalobosquesada integratingcenisots823042inthecatalanhealthappassessmentframeworkcomparativecasestudy AT carmepratdepaduabufill integratingcenisots823042inthecatalanhealthappassessmentframeworkcomparativecasestudy |