Measuring Narrative Visualizations: A Model-Based Evaluation Framework and Validation

Evaluating narrative visualizations is complex due to their dependence on user characteristics, context, and storytelling elements. This study presents NaVi-Q, a quality model designed to structure the assessment of narrative visualizations, drawing on principles from Software Engineering and Inform...

Full description

Saved in:
Bibliographic Details
Main Authors: Andrea Lezcano Airaldi, Juan Andres Carruthers, Emanuel Irrazabal, Andres Diaz-Pace
Format: Article
Language:English
Published: IEEE 2025-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/11005454/
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1850269637861703680
author Andrea Lezcano Airaldi
Juan Andres Carruthers
Emanuel Irrazabal
Andres Diaz-Pace
author_facet Andrea Lezcano Airaldi
Juan Andres Carruthers
Emanuel Irrazabal
Andres Diaz-Pace
author_sort Andrea Lezcano Airaldi
collection DOAJ
description Evaluating narrative visualizations is complex due to their dependence on user characteristics, context, and storytelling elements. This study presents NaVi-Q, a quality model designed to structure the assessment of narrative visualizations, drawing on principles from Software Engineering and Information Visualization. The model was tested in an experiment where 40 participants evaluated 30 visualizations. The results suggest that the model’s criteria align with expert assessments in distinguishing different quality levels. Scores from experts and non-experts followed similar patterns, indicating that the model may be applicable across different levels of experience. These findings suggest that NaVi-Q can be used as a reference for structuring the evaluation of narrative visualizations in research and practice.
format Article
id doaj-art-a44933667efb4a3ab03314e99b17b470
institution OA Journals
issn 2169-3536
language English
publishDate 2025-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj-art-a44933667efb4a3ab03314e99b17b4702025-08-20T01:53:04ZengIEEEIEEE Access2169-35362025-01-0113873508736810.1109/ACCESS.2025.357048511005454Measuring Narrative Visualizations: A Model-Based Evaluation Framework and ValidationAndrea Lezcano Airaldi0https://orcid.org/0000-0003-1361-2797Juan Andres Carruthers1https://orcid.org/0009-0003-8229-1779Emanuel Irrazabal2Andres Diaz-Pace3https://orcid.org/0000-0002-1765-7872Software Quality Research Group, FaCENA-UNNE, Corrientes, ArgentinaSoftware Quality Research Group, FaCENA-UNNE, Corrientes, ArgentinaSoftware Quality Research Group, FaCENA-UNNE, Corrientes, ArgentinaISISTAN, CONICET-UNICEN, Tandil, Buenos Aires, ArgentinaEvaluating narrative visualizations is complex due to their dependence on user characteristics, context, and storytelling elements. This study presents NaVi-Q, a quality model designed to structure the assessment of narrative visualizations, drawing on principles from Software Engineering and Information Visualization. The model was tested in an experiment where 40 participants evaluated 30 visualizations. The results suggest that the model’s criteria align with expert assessments in distinguishing different quality levels. Scores from experts and non-experts followed similar patterns, indicating that the model may be applicable across different levels of experience. These findings suggest that NaVi-Q can be used as a reference for structuring the evaluation of narrative visualizations in research and practice.https://ieeexplore.ieee.org/document/11005454/Information visualizationdata storytellingnarrative visualizationsevaluationquality model
spellingShingle Andrea Lezcano Airaldi
Juan Andres Carruthers
Emanuel Irrazabal
Andres Diaz-Pace
Measuring Narrative Visualizations: A Model-Based Evaluation Framework and Validation
IEEE Access
Information visualization
data storytelling
narrative visualizations
evaluation
quality model
title Measuring Narrative Visualizations: A Model-Based Evaluation Framework and Validation
title_full Measuring Narrative Visualizations: A Model-Based Evaluation Framework and Validation
title_fullStr Measuring Narrative Visualizations: A Model-Based Evaluation Framework and Validation
title_full_unstemmed Measuring Narrative Visualizations: A Model-Based Evaluation Framework and Validation
title_short Measuring Narrative Visualizations: A Model-Based Evaluation Framework and Validation
title_sort measuring narrative visualizations a model based evaluation framework and validation
topic Information visualization
data storytelling
narrative visualizations
evaluation
quality model
url https://ieeexplore.ieee.org/document/11005454/
work_keys_str_mv AT andrealezcanoairaldi measuringnarrativevisualizationsamodelbasedevaluationframeworkandvalidation
AT juanandrescarruthers measuringnarrativevisualizationsamodelbasedevaluationframeworkandvalidation
AT emanuelirrazabal measuringnarrativevisualizationsamodelbasedevaluationframeworkandvalidation
AT andresdiazpace measuringnarrativevisualizationsamodelbasedevaluationframeworkandvalidation