Measuring joint attention in co-creation through automatic human activity recognition

Within the broad context of design research, joint attention within co-creation represents a critical component, linking cognitive actors through dynamic interactions. This study introduces a novel approach employing deep learning algorithms to objectively quantify joint attention, offering a signif...

Full description

Saved in:
Bibliographic Details
Main Authors: Tao Shen, Yanyi Li, Yonqqi Lou, Chun Liu, Danwen Ji, Man Zhang, Ying Li
Format: Article
Language:English
Published: Cambridge University Press 2025-01-01
Series:Design Science
Subjects:
Online Access:https://www.cambridge.org/core/product/identifier/S2053470125100218/type/journal_article
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Within the broad context of design research, joint attention within co-creation represents a critical component, linking cognitive actors through dynamic interactions. This study introduces a novel approach employing deep learning algorithms to objectively quantify joint attention, offering a significant advancement over traditional subjective methods. We developed an optimized deep learning algorithm, YOLO-TP, to identify participants’ engagement in design workshops accurately. Our research methodology involved video recording of design workshops and subsequent analysis using the YOLO-TP algorithm to track and measure joint attention instances. Key findings demonstrate that the algorithm effectively quantifies joint attention with high reliability and correlates well with known measures of intersubjectivity and co-creation effectiveness. This approach not only provides a more objective measure of joint attention but also allows for the real-time analysis of collaborative interactions. The implications of this study are profound, suggesting that the integration of automated human activity recognition in co-creation can significantly enhance the understanding and facilitation of collaborative design processes, potentially leading to more effective design outcomes.
ISSN:2053-4701