Affective-Computing-Driven Personalized Display of Cultural Information for Commercial Heritage Architecture

The display methods for traditional cultural heritage lack personalization and emotional interaction, making it difficult to stimulate the public’s deep cultural awareness. This is especially true in commercialized historical districts, where cultural value is easily overlooked. Balancing cultural v...

Full description

Saved in:
Bibliographic Details
Main Authors: Huimin Hu, Yaxin Wan, Khang Yeu Tang, Qingyue Li, Xiaohui Wang
Format: Article
Language:English
Published: MDPI AG 2025-03-01
Series:Applied Sciences
Subjects:
Online Access:https://www.mdpi.com/2076-3417/15/7/3459
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1849730923403149312
author Huimin Hu
Yaxin Wan
Khang Yeu Tang
Qingyue Li
Xiaohui Wang
author_facet Huimin Hu
Yaxin Wan
Khang Yeu Tang
Qingyue Li
Xiaohui Wang
author_sort Huimin Hu
collection DOAJ
description The display methods for traditional cultural heritage lack personalization and emotional interaction, making it difficult to stimulate the public’s deep cultural awareness. This is especially true in commercialized historical districts, where cultural value is easily overlooked. Balancing cultural value and commercial value in information display has become one of the challenges that needs to be addressed. To solve the above problems, this article focuses on the identification of deep cultural values and the optimization of the information display in Beijing’s Qianmen Street, proposing a framework for cultural information mining and display based on affective computing and large language models. The pre-trained models QwenLM and RoBERTa were employed to analyze text and image data from user-generated content on social media, identifying users’ emotional tendencies toward various cultural value dimensions and quantifying their multilayered understanding of architectural heritage. This study further constructed a multimodal information presentation model driven by emotional feedback, mapping it into virtual reality environments to enable personalized, multilayered cultural information visualization. The framework’s effectiveness was validated through an eye-tracking experiment that assessed how different presentation styles impacted users’ emotional engagement and cognitive outcomes. The results show that the affective computing and multimodal data fusion approach to cultural heritage presentation accurately captures users’ emotions, enhancing their interest and emotional involvement. Personalized presentations of information significantly improve users’ engagement, historical understanding, and cultural experience, thereby fostering a deeper comprehension of historical contexts and architectural details.
format Article
id doaj-art-df740dddc6604aebb0afdb28317f81f0
institution DOAJ
issn 2076-3417
language English
publishDate 2025-03-01
publisher MDPI AG
record_format Article
series Applied Sciences
spelling doaj-art-df740dddc6604aebb0afdb28317f81f02025-08-20T03:08:43ZengMDPI AGApplied Sciences2076-34172025-03-01157345910.3390/app15073459Affective-Computing-Driven Personalized Display of Cultural Information for Commercial Heritage ArchitectureHuimin Hu0Yaxin Wan1Khang Yeu Tang2Qingyue Li3Xiaohui Wang4School of Mechanical Engineering, University of Science and Technology Beijing, Beijing 100083, ChinaSchool of Mechanical Engineering, University of Science and Technology Beijing, Beijing 100083, ChinaDepartment of Physics, Tsinghua University, Beijing 100084, ChinaCreative Lab, Esri, 380 New York Street, Redlands, CA 92373, USASchool of Mechanical Engineering, University of Science and Technology Beijing, Beijing 100083, ChinaThe display methods for traditional cultural heritage lack personalization and emotional interaction, making it difficult to stimulate the public’s deep cultural awareness. This is especially true in commercialized historical districts, where cultural value is easily overlooked. Balancing cultural value and commercial value in information display has become one of the challenges that needs to be addressed. To solve the above problems, this article focuses on the identification of deep cultural values and the optimization of the information display in Beijing’s Qianmen Street, proposing a framework for cultural information mining and display based on affective computing and large language models. The pre-trained models QwenLM and RoBERTa were employed to analyze text and image data from user-generated content on social media, identifying users’ emotional tendencies toward various cultural value dimensions and quantifying their multilayered understanding of architectural heritage. This study further constructed a multimodal information presentation model driven by emotional feedback, mapping it into virtual reality environments to enable personalized, multilayered cultural information visualization. The framework’s effectiveness was validated through an eye-tracking experiment that assessed how different presentation styles impacted users’ emotional engagement and cognitive outcomes. The results show that the affective computing and multimodal data fusion approach to cultural heritage presentation accurately captures users’ emotions, enhancing their interest and emotional involvement. Personalized presentations of information significantly improve users’ engagement, historical understanding, and cultural experience, thereby fostering a deeper comprehension of historical contexts and architectural details.https://www.mdpi.com/2076-3417/15/7/3459affective computinglarge language modelmultimodal information fusionuser-generated contentinformation presentation
spellingShingle Huimin Hu
Yaxin Wan
Khang Yeu Tang
Qingyue Li
Xiaohui Wang
Affective-Computing-Driven Personalized Display of Cultural Information for Commercial Heritage Architecture
Applied Sciences
affective computing
large language model
multimodal information fusion
user-generated content
information presentation
title Affective-Computing-Driven Personalized Display of Cultural Information for Commercial Heritage Architecture
title_full Affective-Computing-Driven Personalized Display of Cultural Information for Commercial Heritage Architecture
title_fullStr Affective-Computing-Driven Personalized Display of Cultural Information for Commercial Heritage Architecture
title_full_unstemmed Affective-Computing-Driven Personalized Display of Cultural Information for Commercial Heritage Architecture
title_short Affective-Computing-Driven Personalized Display of Cultural Information for Commercial Heritage Architecture
title_sort affective computing driven personalized display of cultural information for commercial heritage architecture
topic affective computing
large language model
multimodal information fusion
user-generated content
information presentation
url https://www.mdpi.com/2076-3417/15/7/3459
work_keys_str_mv AT huiminhu affectivecomputingdrivenpersonalizeddisplayofculturalinformationforcommercialheritagearchitecture
AT yaxinwan affectivecomputingdrivenpersonalizeddisplayofculturalinformationforcommercialheritagearchitecture
AT khangyeutang affectivecomputingdrivenpersonalizeddisplayofculturalinformationforcommercialheritagearchitecture
AT qingyueli affectivecomputingdrivenpersonalizeddisplayofculturalinformationforcommercialheritagearchitecture
AT xiaohuiwang affectivecomputingdrivenpersonalizeddisplayofculturalinformationforcommercialheritagearchitecture