Multi-Modal Social Media Analysis via SHAP-Based Explanation: A Framework for Public Art Perception

Jiangsu Province’s rapid urbanization presents unprecedented opportunities for examining evolving cultural landscapes through public art perception patterns. We propose a multi-modal framework integrating visual and linguistic analysis: visual content undergoes ResNet-152 feature extracti...

Full description

Saved in:
Bibliographic Details
Main Authors: Tianhao Guo, Zhengyang Lu, Feng Wang
Format: Article
Language:English
Published: IEEE 2025-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10964286/
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1850177509293817856
author Tianhao Guo
Zhengyang Lu
Feng Wang
author_facet Tianhao Guo
Zhengyang Lu
Feng Wang
author_sort Tianhao Guo
collection DOAJ
description Jiangsu Province’s rapid urbanization presents unprecedented opportunities for examining evolving cultural landscapes through public art perception patterns. We propose a multi-modal framework integrating visual and linguistic analysis: visual content undergoes ResNet-152 feature extraction and Qwen-7B-Chat captioning, while textual data is processed through hierarchical topic modeling and sentiment classification. Through analysis of 103,427 geo-tagged Weibo posts across thirteen administrative regions, this study employs fine-tuned Qwen-7B-Chat architecture integrated with spatial random forest modeling to decode urban-rural variations in artistic appreciation. The methodology reveals counterintuitive relationships between institutional density and cultural reception. Notably, technological firm concentration demonstrates negative correlation with digital art appreciation, while cultural venue density emerges as the dominant predictor for traditional art sentiment. Second-tier cities exhibit sophisticated hybrid indices, with Nantong and Changzhou developing balanced traditional-digital reception patterns independent of metropolitan centers. Educational attainment shows varying impacts across artistic modalities, suggesting differentiated mechanisms of cultural capital formation. These empirical patterns establish a polycentric model of cultural development where mid-sized urban centers cultivate autonomous artistic ecosystems characterized by distinctive institutional-technological configurations. The findings advance theoretical frameworks for understanding cultural diffusion in rapidly urbanizing regions while providing evidence-based recommendations for territorially-calibrated cultural policy implementation.
format Article
id doaj-art-79f16c4d41124589bc20d210b9e93879
institution OA Journals
issn 2169-3536
language English
publishDate 2025-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj-art-79f16c4d41124589bc20d210b9e938792025-08-20T02:18:58ZengIEEEIEEE Access2169-35362025-01-0113687536877210.1109/ACCESS.2025.356043310964286Multi-Modal Social Media Analysis via SHAP-Based Explanation: A Framework for Public Art PerceptionTianhao Guo0Zhengyang Lu1https://orcid.org/0000-0002-1540-0678Feng Wang2https://orcid.org/0009-0003-9217-5245School of Design, Jiangnan University, Wuxi, ChinaSchool of Design, Jiangnan University, Wuxi, ChinaSchool of Design, Jiangnan University, Wuxi, ChinaJiangsu Province’s rapid urbanization presents unprecedented opportunities for examining evolving cultural landscapes through public art perception patterns. We propose a multi-modal framework integrating visual and linguistic analysis: visual content undergoes ResNet-152 feature extraction and Qwen-7B-Chat captioning, while textual data is processed through hierarchical topic modeling and sentiment classification. Through analysis of 103,427 geo-tagged Weibo posts across thirteen administrative regions, this study employs fine-tuned Qwen-7B-Chat architecture integrated with spatial random forest modeling to decode urban-rural variations in artistic appreciation. The methodology reveals counterintuitive relationships between institutional density and cultural reception. Notably, technological firm concentration demonstrates negative correlation with digital art appreciation, while cultural venue density emerges as the dominant predictor for traditional art sentiment. Second-tier cities exhibit sophisticated hybrid indices, with Nantong and Changzhou developing balanced traditional-digital reception patterns independent of metropolitan centers. Educational attainment shows varying impacts across artistic modalities, suggesting differentiated mechanisms of cultural capital formation. These empirical patterns establish a polycentric model of cultural development where mid-sized urban centers cultivate autonomous artistic ecosystems characterized by distinctive institutional-technological configurations. The findings advance theoretical frameworks for understanding cultural diffusion in rapidly urbanizing regions while providing evidence-based recommendations for territorially-calibrated cultural policy implementation.https://ieeexplore.ieee.org/document/10964286/Social media perceptionmulti-modal analysisurban cultural development
spellingShingle Tianhao Guo
Zhengyang Lu
Feng Wang
Multi-Modal Social Media Analysis via SHAP-Based Explanation: A Framework for Public Art Perception
IEEE Access
Social media perception
multi-modal analysis
urban cultural development
title Multi-Modal Social Media Analysis via SHAP-Based Explanation: A Framework for Public Art Perception
title_full Multi-Modal Social Media Analysis via SHAP-Based Explanation: A Framework for Public Art Perception
title_fullStr Multi-Modal Social Media Analysis via SHAP-Based Explanation: A Framework for Public Art Perception
title_full_unstemmed Multi-Modal Social Media Analysis via SHAP-Based Explanation: A Framework for Public Art Perception
title_short Multi-Modal Social Media Analysis via SHAP-Based Explanation: A Framework for Public Art Perception
title_sort multi modal social media analysis via shap based explanation a framework for public art perception
topic Social media perception
multi-modal analysis
urban cultural development
url https://ieeexplore.ieee.org/document/10964286/
work_keys_str_mv AT tianhaoguo multimodalsocialmediaanalysisviashapbasedexplanationaframeworkforpublicartperception
AT zhengyanglu multimodalsocialmediaanalysisviashapbasedexplanationaframeworkforpublicartperception
AT fengwang multimodalsocialmediaanalysisviashapbasedexplanationaframeworkforpublicartperception