Image experience prediction for historic districts using a CNN-transformer fusion model
This study addresses key challenges in historic district planning and design: capturing the emotional value of streetscape images and integrating this into the design process. We developed a deep learning-based sentiment analysis system, employing CNN and transformer models to analyze emotional ten...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Slovenian Society for Stereology and Quantitative Image Analysis
2025-02-01
|
| Series: | Image Analysis and Stereology |
| Subjects: | |
| Online Access: | https://www.ias-iss.org/ojs/IAS/article/view/3361 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1823858111790710784 |
|---|---|
| author | Youping Teng Weijia Wang |
| author_facet | Youping Teng Weijia Wang |
| author_sort | Youping Teng |
| collection | DOAJ |
| description |
This study addresses key challenges in historic district planning and design: capturing the emotional value of streetscape images and integrating this into the design process. We developed a deep learning-based sentiment analysis system, employing CNN and transformer models to analyze emotional tendencies and temporal states in images. Using a multi-view feature extraction framework combining VGG, ResNet CNNs, and the Swin Transformer model, we created a novel feature matrix. An attention mechanism and transfer learning strategy enhanced model accuracy in label recognition and classification. Applying this system to Jiangnan Historic District, we demonstrated how understanding and applying emotional value can enhance district appeal. By identifying emotional tendencies in streetscape images, designers can make better-informed decisions, fostering positive experiences. Our analysis of images from 12 Jiangnan historic districts showed the system’s efficiency in aligning images with existing imaging libraries, providing valuable references and feedback. The results highlight the practical potential of deep learning in visual sentiment analysis and emphasize the importance of emotional value in improving experiences in historic districts. This study offers new insights and methodological support for planning and designing such areas.
|
| format | Article |
| id | doaj-art-40a7003a4b75496cad9cb093709004ca |
| institution | Kabale University |
| issn | 1580-3139 1854-5165 |
| language | English |
| publishDate | 2025-02-01 |
| publisher | Slovenian Society for Stereology and Quantitative Image Analysis |
| record_format | Article |
| series | Image Analysis and Stereology |
| spelling | doaj-art-40a7003a4b75496cad9cb093709004ca2025-02-11T14:22:23ZengSlovenian Society for Stereology and Quantitative Image AnalysisImage Analysis and Stereology1580-31391854-51652025-02-0110.5566/ias.3361Image experience prediction for historic districts using a CNN-transformer fusion modelYouping Teng0Weijia WangSchool of Art and Archaeology, Hangzhou City University This study addresses key challenges in historic district planning and design: capturing the emotional value of streetscape images and integrating this into the design process. We developed a deep learning-based sentiment analysis system, employing CNN and transformer models to analyze emotional tendencies and temporal states in images. Using a multi-view feature extraction framework combining VGG, ResNet CNNs, and the Swin Transformer model, we created a novel feature matrix. An attention mechanism and transfer learning strategy enhanced model accuracy in label recognition and classification. Applying this system to Jiangnan Historic District, we demonstrated how understanding and applying emotional value can enhance district appeal. By identifying emotional tendencies in streetscape images, designers can make better-informed decisions, fostering positive experiences. Our analysis of images from 12 Jiangnan historic districts showed the system’s efficiency in aligning images with existing imaging libraries, providing valuable references and feedback. The results highlight the practical potential of deep learning in visual sentiment analysis and emphasize the importance of emotional value in improving experiences in historic districts. This study offers new insights and methodological support for planning and designing such areas. https://www.ias-iss.org/ojs/IAS/article/view/3361historic districtssentiment analysis and evaluation systemconvolutional neural network (CNN)transformer model |
| spellingShingle | Youping Teng Weijia Wang Image experience prediction for historic districts using a CNN-transformer fusion model Image Analysis and Stereology historic districts sentiment analysis and evaluation system convolutional neural network (CNN) transformer model |
| title | Image experience prediction for historic districts using a CNN-transformer fusion model |
| title_full | Image experience prediction for historic districts using a CNN-transformer fusion model |
| title_fullStr | Image experience prediction for historic districts using a CNN-transformer fusion model |
| title_full_unstemmed | Image experience prediction for historic districts using a CNN-transformer fusion model |
| title_short | Image experience prediction for historic districts using a CNN-transformer fusion model |
| title_sort | image experience prediction for historic districts using a cnn transformer fusion model |
| topic | historic districts sentiment analysis and evaluation system convolutional neural network (CNN) transformer model |
| url | https://www.ias-iss.org/ojs/IAS/article/view/3361 |
| work_keys_str_mv | AT youpingteng imageexperiencepredictionforhistoricdistrictsusingacnntransformerfusionmodel AT weijiawang imageexperiencepredictionforhistoricdistrictsusingacnntransformerfusionmodel |