AI- and AR-Assisted 3D Reactivation of Characters in Paintings
Ancient paintings are an intangible window to the economy, politics, and customs of the past. Their characteristics have evolved or were made obsolete, with only limited contemporary connections remaining. This research aims to preserve and to interact with characters in 2D paintings to evolve their...
Saved in:
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2025-06-01
|
| Series: | Heritage |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2571-9408/8/6/207 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849433701720522752 |
|---|---|
| author | Naai-Jung Shih |
| author_facet | Naai-Jung Shih |
| author_sort | Naai-Jung Shih |
| collection | DOAJ |
| description | Ancient paintings are an intangible window to the economy, politics, and customs of the past. Their characteristics have evolved or were made obsolete, with only limited contemporary connections remaining. This research aims to preserve and to interact with characters in 2D paintings to evolve their cultural identity through combining AI and AR. The scope of this research covers traditional Chinese paintings archived by the National Palace Museum in digital collections, mainly “<i>New Year’s Market in a Time of Peace</i>”. About 25 characters were used for training and 3D reconstruction in RODIN<sup>®</sup>. The models were converted into Augment<sup>®</sup> and Sketchfab<sup>®</sup> platforms as reactivated AR characters to interact with new urban fabrics and landscapes. Stable Diffusion<sup>®</sup> and RODIN<sup>®</sup> were successfully integrated to perform image training and reconstruct 3D AR models of various styles. As a result, interactions were conducted in two ways: in a mixed context with mixed characters in a painting and in a familiar context in the real world with mixed characters. It was found that AR facilitated the interpretation of how the old urban fabric was arranged. Using AI and AR is a current issue. Combining AI and AR can activate ubiquitous preservation to perform recursive processing from diffused images in order to reconstruct 3D models. This activated heritage preservation method is a reasonable alternative to redefining intangible subjects with a new and evolved contemporary cultural identity. |
| format | Article |
| id | doaj-art-95b693aae3024180bb1e48c8bafeac71 |
| institution | Kabale University |
| issn | 2571-9408 |
| language | English |
| publishDate | 2025-06-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Heritage |
| spelling | doaj-art-95b693aae3024180bb1e48c8bafeac712025-08-20T03:26:56ZengMDPI AGHeritage2571-94082025-06-018620710.3390/heritage8060207AI- and AR-Assisted 3D Reactivation of Characters in PaintingsNaai-Jung Shih0Department of Architecture, National Taiwan University of Science and Technology, 43, Section 4, Keelung Road, Taipei 106, TaiwanAncient paintings are an intangible window to the economy, politics, and customs of the past. Their characteristics have evolved or were made obsolete, with only limited contemporary connections remaining. This research aims to preserve and to interact with characters in 2D paintings to evolve their cultural identity through combining AI and AR. The scope of this research covers traditional Chinese paintings archived by the National Palace Museum in digital collections, mainly “<i>New Year’s Market in a Time of Peace</i>”. About 25 characters were used for training and 3D reconstruction in RODIN<sup>®</sup>. The models were converted into Augment<sup>®</sup> and Sketchfab<sup>®</sup> platforms as reactivated AR characters to interact with new urban fabrics and landscapes. Stable Diffusion<sup>®</sup> and RODIN<sup>®</sup> were successfully integrated to perform image training and reconstruct 3D AR models of various styles. As a result, interactions were conducted in two ways: in a mixed context with mixed characters in a painting and in a familiar context in the real world with mixed characters. It was found that AR facilitated the interpretation of how the old urban fabric was arranged. Using AI and AR is a current issue. Combining AI and AR can activate ubiquitous preservation to perform recursive processing from diffused images in order to reconstruct 3D models. This activated heritage preservation method is a reasonable alternative to redefining intangible subjects with a new and evolved contemporary cultural identity.https://www.mdpi.com/2571-9408/8/6/207AIARRODIN<sup>®</sup>charactersheritagepreservation |
| spellingShingle | Naai-Jung Shih AI- and AR-Assisted 3D Reactivation of Characters in Paintings Heritage AI AR RODIN<sup>®</sup> characters heritage preservation |
| title | AI- and AR-Assisted 3D Reactivation of Characters in Paintings |
| title_full | AI- and AR-Assisted 3D Reactivation of Characters in Paintings |
| title_fullStr | AI- and AR-Assisted 3D Reactivation of Characters in Paintings |
| title_full_unstemmed | AI- and AR-Assisted 3D Reactivation of Characters in Paintings |
| title_short | AI- and AR-Assisted 3D Reactivation of Characters in Paintings |
| title_sort | ai and ar assisted 3d reactivation of characters in paintings |
| topic | AI AR RODIN<sup>®</sup> characters heritage preservation |
| url | https://www.mdpi.com/2571-9408/8/6/207 |
| work_keys_str_mv | AT naaijungshih aiandarassisted3dreactivationofcharactersinpaintings |