Design of an Integrated Model Combining CycleGAN, PPO, and Vision Transformer for Adaptive Scene Rendering in the Metaverse
The emergence of the metaverse demands adaptive rendering systems that produce high-quality scenes, balancing the dimensions of visual fidelity with computational efficiency. Methods used for scene generation and rendering usually fail to incorporate user interactions in real time, leading to resour...
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2025-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10848107/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832540572530769920 |
|---|---|
| author | Durga Prasad Kavadi Kailash Chandra Mishra Sai Babu Veesam Mudimela Madhusudhan Palacharla Ravi Kumar Pannangi Naresh Yuvaraju Chinnam |
| author_facet | Durga Prasad Kavadi Kailash Chandra Mishra Sai Babu Veesam Mudimela Madhusudhan Palacharla Ravi Kumar Pannangi Naresh Yuvaraju Chinnam |
| author_sort | Durga Prasad Kavadi |
| collection | DOAJ |
| description | The emergence of the metaverse demands adaptive rendering systems that produce high-quality scenes, balancing the dimensions of visual fidelity with computational efficiency. Methods used for scene generation and rendering usually fail to incorporate user interactions in real time, leading to resource inefficiency and reduced user experience. This paper proposes a new, all-in-one model that integrates CycleGAN, Proximal Policy Optimization (PPO), Vision Transformer (ViT), Bootstrap Your Own Latent (BYOL), and Adaptive Feedback Learning (AFL-RT) in an attempt at dynamic optimization of the scene rendering based on user behavior and environmental data. The CycleGAN module ensures the production of the high-resolution scenes even from low-resolution inputs, whereas PPO provides for continuous adaptation of rendering parameters so as to reduce latency and computational load. ViT uses attention-based rendering, providing better visualization to user-centric areas, and BYOL does self-supervised scene understanding and compression, maintaining important information though reducing the bandwidth usage. AFL-RT is actually a closed-loop feedback system used to refine rendering parameters in real-time by actually reflecting the user’s preference and interests. Experimental results demonstrate that the proposed model reduces latency by as much as 30% in rendering, improves visual fidelity by up to 15%, and decreases energy consumption by 25% compared with the baseline methods. The user satisfaction also increases up to 25% regarding real-time adaptations by using this model, which only validates the practicality of such a model for dynamic, interactive metaverse environments. This work offers a comprehensive solution to the challenges of adaptive scene rendering, thus highly applicable to future metaverse applications in almost all industries and scenarios. |
| format | Article |
| id | doaj-art-f9a8aa43d1f5423e97b0eb31239d83e3 |
| institution | Kabale University |
| issn | 2169-3536 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj-art-f9a8aa43d1f5423e97b0eb31239d83e32025-02-05T00:00:56ZengIEEEIEEE Access2169-35362025-01-0113211172113810.1109/ACCESS.2025.353232710848107Design of an Integrated Model Combining CycleGAN, PPO, and Vision Transformer for Adaptive Scene Rendering in the MetaverseDurga Prasad Kavadi0https://orcid.org/0000-0003-2823-8478Kailash Chandra Mishra1https://orcid.org/0000-0003-4967-3938Sai Babu Veesam2https://orcid.org/0009-0000-5473-4681Mudimela Madhusudhan3Palacharla Ravi Kumar4Pannangi Naresh5https://orcid.org/0000-0003-2932-6699Yuvaraju Chinnam6https://orcid.org/0000-0002-7156-2452Department of Computer Science and Engineering-AI&ML, DRK Institute of Science and Technology, Hyderabad, Telangana, IndiaSchool of Computer Science and Engineering, VIT-AP University, Amaravathi, IndiaSchool of Computer Science and Engineering, VIT-AP University, Amaravathi, IndiaDepartment of Computer Science and Engineering, CMR Technical Campus, Hyderabad, Telangana, IndiaDepartment of Artificial Intelligence and Machine Learning, RVR & JC College of Engineering, Guntur, Andhra Pradesh, IndiaDepartment of Computer Science and Engineering, Dayananda Sagar University, Bengaluru, IndiaDepartment of Computer Science and Engineering, St. Peter’s Engineering College, Hyderabad, Telangana, IndiaThe emergence of the metaverse demands adaptive rendering systems that produce high-quality scenes, balancing the dimensions of visual fidelity with computational efficiency. Methods used for scene generation and rendering usually fail to incorporate user interactions in real time, leading to resource inefficiency and reduced user experience. This paper proposes a new, all-in-one model that integrates CycleGAN, Proximal Policy Optimization (PPO), Vision Transformer (ViT), Bootstrap Your Own Latent (BYOL), and Adaptive Feedback Learning (AFL-RT) in an attempt at dynamic optimization of the scene rendering based on user behavior and environmental data. The CycleGAN module ensures the production of the high-resolution scenes even from low-resolution inputs, whereas PPO provides for continuous adaptation of rendering parameters so as to reduce latency and computational load. ViT uses attention-based rendering, providing better visualization to user-centric areas, and BYOL does self-supervised scene understanding and compression, maintaining important information though reducing the bandwidth usage. AFL-RT is actually a closed-loop feedback system used to refine rendering parameters in real-time by actually reflecting the user’s preference and interests. Experimental results demonstrate that the proposed model reduces latency by as much as 30% in rendering, improves visual fidelity by up to 15%, and decreases energy consumption by 25% compared with the baseline methods. The user satisfaction also increases up to 25% regarding real-time adaptations by using this model, which only validates the practicality of such a model for dynamic, interactive metaverse environments. This work offers a comprehensive solution to the challenges of adaptive scene rendering, thus highly applicable to future metaverse applications in almost all industries and scenarios.https://ieeexplore.ieee.org/document/10848107/Adaptive renderingmetaverseCycleGANproximal policy optimizationvision transformer |
| spellingShingle | Durga Prasad Kavadi Kailash Chandra Mishra Sai Babu Veesam Mudimela Madhusudhan Palacharla Ravi Kumar Pannangi Naresh Yuvaraju Chinnam Design of an Integrated Model Combining CycleGAN, PPO, and Vision Transformer for Adaptive Scene Rendering in the Metaverse IEEE Access Adaptive rendering metaverse CycleGAN proximal policy optimization vision transformer |
| title | Design of an Integrated Model Combining CycleGAN, PPO, and Vision Transformer for Adaptive Scene Rendering in the Metaverse |
| title_full | Design of an Integrated Model Combining CycleGAN, PPO, and Vision Transformer for Adaptive Scene Rendering in the Metaverse |
| title_fullStr | Design of an Integrated Model Combining CycleGAN, PPO, and Vision Transformer for Adaptive Scene Rendering in the Metaverse |
| title_full_unstemmed | Design of an Integrated Model Combining CycleGAN, PPO, and Vision Transformer for Adaptive Scene Rendering in the Metaverse |
| title_short | Design of an Integrated Model Combining CycleGAN, PPO, and Vision Transformer for Adaptive Scene Rendering in the Metaverse |
| title_sort | design of an integrated model combining cyclegan ppo and vision transformer for adaptive scene rendering in the metaverse |
| topic | Adaptive rendering metaverse CycleGAN proximal policy optimization vision transformer |
| url | https://ieeexplore.ieee.org/document/10848107/ |
| work_keys_str_mv | AT durgaprasadkavadi designofanintegratedmodelcombiningcycleganppoandvisiontransformerforadaptivescenerenderinginthemetaverse AT kailashchandramishra designofanintegratedmodelcombiningcycleganppoandvisiontransformerforadaptivescenerenderinginthemetaverse AT saibabuveesam designofanintegratedmodelcombiningcycleganppoandvisiontransformerforadaptivescenerenderinginthemetaverse AT mudimelamadhusudhan designofanintegratedmodelcombiningcycleganppoandvisiontransformerforadaptivescenerenderinginthemetaverse AT palacharlaravikumar designofanintegratedmodelcombiningcycleganppoandvisiontransformerforadaptivescenerenderinginthemetaverse AT pannanginaresh designofanintegratedmodelcombiningcycleganppoandvisiontransformerforadaptivescenerenderinginthemetaverse AT yuvarajuchinnam designofanintegratedmodelcombiningcycleganppoandvisiontransformerforadaptivescenerenderinginthemetaverse |