Enhancing Visual Perception in Immersive VR and AR Environments: AI-Driven Color and Clarity Adjustments Under Dynamic Lighting Conditions

The visual fidelity of virtual reality (VR) and augmented reality (AR) environments is essential for user immersion and comfort. Dynamic lighting often leads to chromatic distortions and reduced clarity, causing discomfort and disrupting user experience. This paper introduces an AI-driven chromatic...

Full description

Saved in:
Bibliographic Details
Main Authors: Maryam Abbasi, Paulo Váz, José Silva, Pedro Martins
Format: Article
Language:English
Published: MDPI AG 2024-11-01
Series:Technologies
Subjects:
Online Access:https://www.mdpi.com/2227-7080/12/11/216
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1850147079850033152
author Maryam Abbasi
Paulo Váz
José Silva
Pedro Martins
author_facet Maryam Abbasi
Paulo Váz
José Silva
Pedro Martins
author_sort Maryam Abbasi
collection DOAJ
description The visual fidelity of virtual reality (VR) and augmented reality (AR) environments is essential for user immersion and comfort. Dynamic lighting often leads to chromatic distortions and reduced clarity, causing discomfort and disrupting user experience. This paper introduces an AI-driven chromatic adjustment system based on a modified U-Net architecture, optimized for real-time applications in VR/AR. This system adapts to dynamic lighting conditions, addressing the shortcomings of traditional methods like histogram equalization and gamma correction, which struggle with rapid lighting changes and real-time user interactions. We compared our approach with state-of-the-art color constancy algorithms, including Barron’s Convolutional Color Constancy and STAR, demonstrating superior performance. Experimental results from 60 participants show significant improvements, with up to 41% better color accuracy and 39% enhanced clarity under dynamic lighting conditions. The study also included eye-tracking data, which confirmed increased user engagement with AI-enhanced images. Our system provides a practical solution for developers aiming to improve image quality, reduce visual discomfort, and enhance overall user satisfaction in immersive environments. Future work will focus on extending the model’s capability to handle more complex lighting scenarios.
format Article
id doaj-art-58759604fadf4054b58d213c6f3ea04b
institution OA Journals
issn 2227-7080
language English
publishDate 2024-11-01
publisher MDPI AG
record_format Article
series Technologies
spelling doaj-art-58759604fadf4054b58d213c6f3ea04b2025-08-20T02:27:39ZengMDPI AGTechnologies2227-70802024-11-01121121610.3390/technologies12110216Enhancing Visual Perception in Immersive VR and AR Environments: AI-Driven Color and Clarity Adjustments Under Dynamic Lighting ConditionsMaryam Abbasi0Paulo Váz1José Silva2Pedro Martins3Applied Research Institute, Polytechnic of Coimbra, 3045-093 Coimbra, PortugalResearch Center in Digital Services (CISeD), Polytechnic of Viseu, 3504-510 Viseu, PortugalResearch Center in Digital Services (CISeD), Polytechnic of Viseu, 3504-510 Viseu, PortugalResearch Center in Digital Services (CISeD), Polytechnic of Viseu, 3504-510 Viseu, PortugalThe visual fidelity of virtual reality (VR) and augmented reality (AR) environments is essential for user immersion and comfort. Dynamic lighting often leads to chromatic distortions and reduced clarity, causing discomfort and disrupting user experience. This paper introduces an AI-driven chromatic adjustment system based on a modified U-Net architecture, optimized for real-time applications in VR/AR. This system adapts to dynamic lighting conditions, addressing the shortcomings of traditional methods like histogram equalization and gamma correction, which struggle with rapid lighting changes and real-time user interactions. We compared our approach with state-of-the-art color constancy algorithms, including Barron’s Convolutional Color Constancy and STAR, demonstrating superior performance. Experimental results from 60 participants show significant improvements, with up to 41% better color accuracy and 39% enhanced clarity under dynamic lighting conditions. The study also included eye-tracking data, which confirmed increased user engagement with AI-enhanced images. Our system provides a practical solution for developers aiming to improve image quality, reduce visual discomfort, and enhance overall user satisfaction in immersive environments. Future work will focus on extending the model’s capability to handle more complex lighting scenarios.https://www.mdpi.com/2227-7080/12/11/216AI-driven image enhancementvirtual realityaugmented realityimage qualitydeep learninglighting conditions
spellingShingle Maryam Abbasi
Paulo Váz
José Silva
Pedro Martins
Enhancing Visual Perception in Immersive VR and AR Environments: AI-Driven Color and Clarity Adjustments Under Dynamic Lighting Conditions
Technologies
AI-driven image enhancement
virtual reality
augmented reality
image quality
deep learning
lighting conditions
title Enhancing Visual Perception in Immersive VR and AR Environments: AI-Driven Color and Clarity Adjustments Under Dynamic Lighting Conditions
title_full Enhancing Visual Perception in Immersive VR and AR Environments: AI-Driven Color and Clarity Adjustments Under Dynamic Lighting Conditions
title_fullStr Enhancing Visual Perception in Immersive VR and AR Environments: AI-Driven Color and Clarity Adjustments Under Dynamic Lighting Conditions
title_full_unstemmed Enhancing Visual Perception in Immersive VR and AR Environments: AI-Driven Color and Clarity Adjustments Under Dynamic Lighting Conditions
title_short Enhancing Visual Perception in Immersive VR and AR Environments: AI-Driven Color and Clarity Adjustments Under Dynamic Lighting Conditions
title_sort enhancing visual perception in immersive vr and ar environments ai driven color and clarity adjustments under dynamic lighting conditions
topic AI-driven image enhancement
virtual reality
augmented reality
image quality
deep learning
lighting conditions
url https://www.mdpi.com/2227-7080/12/11/216
work_keys_str_mv AT maryamabbasi enhancingvisualperceptioninimmersivevrandarenvironmentsaidrivencolorandclarityadjustmentsunderdynamiclightingconditions
AT paulovaz enhancingvisualperceptioninimmersivevrandarenvironmentsaidrivencolorandclarityadjustmentsunderdynamiclightingconditions
AT josesilva enhancingvisualperceptioninimmersivevrandarenvironmentsaidrivencolorandclarityadjustmentsunderdynamiclightingconditions
AT pedromartins enhancingvisualperceptioninimmersivevrandarenvironmentsaidrivencolorandclarityadjustmentsunderdynamiclightingconditions