Comparing Perceptual Visual Quality of Hybrid Neural and Ray Tracing in Foveated Rendering

Enabling Foveated Rendering for VR devices displays is fundamental when dealing with real-time ray tracing. Combining traditional methods with Neural based strategies, such as NeRFs and 3D Gaussian Splatting, may impact on leveraging performance even more. In this work we enhance and validate how w...

Full description

Saved in:
Bibliographic Details
Main Authors: Horácio Henriques, Alan de Oliveira, Eder Oliveira, Esteban Clua, Daniela Trevisan
Format: Article
Language:English
Published: Brazilian Computer Society 2025-05-01
Series:Journal on Interactive Systems
Subjects:
Online Access:https://journals-sol.sbc.org.br/index.php/jis/article/view/5593
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1849327787242946560
author Horácio Henriques
Alan de Oliveira
Eder Oliveira
Esteban Clua
Daniela Trevisan
author_facet Horácio Henriques
Alan de Oliveira
Eder Oliveira
Esteban Clua
Daniela Trevisan
author_sort Horácio Henriques
collection DOAJ
description Enabling Foveated Rendering for VR devices displays is fundamental when dealing with real-time ray tracing. Combining traditional methods with Neural based strategies, such as NeRFs and 3D Gaussian Splatting, may impact on leveraging performance even more. In this work we enhance and validate how well our traditional Instant-NeRF reconstructs common ray-traced effects through user metrics and quality metrics. We also show that 3D Gaussian Splatting used in the periphery vision area presents better results than the perceptual quality achieved through NeRFs. We present a deep human perception experiment through different global illumination light effects.
format Article
id doaj-art-e18775b0ee0d429ab80b41e4b7586710
institution Kabale University
issn 2763-7719
language English
publishDate 2025-05-01
publisher Brazilian Computer Society
record_format Article
series Journal on Interactive Systems
spelling doaj-art-e18775b0ee0d429ab80b41e4b75867102025-08-20T03:47:45ZengBrazilian Computer SocietyJournal on Interactive Systems2763-77192025-05-0116110.5753/jis.2025.5593Comparing Perceptual Visual Quality of Hybrid Neural and Ray Tracing in Foveated RenderingHorácio Henriques0Alan de Oliveira1Eder Oliveira2Esteban Clua3Daniela Trevisan4Fluminense Federal UniversityFederal Institute of Education, Science and Technology of RondoniaFluminense Federal UniversityFluminense Federal UniversityFluminense Federal University Enabling Foveated Rendering for VR devices displays is fundamental when dealing with real-time ray tracing. Combining traditional methods with Neural based strategies, such as NeRFs and 3D Gaussian Splatting, may impact on leveraging performance even more. In this work we enhance and validate how well our traditional Instant-NeRF reconstructs common ray-traced effects through user metrics and quality metrics. We also show that 3D Gaussian Splatting used in the periphery vision area presents better results than the perceptual quality achieved through NeRFs. We present a deep human perception experiment through different global illumination light effects. https://journals-sol.sbc.org.br/index.php/jis/article/view/5593Virtual RealityFoveated RenderingPerception-based RenderingRay TracingNeRF3D Gaussian Splatting
spellingShingle Horácio Henriques
Alan de Oliveira
Eder Oliveira
Esteban Clua
Daniela Trevisan
Comparing Perceptual Visual Quality of Hybrid Neural and Ray Tracing in Foveated Rendering
Journal on Interactive Systems
Virtual Reality
Foveated Rendering
Perception-based Rendering
Ray Tracing
NeRF
3D Gaussian Splatting
title Comparing Perceptual Visual Quality of Hybrid Neural and Ray Tracing in Foveated Rendering
title_full Comparing Perceptual Visual Quality of Hybrid Neural and Ray Tracing in Foveated Rendering
title_fullStr Comparing Perceptual Visual Quality of Hybrid Neural and Ray Tracing in Foveated Rendering
title_full_unstemmed Comparing Perceptual Visual Quality of Hybrid Neural and Ray Tracing in Foveated Rendering
title_short Comparing Perceptual Visual Quality of Hybrid Neural and Ray Tracing in Foveated Rendering
title_sort comparing perceptual visual quality of hybrid neural and ray tracing in foveated rendering
topic Virtual Reality
Foveated Rendering
Perception-based Rendering
Ray Tracing
NeRF
3D Gaussian Splatting
url https://journals-sol.sbc.org.br/index.php/jis/article/view/5593
work_keys_str_mv AT horaciohenriques comparingperceptualvisualqualityofhybridneuralandraytracinginfoveatedrendering
AT alandeoliveira comparingperceptualvisualqualityofhybridneuralandraytracinginfoveatedrendering
AT ederoliveira comparingperceptualvisualqualityofhybridneuralandraytracinginfoveatedrendering
AT estebanclua comparingperceptualvisualqualityofhybridneuralandraytracinginfoveatedrendering
AT danielatrevisan comparingperceptualvisualqualityofhybridneuralandraytracinginfoveatedrendering