Analyzing the applicability of psychometric QoE modeling for projection-based point cloud video quality assessment

Abstract Point cloud video delivery will be an important part of future immersive multimedia. In it, objects represented as sets of points are embedded within a video which is streamed and displayed to remote users. This opens possibilities towards remote presence scenarios such as tele-conferencing...

Full description

Saved in:
Bibliographic Details
Main Authors: Sam Van Damme, Jeroen van der Hooft, Filip De Turck, Maria Torres Vega
Format: Article
Language:English
Published: SpringerOpen 2024-11-01
Series:EURASIP Journal on Image and Video Processing
Subjects:
Online Access:https://doi.org/10.1186/s13640-024-00655-y
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1849221033180004352
author Sam Van Damme
Jeroen van der Hooft
Filip De Turck
Maria Torres Vega
author_facet Sam Van Damme
Jeroen van der Hooft
Filip De Turck
Maria Torres Vega
author_sort Sam Van Damme
collection DOAJ
description Abstract Point cloud video delivery will be an important part of future immersive multimedia. In it, objects represented as sets of points are embedded within a video which is streamed and displayed to remote users. This opens possibilities towards remote presence scenarios such as tele-conferencing, remote education and virtual training. Due to its infeasibly high bandwidth requirements, encoding is unavoidable. The introduced artifacts and network degradations can have an important but unpredictable impact on the end-user’s Quality of Experience (QoE). Thus, real-time quality monitoring and prediction mechanisms are key to allow for fast countermeasures in case of QoE decrease. Since current state-of-the-art research is focusing on either continuous QoE monitoring of traditional video streaming services or objective delivery optimizations of point cloud content without any QoE validation, we believe this work brings a valuable contribution to current literature. Therefore, we present a no-reference (NR) QoE model, consisting of KMeans clustering and sigmoidal mapping, that works on video-level, group-of-pictures (GOP)-level and frame-level granularity. Results show the value of the sigmoidal mapping across all granularity levels. The clustering algorithm shows its value at the video-level and in the role of an outlier detector on the more fine-grained levels. Satisfying results are yet obtained with correlation values often going above 0.700 on GOP- and frame-level while maintaining root mean squared error (RMSE) below 10 on a 0–100 scale. In addition, a Command Line Interface (CLI) Video Metric Tool is presented that allows for easy and modular calculation of NR metrics on a given video.
format Article
id doaj-art-d2aedb71db2147f58245c2bbfc46e7c3
institution Kabale University
issn 1687-5281
language English
publishDate 2024-11-01
publisher SpringerOpen
record_format Article
series EURASIP Journal on Image and Video Processing
spelling doaj-art-d2aedb71db2147f58245c2bbfc46e7c32024-11-24T12:38:56ZengSpringerOpenEURASIP Journal on Image and Video Processing1687-52812024-11-012024114210.1186/s13640-024-00655-yAnalyzing the applicability of psychometric QoE modeling for projection-based point cloud video quality assessmentSam Van Damme0Jeroen van der Hooft1Filip De Turck2Maria Torres Vega3IDLab, Department of Information Technology (INTEC), Ghent University - imecIDLab, Department of Information Technology (INTEC), Ghent University - imecIDLab, Department of Information Technology (INTEC), Ghent University - imeceMedia Research Lab, Department of Electrical Engineering (ESAT), KU LeuvenAbstract Point cloud video delivery will be an important part of future immersive multimedia. In it, objects represented as sets of points are embedded within a video which is streamed and displayed to remote users. This opens possibilities towards remote presence scenarios such as tele-conferencing, remote education and virtual training. Due to its infeasibly high bandwidth requirements, encoding is unavoidable. The introduced artifacts and network degradations can have an important but unpredictable impact on the end-user’s Quality of Experience (QoE). Thus, real-time quality monitoring and prediction mechanisms are key to allow for fast countermeasures in case of QoE decrease. Since current state-of-the-art research is focusing on either continuous QoE monitoring of traditional video streaming services or objective delivery optimizations of point cloud content without any QoE validation, we believe this work brings a valuable contribution to current literature. Therefore, we present a no-reference (NR) QoE model, consisting of KMeans clustering and sigmoidal mapping, that works on video-level, group-of-pictures (GOP)-level and frame-level granularity. Results show the value of the sigmoidal mapping across all granularity levels. The clustering algorithm shows its value at the video-level and in the role of an outlier detector on the more fine-grained levels. Satisfying results are yet obtained with correlation values often going above 0.700 on GOP- and frame-level while maintaining root mean squared error (RMSE) below 10 on a 0–100 scale. In addition, a Command Line Interface (CLI) Video Metric Tool is presented that allows for easy and modular calculation of NR metrics on a given video.https://doi.org/10.1186/s13640-024-00655-yPoint cloud videoQuality-of-ExperienceNo ReferenceNear-continuous modelingVideo Metric Tool
spellingShingle Sam Van Damme
Jeroen van der Hooft
Filip De Turck
Maria Torres Vega
Analyzing the applicability of psychometric QoE modeling for projection-based point cloud video quality assessment
EURASIP Journal on Image and Video Processing
Point cloud video
Quality-of-Experience
No Reference
Near-continuous modeling
Video Metric Tool
title Analyzing the applicability of psychometric QoE modeling for projection-based point cloud video quality assessment
title_full Analyzing the applicability of psychometric QoE modeling for projection-based point cloud video quality assessment
title_fullStr Analyzing the applicability of psychometric QoE modeling for projection-based point cloud video quality assessment
title_full_unstemmed Analyzing the applicability of psychometric QoE modeling for projection-based point cloud video quality assessment
title_short Analyzing the applicability of psychometric QoE modeling for projection-based point cloud video quality assessment
title_sort analyzing the applicability of psychometric qoe modeling for projection based point cloud video quality assessment
topic Point cloud video
Quality-of-Experience
No Reference
Near-continuous modeling
Video Metric Tool
url https://doi.org/10.1186/s13640-024-00655-y
work_keys_str_mv AT samvandamme analyzingtheapplicabilityofpsychometricqoemodelingforprojectionbasedpointcloudvideoqualityassessment
AT jeroenvanderhooft analyzingtheapplicabilityofpsychometricqoemodelingforprojectionbasedpointcloudvideoqualityassessment
AT filipdeturck analyzingtheapplicabilityofpsychometricqoemodelingforprojectionbasedpointcloudvideoqualityassessment
AT mariatorresvega analyzingtheapplicabilityofpsychometricqoemodelingforprojectionbasedpointcloudvideoqualityassessment