Hierarchical QAM and Inter-Layer FEC for Multi-View Video Plus Depth Format in Two-Way Relay Channels
This paper presents an enhanced method for the transmission of 3D video in the Multi-view Video plus Depth (MVD) format over Two-Way Relay Channels (TWRC). Our approach addresses the unique challenges of MVD-based 3D video by combining Hierarchical Quadrature Amplitude Modulation (HQAM), a method th...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2024-09-01
|
| Series: | Applied Sciences |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2076-3417/14/19/8741 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850283693621379072 |
|---|---|
| author | Dongho You Sung-Hoon Kim Dong Ho Kim |
| author_facet | Dongho You Sung-Hoon Kim Dong Ho Kim |
| author_sort | Dongho You |
| collection | DOAJ |
| description | This paper presents an enhanced method for the transmission of 3D video in the Multi-view Video plus Depth (MVD) format over Two-Way Relay Channels (TWRC). Our approach addresses the unique challenges of MVD-based 3D video by combining Hierarchical Quadrature Amplitude Modulation (HQAM), a method that prioritizes data layers based on importance, and Inter-Layer Forward Error Correction (IL-FEC), which protects critical data from errors. These are specifically designed to handle the dual-layer data structure where color data and depth information require different levels of error protection, and it reduces transmission errors and enhances the quality of MVD-based 3D video over TWRC. In the TWRC scenario, the proposed scheme optimizes transmission by reducing the number of relayed bitstreams by half while maintaining high-quality requirements, as demonstrated by significant improvements in the Structural Similarity Index (SSIM) for virtually synthesized views. Furthermore, we identify and optimize the hierarchical modulation parameter (<inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><mi>α</mi></semantics></math></inline-formula>), which controls the priority and protection levels of different data streams. Systematically varying <inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><mi>α</mi></semantics></math></inline-formula> reveals its substantial impact on the quality of the reconstructed 3D video, as measured by SSIM. Our results demonstrate that the proposed combination of HQAM and IL-FEC not only maintains the target SSIM of 0.9 for the virtually synthesized view under various relay conditions but also reveals the optimal <inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><mi>α</mi></semantics></math></inline-formula> value for balancing the error protection between the color and depth map data streams. Notably, while increasing <inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><mi>α</mi></semantics></math></inline-formula> enhances the protection of critical data (such as color video streams), it may concurrently degrade the quality of less important streams (like depth maps), highlighting the importance of fine-tuning <inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><mi>α</mi></semantics></math></inline-formula> to achieve the best overall video quality. These findings suggest that our method provides a flexible and effective solution for high-quality 3D video transmission in challenging communication environments, potentially advancing the development of future 3D video delivery systems. |
| format | Article |
| id | doaj-art-b88fcbdda46f407982c5408e9c31cd3e |
| institution | OA Journals |
| issn | 2076-3417 |
| language | English |
| publishDate | 2024-09-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Applied Sciences |
| spelling | doaj-art-b88fcbdda46f407982c5408e9c31cd3e2025-08-20T01:47:44ZengMDPI AGApplied Sciences2076-34172024-09-011419874110.3390/app14198741Hierarchical QAM and Inter-Layer FEC for Multi-View Video Plus Depth Format in Two-Way Relay ChannelsDongho You0Sung-Hoon Kim1Dong Ho Kim2Department of Information and Communication Engineering, Hannam University, Daejeon 34430, Republic of KoreaElectronics and Telecommunications Research Institute (ETRI), Daejeon 34129, Republic of KoreaDepartment of Smart ICT Convergence Engineering, Seoul National University of Science and Technology, Seoul 01811, Republic of KoreaThis paper presents an enhanced method for the transmission of 3D video in the Multi-view Video plus Depth (MVD) format over Two-Way Relay Channels (TWRC). Our approach addresses the unique challenges of MVD-based 3D video by combining Hierarchical Quadrature Amplitude Modulation (HQAM), a method that prioritizes data layers based on importance, and Inter-Layer Forward Error Correction (IL-FEC), which protects critical data from errors. These are specifically designed to handle the dual-layer data structure where color data and depth information require different levels of error protection, and it reduces transmission errors and enhances the quality of MVD-based 3D video over TWRC. In the TWRC scenario, the proposed scheme optimizes transmission by reducing the number of relayed bitstreams by half while maintaining high-quality requirements, as demonstrated by significant improvements in the Structural Similarity Index (SSIM) for virtually synthesized views. Furthermore, we identify and optimize the hierarchical modulation parameter (<inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><mi>α</mi></semantics></math></inline-formula>), which controls the priority and protection levels of different data streams. Systematically varying <inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><mi>α</mi></semantics></math></inline-formula> reveals its substantial impact on the quality of the reconstructed 3D video, as measured by SSIM. Our results demonstrate that the proposed combination of HQAM and IL-FEC not only maintains the target SSIM of 0.9 for the virtually synthesized view under various relay conditions but also reveals the optimal <inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><mi>α</mi></semantics></math></inline-formula> value for balancing the error protection between the color and depth map data streams. Notably, while increasing <inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><mi>α</mi></semantics></math></inline-formula> enhances the protection of critical data (such as color video streams), it may concurrently degrade the quality of less important streams (like depth maps), highlighting the importance of fine-tuning <inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><mi>α</mi></semantics></math></inline-formula> to achieve the best overall video quality. These findings suggest that our method provides a flexible and effective solution for high-quality 3D video transmission in challenging communication environments, potentially advancing the development of future 3D video delivery systems.https://www.mdpi.com/2076-3417/14/19/8741hierarchical QAMinter-layer FECmulti-view video plus depthdepth image-based renderingtwo-way relay channel |
| spellingShingle | Dongho You Sung-Hoon Kim Dong Ho Kim Hierarchical QAM and Inter-Layer FEC for Multi-View Video Plus Depth Format in Two-Way Relay Channels Applied Sciences hierarchical QAM inter-layer FEC multi-view video plus depth depth image-based rendering two-way relay channel |
| title | Hierarchical QAM and Inter-Layer FEC for Multi-View Video Plus Depth Format in Two-Way Relay Channels |
| title_full | Hierarchical QAM and Inter-Layer FEC for Multi-View Video Plus Depth Format in Two-Way Relay Channels |
| title_fullStr | Hierarchical QAM and Inter-Layer FEC for Multi-View Video Plus Depth Format in Two-Way Relay Channels |
| title_full_unstemmed | Hierarchical QAM and Inter-Layer FEC for Multi-View Video Plus Depth Format in Two-Way Relay Channels |
| title_short | Hierarchical QAM and Inter-Layer FEC for Multi-View Video Plus Depth Format in Two-Way Relay Channels |
| title_sort | hierarchical qam and inter layer fec for multi view video plus depth format in two way relay channels |
| topic | hierarchical QAM inter-layer FEC multi-view video plus depth depth image-based rendering two-way relay channel |
| url | https://www.mdpi.com/2076-3417/14/19/8741 |
| work_keys_str_mv | AT donghoyou hierarchicalqamandinterlayerfecformultiviewvideoplusdepthformatintwowayrelaychannels AT sunghoonkim hierarchicalqamandinterlayerfecformultiviewvideoplusdepthformatintwowayrelaychannels AT donghokim hierarchicalqamandinterlayerfecformultiviewvideoplusdepthformatintwowayrelaychannels |