TY - JOUR
T1 - Hierarchical QAM and Inter-Layer FEC for Multi-View Video Plus Depth Format in Two-Way Relay Channels
AU - You, Dongho
AU - Kim, Sung Hoon
AU - Kim, Dong Ho
N1 - Publisher Copyright:
© 2024 by the authors.
PY - 2024/10
Y1 - 2024/10
N2 - This paper presents an enhanced method for the transmission of 3D video in the Multi-view Video plus Depth (MVD) format over Two-Way Relay Channels (TWRC). Our approach addresses the unique challenges of MVD-based 3D video by combining Hierarchical Quadrature Amplitude Modulation (HQAM), a method that prioritizes data layers based on importance, and Inter-Layer Forward Error Correction (IL-FEC), which protects critical data from errors. These are specifically designed to handle the dual-layer data structure where color data and depth information require different levels of error protection, and it reduces transmission errors and enhances the quality of MVD-based 3D video over TWRC. In the TWRC scenario, the proposed scheme optimizes transmission by reducing the number of relayed bitstreams by half while maintaining high-quality requirements, as demonstrated by significant improvements in the Structural Similarity Index (SSIM) for virtually synthesized views. Furthermore, we identify and optimize the hierarchical modulation parameter ((Formula presented.)), which controls the priority and protection levels of different data streams. Systematically varying (Formula presented.) reveals its substantial impact on the quality of the reconstructed 3D video, as measured by SSIM. Our results demonstrate that the proposed combination of HQAM and IL-FEC not only maintains the target SSIM of 0.9 for the virtually synthesized view under various relay conditions but also reveals the optimal (Formula presented.) value for balancing the error protection between the color and depth map data streams. Notably, while increasing (Formula presented.) enhances the protection of critical data (such as color video streams), it may concurrently degrade the quality of less important streams (like depth maps), highlighting the importance of fine-tuning (Formula presented.) to achieve the best overall video quality. These findings suggest that our method provides a flexible and effective solution for high-quality 3D video transmission in challenging communication environments, potentially advancing the development of future 3D video delivery systems.
AB - This paper presents an enhanced method for the transmission of 3D video in the Multi-view Video plus Depth (MVD) format over Two-Way Relay Channels (TWRC). Our approach addresses the unique challenges of MVD-based 3D video by combining Hierarchical Quadrature Amplitude Modulation (HQAM), a method that prioritizes data layers based on importance, and Inter-Layer Forward Error Correction (IL-FEC), which protects critical data from errors. These are specifically designed to handle the dual-layer data structure where color data and depth information require different levels of error protection, and it reduces transmission errors and enhances the quality of MVD-based 3D video over TWRC. In the TWRC scenario, the proposed scheme optimizes transmission by reducing the number of relayed bitstreams by half while maintaining high-quality requirements, as demonstrated by significant improvements in the Structural Similarity Index (SSIM) for virtually synthesized views. Furthermore, we identify and optimize the hierarchical modulation parameter ((Formula presented.)), which controls the priority and protection levels of different data streams. Systematically varying (Formula presented.) reveals its substantial impact on the quality of the reconstructed 3D video, as measured by SSIM. Our results demonstrate that the proposed combination of HQAM and IL-FEC not only maintains the target SSIM of 0.9 for the virtually synthesized view under various relay conditions but also reveals the optimal (Formula presented.) value for balancing the error protection between the color and depth map data streams. Notably, while increasing (Formula presented.) enhances the protection of critical data (such as color video streams), it may concurrently degrade the quality of less important streams (like depth maps), highlighting the importance of fine-tuning (Formula presented.) to achieve the best overall video quality. These findings suggest that our method provides a flexible and effective solution for high-quality 3D video transmission in challenging communication environments, potentially advancing the development of future 3D video delivery systems.
KW - depth image-based rendering
KW - hierarchical QAM
KW - inter-layer FEC
KW - multi-view video plus depth
KW - two-way relay channel
UR - http://www.scopus.com/inward/record.url?scp=85206590071&partnerID=8YFLogxK
U2 - 10.3390/app14198741
DO - 10.3390/app14198741
M3 - Article
AN - SCOPUS:85206590071
SN - 2076-3417
VL - 14
JO - Applied Sciences (Switzerland)
JF - Applied Sciences (Switzerland)
IS - 19
M1 - 8741
ER -