Abstract
3D-high efficiency video coding (3D-HEVC) is the latest new extension standard of high efficiency video coding (HEVC) for multi-view video plus depth (MVD). Several novel coding tools are employed in the 3D-HEVC for better representation of the dependent texture and depth video. However, employing these tools causes a significant increase in coding complexity. In this paper, we introduce a fast coding scheme for complexity reduction of 3D-HEVC. Since the multi-view video and depth are highly content dependent, testing all the prediction modes are not efficient. A statistically analysis is performed to study the features of 3D video contents from spatio, spatial and inter-view correlations. Based on this correlation, the proposed fast coding scheme determines to skip some treeblocks of texture and depth video at the early stage. Experimental results demonstrate that the proposed scheme can save 63.3% runtime of 3D-HEVC with only 0.41% bitrate increase.
Similar content being viewed by others
References
Bjontegaard G (2001) Calculation of Average PSNR differences between RD curves, document ITU-T SG16 Q.6, VCEG Meeting, VCEG-M33, Austin, TX, USA
Chen Y, Vetro A (2014) Next-generation 3D formats with depth map support. IEEE MultiMedia 21(2):90–94
Corrêa G, Assuncao PA, Agostini LV, da Silva Cruz LA (2015) Fast HEVC encoding decisions using data mining. IEEE Trans. Circuits Syst. Video Technol. 25(4):660–673
Hamout H, Elyousfi A (2020) Fast Depth Map Intra Coding for 3D Video Compression Based Tensor Feature Extraction and Data Analysis, IEEE Trans. Circuits Syst. Video Technol., vol. 30, no. 7, pp. 1933-1945
Huang X, An P, Zhang Q (2017) Efficient AMP decision and search range adjustment algorithm for HEVC. EURASIP J Image Vid Process 2017(75):1–15
Lei J, Duan J, Wu F, Ling N, Hou C (2018) Fast mode decision based on grayscale similarity and inter-view correlation for depth map coding in 3D-HEVC. IEEE Trans Circuits Syst Vid Technol 28(3):706–718
Mueller K, Vetro A (2014) Common test conditions of 3DV core experiments, Joint Collaborative Team on 3D Video Coding Extensions (JCT-3V) document JCT3V-G1100, 7th Meeting: San Jose, CA, USA
Müller K, Schwarz H, Marpe D, Bartnik C, Bosse S, Brust H, Hinz T, Lakshman H, Merkle P, Rhee H, Tech G, Winken M, Wiegand T (2013) 3D high efficiency video coding for multi-view video and depth data. IEEE Trans Circuits Syst Video Technol 22(9):3366–3378
Park C (2015) Edge-based Intramode selection for depth-map coding in 3D-HEVC. IEEE Trans Image Process 24(1):155–162
Saldanha M, Sanchez G, Marcon C, Agostini L (2020) Fast 3D-HEVC depth map encoding using machine learning. IEEE Trans. Circuits Syst. Vid Technol. 30(3):850–861
Shen L, Liu Z, Zhang X, Zhao W, Zhang Z (2013) An effective CU size decision method for HEVC encoders, IEEE Trans. Multimed, vol. 15, no. 2
Shen L, Zhang Z, An P (Feb. 2013) Fast CU size decision and mode decision algorithm for HEVC intra coding. IEEE Trans Consum Electron 59(1):207–213
Shen L, Zhang Z, Liu Z (2014) Adaptive inter-mode decision for HEVC jointly utilizing inter-level and spatio-temporal correlations. IEEE Trans. Circuits Syst. Video Technol. 24(10):1709–1722
Shen L, Zhang Z, Liu Z (2014) Effective CU size decision for HEVC intra coding. IEEE Trans Image Process 23(10):4232–4241
Shen L, An P, Zhang Z, Hu Q, Chen Z (2015) A 3D-HEVC fast mode decision algorithm for real-time applications. ACM Trans Multimed Comput Commun Appl 11(3):1–23
Shen L, An P, Liu Z (2017) Context-adaptive based CU processing for 3D-HEVC. PLOS One 12(2):e0171018
Sullivan GJ, Ohm J-R, Han W-J, Wiegand T (Dec. 2012) Overview of the high efficiency video coding (FHEVC) standard. IEEE Trans. Circuits Syst. Video Technol. 22(12):1649–1668
Tanimoto M, Fujii T, Suzuki K (2008) View synthesis algorithm in view synthesis reference software 2.0 (VSRS 2.0), ISO/IEC JTC1/SC29/WG11 document M16090, Lausanne, Switzerland.
Tech G, Chen Y, Müller K, Ohm J, Vetro A (Jan. 2016) Overview of the multiview and 3D extensions of high efficiency video coding. IEEE Trans. Circuits Syst. Video Technol. 26(1):35–49
Tohidypour HR, Pourazad MT, Nasiopoulos P (2016) Online-learning-based complexity reduction scheme for 3D-HEVC. IEEE Trans. Circuits Syst. Vid Technol. 26(10):1870–1883
Xiong J, Li H, Wu Q, Meng F (Feb. 2014) A fast HEVC inter CU selection method based on pyramid motion divergence. IEEE Trans Multimed 16(2):559–564
Zhang N, Zhao D, Chen Y, Lin J, Gao W (Oct. 2014) Fast encoder decision for texture coding in 3D-HEVC. Signal Process Image Commun 29(9):951–961
Zhang Q, Zhao J, Huang X, Gan Y (2015) A fast and efficient coding unit size decision algorithm based on temporal and spatial correlation. Optik-Int J Light Electron Optics 126(21):2793–2798
Zhang Y, Kwong S, Wang X, Yuan H, Pan Z, Xu L (2015) Machine learning-based coding unit depth decisions for flexible complexity allocation in high efficiency video coding. IEEE Trans Image Process 24(7):2225–2238
Zhang Q, Wang X, Huang X, Su R, Gan Y (2015) Fast mode decision algorithm for 3D-HEVC encoding optimization based on depth information. Digital Signal Process 44(9):37–46
Zhang H, Fu C, Chan Y, Tsang S, Siu W (2018) Probability based depth intra mode skipping strategy and novel VSO metric for DMM decision in 3D-HEVC. IEEE Trans Circuits Syst Vid Techn 28(2):513–527
Zhang Q, Huang K, Wang X, Jiang B, Gan Y (Dec. 2019) Efficient multiview video plus depth coding for 3D-HEVC based on complexity classification of the treeblock. J Real-Time Image Process 16(6):1909–1926
Acknowledgments
This work was supported in part by the National Natural Science Foundation of China under Grant 61771432, 61302118, 61702464, 61773018 and 61374014, the Basic Research Projects of Education Department of Henan No. 21zx003, and 20A880004, the Scientific Project of Henan under Grant 202102210179.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Zhang, Q., Wang, Y., Huang, L. et al. Fast coding scheme for low complexity 3D-HEVC based on video content property. Multimed Tools Appl 80, 25909–25925 (2021). https://doi.org/10.1007/s11042-021-10961-6
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-021-10961-6