Skip to main content
Log in

Fast coding scheme for low complexity 3D-HEVC based on video content property

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

3D-high efficiency video coding (3D-HEVC) is the latest new extension standard of high efficiency video coding (HEVC) for multi-view video plus depth (MVD). Several novel coding tools are employed in the 3D-HEVC for better representation of the dependent texture and depth video. However, employing these tools causes a significant increase in coding complexity. In this paper, we introduce a fast coding scheme for complexity reduction of 3D-HEVC. Since the multi-view video and depth are highly content dependent, testing all the prediction modes are not efficient. A statistically analysis is performed to study the features of 3D video contents from spatio, spatial and inter-view correlations. Based on this correlation, the proposed fast coding scheme determines to skip some treeblocks of texture and depth video at the early stage. Experimental results demonstrate that the proposed scheme can save 63.3% runtime of 3D-HEVC with only 0.41% bitrate increase.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  1. Bjontegaard G (2001) Calculation of Average PSNR differences between RD curves, document ITU-T SG16 Q.6, VCEG Meeting, VCEG-M33, Austin, TX, USA

  2. Chen Y, Vetro A (2014) Next-generation 3D formats with depth map support. IEEE MultiMedia 21(2):90–94

    Article  Google Scholar 

  3. Corrêa G, Assuncao PA, Agostini LV, da Silva Cruz LA (2015) Fast HEVC encoding decisions using data mining. IEEE Trans. Circuits Syst. Video Technol. 25(4):660–673

    Article  Google Scholar 

  4. Hamout H, Elyousfi A (2020) Fast Depth Map Intra Coding for 3D Video Compression Based Tensor Feature Extraction and Data Analysis, IEEE Trans. Circuits Syst. Video Technol., vol. 30, no. 7, pp. 1933-1945

  5. Huang X, An P, Zhang Q (2017) Efficient AMP decision and search range adjustment algorithm for HEVC. EURASIP J Image Vid Process 2017(75):1–15

    Google Scholar 

  6. Lei J, Duan J, Wu F, Ling N, Hou C (2018) Fast mode decision based on grayscale similarity and inter-view correlation for depth map coding in 3D-HEVC. IEEE Trans Circuits Syst Vid Technol 28(3):706–718

    Article  Google Scholar 

  7. Mueller K, Vetro A (2014) Common test conditions of 3DV core experiments, Joint Collaborative Team on 3D Video Coding Extensions (JCT-3V) document JCT3V-G1100, 7th Meeting: San Jose, CA, USA

  8. Müller K, Schwarz H, Marpe D, Bartnik C, Bosse S, Brust H, Hinz T, Lakshman H, Merkle P, Rhee H, Tech G, Winken M, Wiegand T (2013) 3D high efficiency video coding for multi-view video and depth data. IEEE Trans Circuits Syst Video Technol 22(9):3366–3378

    MathSciNet  MATH  Google Scholar 

  9. Park C (2015) Edge-based Intramode selection for depth-map coding in 3D-HEVC. IEEE Trans Image Process 24(1):155–162

    Article  MathSciNet  Google Scholar 

  10. Saldanha M, Sanchez G, Marcon C, Agostini L (2020) Fast 3D-HEVC depth map encoding using machine learning. IEEE Trans. Circuits Syst. Vid Technol. 30(3):850–861

    Article  Google Scholar 

  11. Shen L, Liu Z, Zhang X, Zhao W, Zhang Z (2013) An effective CU size decision method for HEVC encoders, IEEE Trans. Multimed, vol. 15, no. 2

  12. Shen L, Zhang Z, An P (Feb. 2013) Fast CU size decision and mode decision algorithm for HEVC intra coding. IEEE Trans Consum Electron 59(1):207–213

    Article  Google Scholar 

  13. Shen L, Zhang Z, Liu Z (2014) Adaptive inter-mode decision for HEVC jointly utilizing inter-level and spatio-temporal correlations. IEEE Trans. Circuits Syst. Video Technol. 24(10):1709–1722

    Article  Google Scholar 

  14. Shen L, Zhang Z, Liu Z (2014) Effective CU size decision for HEVC intra coding. IEEE Trans Image Process 23(10):4232–4241

    Article  MathSciNet  Google Scholar 

  15. Shen L, An P, Zhang Z, Hu Q, Chen Z (2015) A 3D-HEVC fast mode decision algorithm for real-time applications. ACM Trans Multimed Comput Commun Appl 11(3):1–23

    Article  Google Scholar 

  16. Shen L, An P, Liu Z (2017) Context-adaptive based CU processing for 3D-HEVC. PLOS One 12(2):e0171018

    Article  Google Scholar 

  17. Sullivan GJ, Ohm J-R, Han W-J, Wiegand T (Dec. 2012) Overview of the high efficiency video coding (FHEVC) standard. IEEE Trans. Circuits Syst. Video Technol. 22(12):1649–1668

    Article  Google Scholar 

  18. Tanimoto M, Fujii T, Suzuki K (2008) View synthesis algorithm in view synthesis reference software 2.0 (VSRS 2.0), ISO/IEC JTC1/SC29/WG11 document M16090, Lausanne, Switzerland.

  19. Tech G, Chen Y, Müller K, Ohm J, Vetro A (Jan. 2016) Overview of the multiview and 3D extensions of high efficiency video coding. IEEE Trans. Circuits Syst. Video Technol. 26(1):35–49

    Article  Google Scholar 

  20. Tohidypour HR, Pourazad MT, Nasiopoulos P (2016) Online-learning-based complexity reduction scheme for 3D-HEVC. IEEE Trans. Circuits Syst. Vid Technol. 26(10):1870–1883

    Article  Google Scholar 

  21. Xiong J, Li H, Wu Q, Meng F (Feb. 2014) A fast HEVC inter CU selection method based on pyramid motion divergence. IEEE Trans Multimed 16(2):559–564

    Article  Google Scholar 

  22. Zhang N, Zhao D, Chen Y, Lin J, Gao W (Oct. 2014) Fast encoder decision for texture coding in 3D-HEVC. Signal Process Image Commun 29(9):951–961

    Article  Google Scholar 

  23. Zhang Q, Zhao J, Huang X, Gan Y (2015) A fast and efficient coding unit size decision algorithm based on temporal and spatial correlation. Optik-Int J Light Electron Optics 126(21):2793–2798

    Article  Google Scholar 

  24. Zhang Y, Kwong S, Wang X, Yuan H, Pan Z, Xu L (2015) Machine learning-based coding unit depth decisions for flexible complexity allocation in high efficiency video coding. IEEE Trans Image Process 24(7):2225–2238

    Article  MathSciNet  Google Scholar 

  25. Zhang Q, Wang X, Huang X, Su R, Gan Y (2015) Fast mode decision algorithm for 3D-HEVC encoding optimization based on depth information. Digital Signal Process 44(9):37–46

    Article  Google Scholar 

  26. Zhang H, Fu C, Chan Y, Tsang S, Siu W (2018) Probability based depth intra mode skipping strategy and novel VSO metric for DMM decision in 3D-HEVC. IEEE Trans Circuits Syst Vid Techn 28(2):513–527

    Article  Google Scholar 

  27. Zhang Q, Huang K, Wang X, Jiang B, Gan Y (Dec. 2019) Efficient multiview video plus depth coding for 3D-HEVC based on complexity classification of the treeblock. J Real-Time Image Process 16(6):1909–1926

    Article  Google Scholar 

Download references

Acknowledgments

This work was supported in part by the National Natural Science Foundation of China under Grant 61771432, 61302118, 61702464, 61773018 and 61374014, the Basic Research Projects of Education Department of Henan No. 21zx003, and 20A880004, the Scientific Project of Henan under Grant 202102210179.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Qiuwen Zhang.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhang, Q., Wang, Y., Huang, L. et al. Fast coding scheme for low complexity 3D-HEVC based on video content property. Multimed Tools Appl 80, 25909–25925 (2021). https://doi.org/10.1007/s11042-021-10961-6

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-021-10961-6

Keywords

Navigation