Skip to main content
SpringerLink
Log in

Estimating human body orientation from image depth data and its implementation

  • Original Paper
  • Published:
Machine Vision and Applications Aims and scope Submit manuscript

Abstract

This paper proposes a human body orientation estimation method using the Kinect camera depth data. The input of our system consists of three one-dimensional distance-based signals which reflect the body’s surface contours of the human upper body portion, i.e., the upper chest, upper abdomen, and lower abdomen. Such signals are then normalized using their distances to achieve the same amount of the lower parts. All normalized signals are concatenated to provide a mix of contour features. We used Support Vector Regression (SVR) to classify the feature and Kalman Filter to estimate the continuous orientations instead of using discrete orientations. We also extend our work by adding human motion direction to the robust estimate of human body orientation when walking. We conducted two evaluation schemes, i.e., body orientation at static position and body orientation when moving. The experimental results show that our system achieves impressive results by achieving mean average of angle error (MAAE) of \(0.097^{\circ }\) and \(5.82^{\circ }\) for estimating body continuous orientation at static position and estimating body continuous orientation when moving, respectively. Therefore, it is very promising to be applied in real implementations.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21

Similar content being viewed by others

References

  1. Li, S., Zhang, L., Diao, X.: Deep-learning-based human intention prediction using RGB images and optical flow. J. Intell. Rob. Syst. 97, 95–107 (2020)

    Article  Google Scholar 

  2. Saeed, A., Al-Hamadi, A.: Boosted human head pose estimation using kinect camera, In: IEEE International Conference on Image Processing (ICIP) (2015)

  3. Dewantara, B.S.B., Miura, J.: Estimating head orientation using a combination of multiple cues. IEICE Trans. Inf. Syst. E99–D(6), 1603–1613 (2016)

    Article  Google Scholar 

  4. Glas, D.F., Miyashita, T., Ishiguro, H., Hagita, N.: Laser-based tracking of human position and orientation using parametric shape modeling. Adv. Robot. 23(4), 405–428 (2009)

    Article  Google Scholar 

  5. Shimizu, M., Koide, K., Ardiyanto, I., Miura, J., Oishi, S.: LIDAR-based body orientation estimation by integrating shape and motion information, In: Proceedings of 2016 IEEE International Conference on Robotics and Biomimetics (ROBIO), pp. 1948–1953 (2016)

  6. Tepencelik, O.N., Wei, W., Chukoskie, L., Cosman P.C., Dey, S.: Body and Head Orientation Estimation with Privacy Preserving LiDAR Sensors, Semantic Scholar (2021)

  7. Baltieri, D., Vezzani, R., Cucchiara, R.: People orientation recognition by mixtures of wrapped distributions on random trees. Proc. Eur. Conf. Computer Vis. 7576, 270–283 (2012)

    Google Scholar 

  8. Weinrich, C., Vollmer, C., Gross, H.: Estimation of human upper body orientation formobile robotics using an SVM decision tree on monocular images, In: International Conference on Intelligent Robots and Systems, pp. 2147–2152 (2012)

  9. Ardiyanto, I., Miura, J.: Partial least squares-based human upper body orientation estimation with combined detection and tracking. Image Vis. Comput. 32(11), 904–915 (2014)

    Article  Google Scholar 

  10. Kohari, Y., Miura, J., Oishi, S.: CNN-based Human Body Orientation Estimation for Robotic Attendant, Workshop on Robot Perception of Humans, IAS-15, (2018)

  11. Yu, D., Xiong, H., Xu, Q., Wang, J., Li, K.: Continuous pedestrian orientation estimation using human keypoints, In: 2019 IEEE International Symposium on Circuits and Systems (ISCAS) (2019)

  12. Wu, C., Chen, Y., Luo, J., Su, C.C., Dawane, A., Hanzra, B., Deng, Z., Liu, B., Wang, J.Z., Kuo, C.H.: MEBOW: monocular estimation of body orientation in the wild. IEEE/CVF Conf. Comput. Vis. Pattern Recogn. (CVPR) 1, 3448–3458 (2020)

  13. Chen, L., Panin, G., Knoll, A.: Human body orientation estimation in multiview scenarios. ISVC Part II, LNCS 7432, 499–508 (2012)

    Google Scholar 

  14. Choi, J., Lee, B.J., Zhang, B.T.: Human body orientation estimation using convolutional neural network, In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), (2016)

  15. Liu, W., Zhang, Y., Tang, S., Tang, J., Hong, R., Li, J.: Accurate estimation of human body orientation from RGB-D sensors. IEEE Trans. Cybern. 43(5), 1442–1452 (2013)

  16. Lewandowski, B., Seichter, D., Wengefeld, T., Pfennig, L., Drumm, H., Gross, H.M.: Deep orientation: fast and robust upper body orientation estimation for mobile robotic applications, In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 441–448 (2019)

  17. Saputra, R.W.A., Dewantara, B.S.B., Pramadihanto, D.: Human body’s orientation estimation based on depth image, In: The 21th IEEE International Electronic Symposium, pp. 100–106 (2019)

  18. Shinmura, F., Deguchi, D., Ide, I., Murase, H., Fujiyoshi, H.: Estimation of human orientation using coaxial RGB-depth images, In: VISAPP 2015 - 10th International Conference on Computer Vision Theory and Applications (VISIGRAPP), pp. 113–120 (2015)

  19. Dewantara, B.S.B., Ardilla, F., Thoriqy, A.A.: Implementation of depth-HOG based human upper body detection on a mini PC using a low cost stereo camera, In: International Conference of Artificial Intelligence and Information Technology (ICAIIT), (2019)

  20. Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection, In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, (2005)

  21. Chang, C.C., Lin, C.J.: LIBSVM: a library for support vector machines. ACM Trans. Intell. Syst. Technol. 2(27), 1–27 (2011)

    Article  Google Scholar 

  22. Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features, In: International Conference on Computer Vision and Pattern Recognition, (2001)

  23. Kim, Y., Bang, H.: Introduction to Kalman filter and its applications, IntechOpen, pp. 1–16 (2018)

  24. Caron, F., Duflos, E., Pomorski, D., Vanheeghe, P.: GPS/IMU data fusion using Multisensor Kalman filtering: introduction of contextual aspects. Inf. Fusion 7(2), 221–230 (2006)

    Article  Google Scholar 

Download references

Acknowledgements

The author would like to thank all of our SVG laboratory members as their help and participation in our experiments to evaluate system performances.

Author information

Authors and Affiliations

  1. Politeknik Elektronika Negeri Surabaya, Surabaya, Indonesia

    Bima Sena Bayu Dewantara, Rizka Wahyu Aditiya Saputra & Dadet Pramadihanto

Authors
  1. Bima Sena Bayu Dewantara
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Rizka Wahyu Aditiya Saputra
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Dadet Pramadihanto
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Bima Sena Bayu Dewantara.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Dewantara, B.S.B., Saputra, R.W.A. & Pramadihanto, D. Estimating human body orientation from image depth data and its implementation. Machine Vision and Applications 33, 38 (2022). https://doi.org/10.1007/s00138-022-01290-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s00138-022-01290-1

Keywords

Search

Navigation