Abstract
People detection is an essential technique for person-following mobile robots in applications of human-friendly services and collaborative tasks. 2D light detection and ranging (LiDAR) sensors are useful for these applications, especially for applications that detect and follow people while maintaining a suitable distance, at a close range, using accurate range measurements. In this study, we propose a method of human-leg detection in 3D feature space for a person-following mobile robot equipped with a 2D LiDAR sensor. We also propose an improved LiDAR scan segmentation technique to extract segments of human leg candidates. The newly proposed method generates a feature vector with the attributes of leg shapes and learns a classification boundary in 3D feature space. Experimental results indicate that the proposed method successfully describes the target dataset and provides accurate leg detection. This study demonstrates that human legs can be detected with improved accuracy by learning the classification boundary in 3D feature space.
Similar content being viewed by others
References
Islam, M. J., Hong, J., & Sattar, J. (2019). Person-following by autonomous robots: A categorical overview. The International Journal of Robotics Research, 38(14), 1581–1618.
Honig, S. S., Oron-Gilad, T., Zaichyk, H., Sarne-Fleischmann, V., Olatunji, S., & Edan, Y. (2018). Toward socially aware person-following robots. IEEE Transactions on Cognitive and Developmental Systems, 10(4), 936–954.
Finžgar, M., & Podržaj, P. (2017). Machine-vision-based human-oriented mobile robots: A review. Strojniški vestnik - Journal of Mechanical Engineering, 63(5), 331–348.
Kim, M., & Choi, D. (2019). Design and development of a variable configuration delivery robot platform. International Journal of Precision Engineering and Manufacturing, 20, 1757–1765.
Jo, J. H., & Moon, C.-B. (2019). Development of a practical ICP outlier rejection scheme for graph-based SLAM using a laser range finder. International Journal of Precision Engineering and Manufacturing, 20, 1735–1745.
Ryu, H., & Park, Y. (2019). Improved informed RRT* using gridmap skeletonization for mobile robot path planning. International Journal of Precision Engineering and Manufacturing, 20, 2033–2039.
Jiang, S., Yao, W., Hong, Z., Li, L., Su, C., & Kuc, T.-Y. (2018). A classification-lock tracking strategy allowing a person-following robot to operate in a complicated indoor environment. Sensors, 18(11), 3903.
Gupta, M., Kumar, S., Behera, L., & Subramanian, V. K. (2017). A novel vision-based tracking algorithm for a human-following mobile robot. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 47(7), 1415–1427.
Wang, X., Zhang, L., Wang, D., & Hu, X. (2018). Person detection, tracking and following using stereo camera. In Ninth international conference on graphic and image processing (ICGIP 2017), p 51.
Chen, B. X., Sahdev, R., & Tsotsos, J. K. (2017). Person following robot using selected online Ada-boosting with stereo camera. In 2017 14th conference on computer and robot vision (CRV), pp 48–55.
Chen, B. X., Sahdev, R., & Tsotsos, J. K. (2017). Integrating stereo vision with a CNN tracker for a person-following robot. In Computer vision systems, pp 300–313.
Chung, W., Kim, H., Yoo, Y., Moon, C.-B., & Park, J. (2012). The detection and following of human legs through inductive approaches for a mobile robot with a single laser range finder. IEEE Transactions on Industrial Electronics, 59(8), 3156–3166.
Karunarathne, D., Morales, Y., Kanda, T., & Ishiguro, H. (2018). Model of side-by-side walking without the robot knowing the goal. International Journal of Social Robotics, 10(4), 401–420.
Schulz, D., Burgard, W., Fox, D., & Cremers, A. B. (2003). People tracking with mobile robots using sample-based joint probabilistic data association filters. The International Journal of Robotics Research, 22(2), 99–116.
Sung, Y., & Chung, W. (2016). Hierarchical sample-based joint probabilistic data association filter for following human legs using a mobile robot in a cluttered environment. IEEE Transactions on Human-Machine Systems, 46(3), 340–349.
Topp, E., & Christensen, H. (2005). Tracking for following and passing persons. In 2005 IEEE/RSJ international conference on intelligent robots and systems, pp 2321–2327.
Bar-Shalom, Y., & Li, X. R. (1996). Multitarget-multisensor tracking: Principles and techniques. IEEE Control Systems, 16(1), 93.
Luo, W., Xing, J., Milan, A., Zhang, X., Liu, W., Zhao, X., et al. (2014). Multiple object tracking: A literature review.
Vo, B.-N., Mallick, M., Bar-shalom, Y., Coraluppi, S., Osborne, R., Mahler, R., & Vo, B.-T. (2015). Multitarget tracking. In Wiley encyclopedia of electrical and electronics engineering, pp 1–15.
Kirubarajan, T., & Bar-Shalom, Y. (2004). Probabilistic data association techniques for target tracking in clutter. Proceedings of the IEEE, 92(3), 536–557.
Arras, K. O., Mozos, O. M., & Burgard, W. (2007). Using boosted features for the detection of people in 2D range data. In Proceedings 2007 IEEE international conference on robotics and automation, pp. 3402–3407.
Oishi, S., Kohari, Y., & Miura, J. (2016). Toward a robotic attendant adaptively behaving according to human state. In 2016 25th IEEE international symposium on robot and human interactive communication (RO-MAN), pp. 1038–1043.
Koide, K., & Miura, J. (2016). Identification of a specific person using color, height, and gait features for a person following robot. Robotics and Autonomous Systems, 84, 76–87.
Zainudin, Z., Kodagoda, S., & Dissanayake, G. (2010). Torso detection and tracking using a 2D laser range finder. In Proceedings of the 2010 Australasian conference on robotics and automation.
Tax, D. M., & Duin, R. P. (2004). Support vector data description. Machine Learning, 54(1), 45–66.
Siadat, A., Kaske, A., Klausmann, S., Dufaut, M., & Husson, R. (1997). An optimized segmentation method for a 2D laser-scanner applied to mobile robot navigation. IFAC Proceedings Volumes, 30(7), 149–154.
Borges, G., & Aldon, M.-J. (2000). A split-and-merge segmentation algorithm for line extraction in 2D range images. In Proceedings 15th international conference on pattern recognition. ICPR-2000, Vol. 1, pp. 441–444.
Linder, T., Breuers, S., Leibe, B., & Arras, K. O. (2016). On multi-modal people tracking from mobile platforms in very crowded and dynamic environments. In 2016 IEEE international conference on robotics and automation (ICRA), pp. 5512–5519.
Acknowledgements
This work was supported in part by the NRF, MSIP (NRF-2017R1A2A1A17069329), and was also supported by the Agriculture, Food and Rural Affairs Research Center Support Program (Project No. 714002-07), Ministry of Agriculture, Food and Rural Affairs.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Cha, D., Chung, W. Human-Leg Detection in 3D Feature Space for a Person-Following Mobile Robot Using 2D LiDARs. Int. J. Precis. Eng. Manuf. 21, 1299–1307 (2020). https://doi.org/10.1007/s12541-020-00343-7
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12541-020-00343-7