Skip to main content
SpringerLink
Log in

A novel approach for ISL alphabet recognition using Extreme Learning Machine

  • Original Research
  • Published:
International Journal of Information Technology Aims and scope Submit manuscript

Abstract

Deaf and dumb people use sign language as a tool for communication. As per the 2011 census in India, hearing impaired and speech disabled population is 1,998,692 and 5,072,914 respectively (Disabled persons in India, https://www.mospi.gov.in). Normal hearing people do not learn sign language and thus there is a big communication gap between them and deaf and dumb people. Sign language interpreters can fill this gap but it is a very costly affair to hire them. Indian Sign Language (ISL) consists of signs which are made with two hands while other sign languages like American Sign Language consists of signs made with single hand. This work proposes an automatic and efficient computer vision based system to recognize ISL alphabet which can assist this communication. It can further be used as a module of complete ISL recognition system. Phases in ISL alphabet recognition are image acquisition, preprocessing, segmentation, feature extraction and classification. All 26 ISL alphabet have been considered for testing with average accuracy of 80.76%. Results show that the accuracy of 100% is achieved when similar alphabet {C, L, M, N, R, U,Y} are excluded from testing dataset.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Hore S, Chatterjee S, Santhi V, Dey N, Ashour AS, Balas VE, Shi F (2015) Indian sign language recognition using optimized Neural Networks. In: Proceedings of the 2015 International Conference on Information Technology and Intelligent Transportation Systems ITITS 2015, held December 12–13, 2015, Xi’an China, pp 563–573

  2. Dour S, Sharma MM (2016) Recognition of alphabets of Indian sign language by Sugeno type Neural Network. Int J Sci Res Public 6(3):442–453

    Google Scholar 

  3. Kumar DA, Kishore PVV, Sastry ASCS, Swamy PRG (2016) Selfie continuous sign language recognition using neural network. In: IEEE annual India conference (INDICON), pp 1–6

  4. Uddin MA, Chowdhury SA (2016) Hand sign language recognition for Bangla alphabet using support vector machine. In: IEEE international conference on innovations in science, engineering and technology (ICISET), pp 1–4

  5. Hosoe H, Sako S, Kwolek B (2017) Recognition of JSL finger spelling using convolutional neural networks. In: IEEE fifteenth IAPR international conference on machine vision applications (MVA), pp 85–88

  6. Mukai N, Harada N, Chang Y (2017) Japanese fingerspelling recognition based on classification tree and machine learning. In: Nicograph international (NicoInt), pp 19–24

  7. Pariwat T, Seresangtakul P (2017) Thai finger-spelling sign language recognition using global and local features with SVM. In: 9th IEEE international conference on knowledge and smart technology (KST), pp 116–120

  8. Rokade YI, Jadav PM (2017) Indian sign language recognition system. Int J Eng Technol 9:189–196

    Article  Google Scholar 

  9. Kiran Kumar E et al (2018) Early estimation model for 3D-discrete indian sign language recognition using graph matching. J King Saud Univ. https://doi.org/10.1016/j.jksuci.2018.06.008

    Article  Google Scholar 

  10. Kaur J, Rama Krishna C (2019) An efficient Indian sign language recognition system using sift descriptor. Int J Eng Adv Technol (IJEAT) 8(6):1456–1461

    Article  Google Scholar 

  11. Hamed A, Belal NA, Mahar KM (2016) Arabic Sign Language alphabet recognition based on HOG-PCA using microsoft Kinect in complex backgrounds. In: IEEE 6th international conference on advanced computing (IACC), pp 451–458

  12. Parcheta Z, Martínez-Hinarejos CD (2017) Sign language gesture recognition using HMM. In: Iberian conference on pattern recognition and image analysis. Springer, Cham, pp 419–426

    Book  Google Scholar 

  13. Kim SY, Han HG, Kim JW, Lee S, Kim TW (2017) A hand gesture recognition sensor using reflected impulses. IEEE Sens J 17(10):2975–2976

    Article  Google Scholar 

  14. Kumar P, Saini R, Roy PP, Dogra DP (2017) A position and rotation invariant framework for sign language recognition (SLR) using Kinect. Multimed Tools Appl 77(7):8823–8846. https://doi.org/10.1007/s11042-017-4776-9

    Article  Google Scholar 

  15. Abraham A, Rohini V (2018) Real time conversion of sign language to speech and prediction of gestures using Artificial Neural Network. 8th International Conference on Advances in Computing and Communication (ICACC-2018). Procedia Comput Sci 143:587–594

    Article  Google Scholar 

  16. Islam MM, Siddiqua S, Afnan J (2017) Real time hand gesture recognition using different algorithms based on American Sign Language. In: 2017 IEEE International Conference on Imaging, Vision & Pattern Recognition (icIVPR)

  17. Kang B, Tripathi S, Nguyen TQ (2015) Real-time Sign Language fingerspelling recognition using convolutional Neural Networks from Depth map. In: 2015 3rd IAPR Asian Conference on Pattern Recognition, pp 136–140

  18. Kumar R (2017) Fingerprint matching using rotational invariant orientation local binary pattern descriptor and machine learning techniques. Int J Comput Vis Image Process (IJCVIP) 7(4):51–67

    Article  Google Scholar 

  19. Kumar R, Chandra P, Hanmandlu M (2013) Fingerprint matching using rotational invariant image based descriptor and machine learning techniques. In: 2013 6th International Conference on Emerging Trends in Engineering and Technology (pp. 13–18). IEEE.

Download references

Author information

Authors and Affiliations

  1. USIC&T (Formerly USIT), GGSIPU, Dwarka, Delhi, India

    Anand Kumar

  2. Skill Faculty of Engineering & Technology, Shri Vishwakarma Skill University, Gurugram, Haryana, India

    Ravinder Kumar

Authors
  1. Anand Kumar
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ravinder Kumar
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Anand Kumar.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kumar, A., Kumar, R. A novel approach for ISL alphabet recognition using Extreme Learning Machine. Int. j. inf. tecnol. 13, 349–357 (2021). https://doi.org/10.1007/s41870-020-00525-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s41870-020-00525-6

Keywords

Search

Navigation