Skip to main content

Advertisement

SpringerLink
Log in

Virtual reality: an aid as cognitive learning environment—a case study of Hindi language

  • S.I. : XR (VR, AR, MR) and Immersive Learning Environments
  • Published:
Virtual Reality Aims and scope Submit manuscript

Abstract

The objective of this research is to propose a dynamic composition of behaviour-rich interactive 3D scene as a virtual environment for cognitive support using visual and linguistic analytics. Based on the constructivist theory of learning through visual cognition by Winn (A conceptual basis for educational applications of virtual reality, Technical report TR 93-9, Washington Technology University, 1993), we propose our work with a grounding that visual data are easy to comprehend for a person having linguistic learning difficulties. Virtual reality provides an environment for learners to actively pursue their knowledge needs by applying their theories in the ‘real world’. Therefore, we focus our work on generating an interactive virtual environment. It decreases cognitive load for the person with difficulties in comprehension, especially in language reading, e.g. dyslexia. Our prior work related to the proposed research is named as Preksha—an automatic Hindi text visualizer. To the best of the knowledge of the authors, Preksha is the only known visualization work for an Indian Language, viz. Hindi. Belonging to morphologically-rich and free-word order Indian languages, this work on the Hindi Language is a novel interdisciplinary approach to develop a virtual environment for cognitive support. Application of an automatic text visualization with a suitable learning paradigm in a virtual environment is another novelty of this research.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  • Barnard K, Forsyth D (2001) Learning the semantics of words and pictures. In: Proceedings of eighth IEEE international conference on computer vision, ICCV 2001, vol 2, Vancouver, BC, Canada, pp 408–415. https://doi.org/10.1109/iccv.2001.937654

  • Beauchamp GR, Kosmorsky G (1987) Learning disabilities: update comment on the visual system. Pediatr Clin N Am 34(6):1439–1446. https://doi.org/10.1016/S0031-3955(16)36366-0

    Article  Google Scholar 

  • Daghestani L, Al-Nuaim H, Xu Z, Ragab AHM (2012) Interactive virtual reality cognitive learning model for performance evaluation of math manipulatives. J King Abdulaziz Univ Comput Inf Technol Sci 1(1):31–52. https://doi.org/10.4197/Comp1-1.2

    Google Scholar 

  • Earley J (1970) An efficient context-free parsing algorithm. Commun ACM 13(2):94–102. https://doi.org/10.1145/362007.362035

    Article  MATH  Google Scholar 

  • Funge J, Tu X, Terzopoulos D (1999) Cognitive modeling: knowledge reasoning planning intelligent characters. In: Proceedings of the 26th annual conference on computer graphics and interactive techniques SIGGRAPH 1999, Los Angeles, CA, annual conference series, ACM SIGGRAPH, pp 29–38. https://doi.org/10.1145/311535.311538

  • Gaddis T (1998) Virtual reality in the school. Virtual reality and Education laboratory, East Carolina University

  • Guerra-Filho G, Aloimonos Y (2007) A language for human action. Computer 40(5):42–51

    Article  Google Scholar 

  • Gupta A (2009) Beyond nouns and verbs. PhD thesis, University of Maryland

  • Mozilla VR. https://webvr.rocks/firefox. Accessed 22 Feb 2019

  • Jain P, Pawar P (2016) From pre-position to post-position. In: Proceedings of international journal of modern computer science (IJMCS), vol 4, pp 66–71. ISSN: 2320-7868

  • Jain P, Darbari H, Bhavsar VC (2013) Text visualization as an aid to language learning disability. In: Proceedings of national conference on e-learning and e-learning technologies ELELTECH, India, p 88

  • Jain P, Darbari H, Bhavsar VC (2014) Vishit: a visualizer for hindi text. In: Proceedings of fourth international conference on communication systems and network technologies CSNT-2014, IEEE Xplore, pp 886–890

  • Jain P, Pawar P, Koriya G, Lele A, Kumar A, Darbari H (2015) Knowledge acquisition for language description from scene understanding. In: IEEE international conference on computer, communication and control conference IC4-2015. IEEE explores

  • Jain P, Bhavsar RP, Lele A, Kumar A, Pawar BP, Darbari H (2017a) Knowledge acquisition for automatic text visualization. In: Proceedings of national conference on advances in computing NCAC-2017

  • Jain P, Darbari H, Bhavsar VC (2017b) Spatial intelligence from hindi language text for scene generation. In: Proceedings of 2nd international conference for convergence in technology I2CT-2017, IEEE Xplore, pp 132–138

  • Jain P, Darbari H, Bhavsar VC (2017c) Cognitive support by language visualization: a case study with Hindi language. In: Proceedings of 2nd international conference for convergence in technology I2CT-2017, IEEE Xplore, pp 110–115

  • Jain P, Bhavsar RP, Kumar A, Pawar BP, Darbari H (2018a) Tree adjoining grammar based parser for a hindi text-to-scene conversion system. In: Proceedings of 4th international conference for convergence in technology I2CT-2018, IEEE Xplore, pp 1–7. https://doi.org/10.1109/i2ct.2018.8529491

  • Jain P, Bhavsar RP, Pawar BP, Darbari H (2018b) VRML for automatic generation of 3D scene. Int J Comput Appl 2(8):1797–2250. https://doi.org/10.26808/rs.ca.i8v2.01

    Article  Google Scholar 

  • Jain P, Shaikh K, Bhavsar RP, Kumar A, Pawar BP, Darbari H, Bhavsar VC (2019) Cascaded finite-state chunk parsing for Hindi language. In: Proceedings of international conference on communication and information processing (ICCIP-2019) 17th–18th, May 2019, and in Elsevier-SSRN

  • JAVA3D. http://www.java3d.org/. Accessed on 22 Feb 2019

  • Joshi AK, Levy LS, Takahashi M (1975) Tree adjunct grammars. J Comput Syst Sci 10(1):136–163. https://doi.org/10.1016/S0022-0000(75)80019-5

    Article  MathSciNet  MATH  Google Scholar 

  • Keene EO, Zimmermann S (2004) Mosaic of thought, teaching comprehension in a reader’s workshop, The English journal (Heinemann, 1997). Article by Cathy Puett Miller, Education World. Portsmouth, NH: Heinemann

  • Likert R (1932) A technique for the measurement of attitudes. Arch Psychol 22(140):1–55

    Google Scholar 

  • Majoy P (1993) Doorways to learning: a model for developing the brain’s full potential. Zepher Press Learning Materials; First Thus edition, AR

  • Mayer RE (2001) Multimedia learning. Cambridge University Press, New York

    Google Scholar 

  • Mnguni LE (2014) The theoretical cognitive process of visualization for science education. SpringerPlus 3:184. https://doi.org/10.1186/2193-1801-3-184

    Article  Google Scholar 

  • MyReddi V, Narayan J (1998) Functional academics for students with mental retardation: a guide for teachers. National Institute for the Mentally Handicapped, Department of Special Education, Ministry of Social Justice and Empowerment. ISBN: 81-86594-12-4

  • H-Anim. http://www.web3d.org/documents/specifications/19774/V1.0/HAnim/HAnim.html. Accessed on 22 Feb 2019

  • Pelligrino JW, Alderton DL, Shute VJ (1984) Understanding spatial ability. Educ Psychol 19(3):239–253

    Google Scholar 

  • Rabinovitch JS (1992) What you see is what you get: examining the critical link between visual processing, language, and learning. Seattle, WA: Presentations, pp 11/21–12/5

  • Riva G, Gamberini L (2000) Virtual reality in telemedicine. Telemed e-Health 6(3):327–340. https://doi.org/10.1089/153056200750040183

    Article  Google Scholar 

  • Roussou M (2004) Learning by doing and learning through play: an exploration of interactivity in virtual environments for children. Comput Entertain 1(2):1–23. https://doi.org/10.1145/973801.973818

    Article  Google Scholar 

  • Sadeghi MA, Farhadi A (2011) Recognition using visual phrases. In: IEEE conference on computer vision and pattern recognition CVPR 2011, Colorado Springs, CO, USA, pp 1745–1752. https://doi.org/10.1109/cvpr.2011.5995711

  • Scene Graph Basics. https://docs.oracle.com/cd/E17802\_01/j2se/javase/technologies/desktop/java3d/forDevelopers/j3dguide/SceneGraphOverview.doc.html. Accessed on 22 Feb 2019

  • Schank RC (2000) The virtual university. Cyber Psychol Behavior 3(1):9–16. https://doi.org/10.1089/109493100316184

    Article  Google Scholar 

  • Schnotz W, Rasch T (2005) Enabling, facilitating, and inhibiting effects of animations in multimedia learning: why reduction of cognition load can have negative results on learning. Educ Technol Res Dev 53(47):47–58. https://doi.org/10.1007/BF02504797

    Article  Google Scholar 

  • Singhal S, Zyda M (1999) Networked virtual environments: design and implementation. Addison-Wesley, Reading

    Google Scholar 

  • Tu Z, Bai X (2010) Auto-context and its application to high-level vision tasks and 3D brain image segmentation. IEEE Trans Pattern Anal Mach Intell 32(10):1744–1757. https://doi.org/10.1109/TPAMI.2009.186

    Article  Google Scholar 

  • VRML. https://www.w3.org/MarkUp/VRML/. Accessed on 22 Feb 2019

  • Wang Y (2006) The OAR model for Knowledge representation. In: Proceedings of Canadian conference on electrical and computer engineering. IEEE Xplore, pp 1727–1730. https://doi.org/10.1109/ccece.2006.277686

  • WebVR. https://webvr.info. Accessed on 22 Feb 2019

  • Winn W (1993) A conceptual basis for educational applications of virtual reality. Technical report TR 93-9: Washington Technology University. http://www.hitl.washington.edu/publications/r-93-9

  • Wiriyathammabhum P, Summers-Stay D, Fermüller C, Aloimonos Y (2016) Computer vision and natural language processing: recent approaches in multimedia and robotics. J ACM Comput Surv (CSUR) Surv Homepage Arch 49(4), Article No. 71. 10.1145/3009906

  • X3D. http://www.web3d.org/getting-started-x3d. Accessed 22 Feb 2019

  • X3DOM. https://www.x3dom.org/. Accessed on 22 Feb 2019

  • Yun R, Chen G, Li Y (2006) Using VRML and JAVA to build virtual game-based learning environment for addition and subtraction operation. In: Liu W, Li Q, Lau R (eds) Advances in web based learning—ICWL 2006. ICWL 2006. Lecture notes in computer science, vol 4181, Springer, Berlin, pp 146–153. https://doi.org/10.1007/11925293_14

  • Zhao R, Grosky RI (2002) Bridging the semantic gap in image retrieval. Distributed multimedia databases: techniques and applications, pp 14–36. https://doi.org/10.4018/978-1-930708-29-7.ch002

Download references

Acknowledgements

We would like to extend our sincere appreciation to the support from Maharashtra Institute of Mental Health (MIMH, Pune), Dr. Tamboli (Ahmednagar) and Dr. Shanta Vaidya Memorial Foundation (Maitra, Pune) who helped us refine the learning pedagogy that significantly improved our research. Lastly, we would like to thank the evaluators for their time and efforts.

Author information

Authors and Affiliations

  1. Centre for Development of Advanced Computing, Pune, Maharashtra, India

    Priyanka Jain, Karimullah Shaik, Ajai Kumar & Hemant Darbari

  2. KBC North Maharashtra University, Jalgaon, Maharashtra, India

    Ram Bhavsar & B. V. Pawar

  3. Faculty of Computer Science, University of New Brunswick, Fredericton, Canada

    Virendrakumar C. Bhavsar

Authors
  1. Priyanka Jain
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ram Bhavsar
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Karimullah Shaik
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ajai Kumar
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. B. V. Pawar
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Hemant Darbari
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Virendrakumar C. Bhavsar
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Priyanka Jain.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jain, P., Bhavsar, R., Shaik, K. et al. Virtual reality: an aid as cognitive learning environment—a case study of Hindi language. Virtual Reality 24, 771–781 (2020). https://doi.org/10.1007/s10055-020-00426-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10055-020-00426-w

Keywords

Search

Navigation