Skip to main content
SpringerLink
Log in

Using augmented reality and deep learning to enhance Taxila Museum experience

  • Special Issue Paper
  • Published:
Journal of Real-Time Image Processing Aims and scope Submit manuscript

Abstract

Museums have adapted their traditional ways of providing services with the advent of novel digital technologies to match up with the pace and growing needs of current industry revolution. Mixed Reality has revitalized interpretation of numerous domains by offering immersive experiences in digital and real world. In the proposed study, an attempt was made to enrich user’s museum experience with relevant multimedia information and for building a better connection with the artifacts with in Taxila Museum in Pakistan, which has beautifully preserved the Gandhara civilization. The proposed solution is an Augmented Reality (AR)-based smartphone application which recognizes artifacts using Deep Learning in real time and retrieve supportive multimedia information for the visitors. To provide user with exact content, convolutional neural networks (CNN) will be applied to correctly recognize artifacts. The significance of proposed application is compared with traditional human guided or free user tours through user-centric questionnaire-based survey. The evaluation is carefully performed using relevant evaluation models including Museum Experience Scale (MES) and triptych model of interactivity.  The findings of the study are discussed and assessed comprehensively using statistical methods to highlight its significance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Pakistan Tours Guide: Taxila Museum (2013). [Online]. Available: http://www.pakistantoursguide.com/taxila-museum.html. Accessed 17 Oct 2020

  2. Guazzaroni, G., Pillai, A. S.: Virtual and augmented reality in Education, Art, and Museums. In: Advances in Computational Intelligence and Robotics, 1st Edition, 2019, IGI Global

  3. Stangl, Brigitte, Ukpabi, Dandison C., Park, Sangwon: Augmented Reality Applications: The Impact of Usability and Emotional Perceptions on Tourists’ App Experiences, Information and Communication Technologies in Tourism 2020, 181–191. Springer, Berlin (2020)

    Google Scholar 

  4. Fuhr, N., Tsakonas, G., Aalberg, T., Agosti, M., Hansen, P., Kapidakis, S., Klas, C., Kovacs, L., Landoni, M., Micsik, A., et al.: Evaluation of digital libraries. Int. J. Digit. Lib. 8(1), 2138 (2007)

    Google Scholar 

  5. Othman, M.K., Petrie, H., Power, C.: Engaging visitors in museums with technology: scales for the measurement of visitor and multimedia guide experience. In: Campos, P., Graham, N., Jorge, J., Nunes, N., Palanque, P., Winckler, M. (eds.) Human–Computer Interaction—INTERACT 2011, pp. 92–99. Springer, Berlin (2011)

    Chapter  Google Scholar 

  6. Fraenkel, J., Wallen, N.: How to Design and Evaluate Research in Education. McGraw-Hill Companies Incorporated, New York (2008)

    Google Scholar 

  7. Field, A., Hole, G.: How to Design and Report Experiments. SAGE Publications Ltd, New York (2003)

    Google Scholar 

  8. Ghouaiel, N., Garbaya, S., Cieutat, J.-M., Jessel, J.-P.: “Mobile augmented reality in museums : towards enhancing visitor’s learning experience. Int. J. Virtual Real. 17(1), 21–31 (2016)

    Article  Google Scholar 

  9. Damala, A., Cubaud, P., Bationo, A., Houlier, P., Marchal, I.: Bridging the gap between the digital and the physical: design and evaluation of a mobile augmented reality guide for the museum visit. In: 3rd International conference on digital interactive media in entertainment and arts, pp. 120–127 (2008)

  10. Othman, M., Petrie, H., Power, C.: Measuring the usability of a smartphone delivered museum guide. Procedia Soc. Behav. Sci. 97, 11 (2013)

    Google Scholar 

  11. Othman, M.K., Petrie, H., Power, C.: Engaging visitors in museums with technology: scales for the measurement of visitor and multimedia guide experience. Human–Computer Interaction INTERACT, pp. 92–99. Springer, Berlin (2011)

    Google Scholar 

  12. Fino, E., Martin-Gutierrez, J., Fernandez, M.D.M., Davara, E.: Interactive tourist guide: connecting web 2.0, augmented reality and qr codes. Procedia Comput. Sci. 25, 338–344 (2013)

    Article  Google Scholar 

  13. Kim, K., Seo, B.-K., Han, J.-H., Park, J.-I.: Augmented reality tour system for immersive experience of cultural heritage. In: Proceedings of the 8th International Conference on Virtual Reality Continuum and its Applications in Industry, pp. 323–324 (2009)

  14. Han, B., Kim, Y., Cho, K., Yang, H. S.: Museum tour guide robot with augmented reality. In: 2010 16th International conference on virtual systems and multimedia, Seoul, pp. 223-229 (2010)

  15. Venigalla, A.S.M., Chimalakonda, S.: Towards enhancing user experience through a web-based augmented reality museum. In: 2019 IEEE 19th International conference on advanced learning technologies (ICALT), Maceió, Brazil, pp. 357-358 (2019)

  16. Choudary, O., Charvillat, V., Grigoras, R., Gurdjos, P.: March: mobile augmented reality for cultural heritage. In: Proceedings of the 17th ACM International Conference on Multimedia, pp. 1023–1024 (2009)

  17. Pierdicca, R., Frontoni, E., Zingaretti, P., Malinverni, E.: Making visible the invisible. augmented reality visualization for 3d reconstructions of archaeological sites. 9254: 25–37 (2015)

  18. Aitamurto, T., Boin, J.B., Chen, K., Cherif, A., Shridhar, S.: The impact of augmented reality on art engagement: liking, impression of learning, and distraction. In: Chen, J., Fragomeni, G. (eds.) Virtual, Augmented and Mixed Reality: Applications in Health, Cultural Heritage, and Industry: VAMR, : Lecture Notes in Computer Science, vol. 10910. Springer, Cham (2018)

    Google Scholar 

  19. Lakens, D.: Calculating and reporting effect sizes to facilitate cumulative science: a practical primer for t-tests and anovas. Front. Psychol. 4, 863 (2013)

    Article  Google Scholar 

  20. Patton, M.Q.: Qualitative evaluation and research methods, 2nd edn. Sage Publications Inc, New York (1990)

    Google Scholar 

  21. Packer, J., Ballantyne, R.: Conceptualizing the visitor experience: a review of literature and development of a multifaceted model. Visit. Stud. 19, 128–143 (2016)

    Article  Google Scholar 

  22. Cohen, J.: Statistical Power Analysis for the Behavioral Sciences. Routledge, New York (1988)

    MATH  Google Scholar 

Download references

Acknowledgements

This work was supported in part by King Saud University, Saudi Arabia, through research supporting project number RSP-2020/184; in part by FCT/MCTES through national funds and when applicable co-funded EU funds under the project UIDB/50008/2020; and in part by Brazilian National Council for Scientific and Technological Development (CNPq) via Grant No. 309335/2017-5.

Author information

Authors and Affiliations

  1. Department of Information Technology, The University of Haripur, Haripur, Khyber Pakhtunkhwa, Pakistan

    Mudassar Ali Khan, Sabahat Israr & Ikram Ud Din

  2. Department of Art Education, College of Education, King Saud University, Riyadh, 11445, Saudi Arabia

    Abeer S Almogren

  3. Department of Computer Science, College of Computer and Information Sciences, King Saud University, Riyadh, 11633, Saudi Arabia

    Ahmad Almogren

  4. Federal University of Piauí (UFPI), Teresina, PI, Brazil

    Joel J. P. C. Rodrigues

  5. Instituto de Telecomunicações, Covilhã, Portugal

    Joel J. P. C. Rodrigues

Authors
  1. Mudassar Ali Khan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sabahat Israr
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Abeer S Almogren
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ikram Ud Din
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Ahmad Almogren
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Joel J. P. C. Rodrigues
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ikram Ud Din.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Khan, M.A., Israr, S., S Almogren, A. et al. Using augmented reality and deep learning to enhance Taxila Museum experience. J Real-Time Image Proc 18, 321–332 (2021). https://doi.org/10.1007/s11554-020-01038-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11554-020-01038-y

Keywords

Search

Navigation