skip to main content
research-article

The Role of Haptic Feedback and Gamification in Virtual Museum Systems

Published:01 July 2021Publication History
Skip Abstract Section

Abstract

This article reports the results of a research aimed to evaluate the ability of a haptic interface to improve the user experience (UX) with virtual museum systems. In particular, two user studies have been carried out to (1) compare the experience aroused during the manipulation of a 3D printed replica of an artifact with a pen-like stylus with that aroused during the interaction (visual and tactile) with a 3D rendering application using a haptic interface and PC monitor, and (2) compare the users’ perceived usability and UX among a traditional mouse-based desktop interface, haptic interface, and haptic gamified interface based on the SUS scale and the AttrakDiff2 questionnaire. A total of 65 people were involved. The considered haptic application is based on the haptic device Omega 6 produced by Force Dimension, and it is a permanent attraction of the Museo Archeologico Nazionale delle Marche. Results suggest that the proposed haptic interface is suitable for people who commonly use mouse-based computer interaction, but without previous experience with haptic systems, and provide some insights useful to better understand the role of haptic feedback and gamification in enhancing UX with virtual museums, and to guide the development of other similar applications in the future.

References

  1. C. Classen and D. Howes. 2006. The museum as Sensescape: Western sensibilities and indigenous artifacts. In Sensible Objects: Colonialism, Museums and Material Culture, E. Edwards, C. Godsen, and R. B. Phillips (Eds.). Routledge, London, UK, 199–222.Google ScholarGoogle Scholar
  2. F. Candlin. 2008. Museums, modernity and the class politics of touching objects. In Touch in Museums: Policy and Practice in Object Handling, H. J. Chatterjee, S. MacDonald, D. Prytherch, and G. Noble (Eds.). Routledge, London, UK, 9–20.Google ScholarGoogle Scholar
  3. P. Kyriakou and S. Hermon. 2019. Can I touch this? Using natural interaction in a museum augmented reality system. Digital Applications in Archaeology and Cultural Heritage 12 (2019), e00088.Google ScholarGoogle ScholarCross RefCross Ref
  4. N. Levent and A. Pascual-Leone (Eds.). 2014. The Multisensory Museum: Cross-Disciplinary Perspectives on Touch, Sound, Smell, Memory, and Space. Rowman & Littlefield.Google ScholarGoogle Scholar
  5. J. Willcocks. 2015. The power of concrete experience: Museum collections, touch and meaning-making in art and design pedagogy. In Engaging the Senses: Object-Based Learning in Higher Education, H. J. Chatterjee and L. Hannan (Eds.). Routledge London, UK, 43–56.Google ScholarGoogle Scholar
  6. E. Pye (Ed.). 2016. The Power of Touch: Handling Objects in Museum and Heritage Context. Routledge.Google ScholarGoogle Scholar
  7. P. F. Wilson, J. Stott, J. M. Warnett, A. Attridge, M. P. Smith, and M. A. Williams. 2017. Evaluation of touchable 3D-printed replicas in museums. Curator: The Museum Journal 60, 4 (2017), 445–465.Google ScholarGoogle ScholarCross RefCross Ref
  8. M. Carrozzino and M. Bergamasco. 2010. Beyond virtual museums: Experiencing immersive virtual reality in real museums. Journal of Cultural Heritage 11, 4 (2010), 452–458.Google ScholarGoogle ScholarCross RefCross Ref
  9. M. Dima, L. Hurcombe, and M. Wright. 2014. Touching the past: Haptic augmented reality for museum artefacts. In Proceedings of the International Conference on Virtual, Augmented,and Mixed Reality. 3–14.Google ScholarGoogle Scholar
  10. S. A. Brewster. 2005. Impact of haptic ‘touching’ technology on cultural applications. In Digital Applications for Cultural Heritage Institutions, J. Hemsley, V. Cappallini, and G. Stanke (Eds.). Ashgate, Aldershot, England, 273—284.Google ScholarGoogle Scholar
  11. G. Zampieri and B. Lavarone. 2000. Bronzi Antichi del Museo Archeologico di Padova. Vol. 28. L'Erma di Bretschneider.Google ScholarGoogle Scholar
  12. M. K. Bekele, R. Pierdicca, E. Frontoni, E. S. Malinverni, and J. Gain. 2018. A survey of augmented, virtual, and mixed reality for cultural heritage. Journal on Computing and Cultural Heritage 11, 2 (2018), 1–36.Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. J. C. Hong, M. Y. Hwang, Y. J. Chen, P. H. Lin, Y. T. Huang, H. Y. Cheng, and C. C. Lee. 2013. Using the saliency-based model to design a digital archaeological game to motivate players’ intention to visit the digital archives of Taiwan's natural science museum. Computers & Education 66 (2013), 74–82.Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. ISTAT. 2019. Annuario Statistico Italiano 2019. Retrieved April 25, 2021 from https://www.istat.it/it/archivio/236772.Google ScholarGoogle Scholar
  15. E. Nofal, G. Panagiotidou, R. M. Reffat, H. Hameeuw, V. Boschloos, and A. V. Moere. 2020. Situated tangible gamification of heritage for supporting collaborative learning of young museum visitors. Journal on Computing and Cultural Heritage 13, 1 (2020), 1–24.Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. L. Barbieri, F. Bruno, and M. Muzzupappa. 2017. Virtual museum system evaluation through user studies. Journal of Cultural Heritage 26 (2017), 101–108.Google ScholarGoogle ScholarCross RefCross Ref
  17. E. Sundén, I. Lundgren, and A. Ynnerman. 2017. Hybrid virtual reality touch table: An immersive collaborative platform for public explanatory use of cultural objects and sites. In Proceedings of the 15th Eurographics Workshop on Graphics and Cultural Heritage. 27–29.Google ScholarGoogle Scholar
  18. M. Butler and P. Neave. 2008. Object appreciation through haptic interaction. In Proceedings ascilite Melbourne. 133–141.Google ScholarGoogle Scholar
  19. M. Bergamasco, A. Frisoli, and F. Barbagli. 2002. Haptics technologies and cultural heritage applications. In Proceedings of Computer Animation 2002. IEEE, Los Alamitos, CA, 25–32.Google ScholarGoogle Scholar
  20. R. Comes. 2016. Haptic devices and tactile experiences in museum exhibitions. Journal of Ancient History and Archaeology 3, 4 (2016), 79175835.Google ScholarGoogle Scholar
  21. M. Mohammadi, A. Franchi, D. Barcelli, and D. Prattichizzo. 2016. Cooperative aerial tele-manipulation with haptic feedback. In Proceedings of the 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS’16). IEEE, Los Alamitos, CA, 5092–5098.Google ScholarGoogle Scholar
  22. G. Gioioso, M. Mohammadi, A. Franchi, and D. Prattichizzo. 2015. A force-based bilateral teleoperation framework for aerial robots in contact with the environment. In Proceedings of the 2015 IEEE International Conference on Robotics and Automation (ICRA’15). IEEE, Los Alamitos, CA, 318–324).Google ScholarGoogle Scholar
  23. H. Hoshyarmanesh, K. Zareinia, S. Lama, B. Durante, and G. R. Sutherland. 2020. Evaluation of haptic devices and end-users: Novel performance metrics in tele-robotic microsurgery. International Journal of Medical Robotics and Computer Assisted Surgery 16, 4 (2020), e2101.Google ScholarGoogle ScholarCross RefCross Ref
  24. A. Javaid, H. Munawar, and M. A. Mohyuddin. 2019. A low cost 1-DoF encounter type haptic device for use in education. In Proceedings of the 2019 International Conference on Robotics and Automation in Industry (ICRAI’19). IEEE, Los Alamitos, CA, 1–6.Google ScholarGoogle Scholar
  25. B. A. Brogni, C. A. Avizzano, C. Evangelista, and M. Bergamasco. 1999. Technological approach for cultural heritage: Augmented reality. In Proceedings of the 8th IEEE International Workshop on Robot and Human Interaction (RO-MAN’99). IEEE, Los Alamitos, CA, 206–212.Google ScholarGoogle Scholar
  26. A. Dettori, C. A. Avizzano, S. Marcheschi, M. Angerilli, M. Bergamasco, C. Loscos, and A. Guerraz. 2003. Art touch with CREATE haptic interface. In Proceedings of the IEEE International Conference on Advanced Robotics (ICAR’03).Google ScholarGoogle Scholar
  27. P. Reuter, G. Riviere, N. Couture, S. Mahut, and L. Espinasse. 2010. ArcheoTUI—Driving virtual reassemblies with tangible 3D interaction. Journal on Computing and Cultural Heritage 3, 2 (2010), 1–13.Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. S. Arnab, P. Petridis, I. Dunwell, and S. De Freitas. 2010. Touching artefacts in an ancient world on a browser-based platform. In Proceedings of the IADIS International Conference on Computer Graphics, Visualization, Computer Vision, and Image Processing (CGVCVIP’10). 478—482.Google ScholarGoogle Scholar
  29. T. Asano, Y. Ishibashi, S. Minezawa, and M. Fujimoto. 2005. Surveys of exhibition planners and visitors about a distributed haptic museum. In Proceedings of the 2005 ACM SIGCHI International Conference on Advances in Computer Entertainment Technology. 246–249.Google ScholarGoogle Scholar
  30. D. I. Grow, L. N. Verner, and A. M. Okamura. 2007. Educational haptics. In Proceedings of the AAAI Spring Symposium: Semantic Scientific Knowledge Integration. 53–58.Google ScholarGoogle Scholar
  31. F. Tecchia, E. Ruffaldi, A. Frisoli, M. Bergamasco, and M. Carrozzino. 2007. Multimodal interaction for the web. In Proceedings of Museums and the Web 2007.Google ScholarGoogle Scholar
  32. P. Figueroa, M. Coral, P. Boulanger, J. Borda, E. Londoño, F. Vega, and D. Restrepo. 2009. Multi-modal exploration of small artifacts: An exhibition at the Gold Museum in Bogota. In Proceedings of the 16th ACM Symposium on Virtual Reality Software and Technology. 67–74.Google ScholarGoogle Scholar
  33. S. A. Brewster. 2001. The Impact of haptic ‘touching’ technology on cultural applications. In Proceedings of the Conference on Extreme Value Analysis (EVA’01). 1–14. Available at http://www.dcs.gla.ac.uk/∼stephen/papers/EVA2001.pdf.Google ScholarGoogle Scholar
  34. A. Reichinger, S. Schröder, C. Löw, S. Sportun, P. Reichl, and W. Purgathofer. 2016. Spaghetti, sink and sarcophagus: Design explorations of tactile artworks for visually impaired people. In Proceedings of the 9th Nordic Conference on Human-Computer Interaction. 1–6.Google ScholarGoogle Scholar
  35. A. Döpker, T. Brockmann, and S. Stieglitz. 2013. Use cases for gamification in virtual museums. In Informatik 2013—Informatik angepasst an Mensch, Organisation und Umwelt.Google ScholarGoogle Scholar
  36. R. Hammady, M. Ma, and N. Temple. 2016. Augmented reality and gamification in heritage museums. In Proceedings of the Joint International Conference on Serious Games. 181–187.Google ScholarGoogle Scholar
  37. E. M. R. Huaman, R. G. A. Aceituno, and O. Sharhorodska. 2019. Application of virtual reality and gamification in the teaching of art history. In Proceedings of the International Conference on Human-Computer Interaction. 220–229.Google ScholarGoogle Scholar
  38. S. Liu and M. Z. Idris. 2018. Constructing a framework of user experience for museum based on gamification and service design. MATEC Web of Conferences 176 (2018), 04007.Google ScholarGoogle Scholar
  39. F. Liarokapis, P. Petridis, D. Andrews, and S. de Freitas. 2017. Multimodal serious games technologies for cultural heritage. In Mixed Reality and Gamification for Cultural Heritage, M. Ionnides, N. Magnenat-Thalmann, and G. Papagiannakis (Eds.). Springer, Cham, Switzerland, 371–392.Google ScholarGoogle Scholar
  40. M. Mortara, C. E. Catalano, F. Bellotti, G. Fiucci, M. Houry-Panchetti, and P. Petridis. 2014. Learning cultural heritage by serious games. Journal of Cultural Heritage 15, 3 (2014), 318–325.Google ScholarGoogle ScholarCross RefCross Ref
  41. J. Mccarthy, E. Sebo, B. Wilkinson, and F. Sheehan. 2020. Open workflows for polychromatic reconstruction of historical sculptural monuments in 3D. Journal on Computing and Cultural Heritage 13, 3 (2020), 1–16.Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. S. Vosinakis, P. Koutsabasis, D. Makris, and E. Sagia. 2016. A kinesthetic approach to digital heritage using leap motion: The Cycladic sculpture application. In Proceedings of the 2016 8th International Conference on Games and Virtual Worlds for Serious Applications (VS-GAMES’16). IEEE, Los Alamitos, CA, 1–8.Google ScholarGoogle Scholar
  43. M. H. Jamil, P. S. Annor, J. Sharfman, R. Parthesius, I. Garachon, and M. Eid. 2018. The role of haptics in digital archaeology and heritage recording processes. In Proceedings of the 2018 IEEE International Symposium on Haptic, Audio, and Visual Environments and Games (HAVE’18). IEEE, Los Alamitos, CA, 1–6.Google ScholarGoogle Scholar
  44. H. M. Hassan and G. H. Galal-Edeen. 2017. From usability to user experience. In Proceedings of the 2017 International Conference on Intelligent Informatics and Biomedical Sciences (ICIIBMS’17). IEEE, Los Alamitos, CA, 216–222.Google ScholarGoogle Scholar
  45. I. Standard. 1998. Ergonomic requirements for office work with visual display terminals (VDTS)—Part 11: Guidance on usability. ISO Standard 9241–11. International Organization for Standardization, 55.Google ScholarGoogle Scholar
  46. M. Maguire. 2001. Methods to support human-centred design. International Journal of Human-Computer Studies 55, 4 (2001), 587–634.Google ScholarGoogle ScholarDigital LibraryDigital Library
  47. J. Kirakowski. 1996. The software usability measurement inventory: Background and usage. In Usability Evaluation in Industry, P. W. Jordan, B. Thomas, B. A. Weerdmeester, and I. L. McClelland (Eds.). Taylor & Francis, London, UK, 169–178.Google ScholarGoogle Scholar
  48. J. P. Chin, V. Diehl, and K. L. Norman. 1988. Development of an instrument measuring user satisfaction of the human-computer interface. Human Factors in Computing Systems CHI188. ACM, New York, NY, 213–218.Google ScholarGoogle Scholar
  49. J. Brooke. 1996. SUS: A “quick and dirty”' usability scale. In Usability Evaluation in Industry, P. W. Jordan, B. Thomas, B. A. Weerdmeester, and I. L. McClelland (Eds.). Taylor & Francis, London, UK, 189–194.Google ScholarGoogle Scholar
  50. M. Hassenzahl. 2008. User experience (UX): Towards an experiential perspective on product quality. In Proceedings of the 20th International Conference of the Association Francophone d'Interaction Homme-Machine. ACM, New York, NY, 11–15.Google ScholarGoogle ScholarDigital LibraryDigital Library
  51. M. Hassenzahl. 2004. The interplay of beauty, goodness, and usability in interactive products. Human-Computer Interaction 19 (2004), 319–349.Google ScholarGoogle ScholarDigital LibraryDigital Library
  52. M. Mengoni and A. Leopardi. 2019. An exploratory study on the application of reverse engineering in the field of small archaeological artefacts. Computer-Aided Design and Applications 16, 6 (2019), 1209–1226.Google ScholarGoogle ScholarCross RefCross Ref
  53. A. Bangor, P. T. Kortum, and J. T. Miller. 2008. An empirical evaluation of the system usability scale. International Journal of Human–Computer Interaction 24, 6 (2008), 574–594.Google ScholarGoogle Scholar
  54. W. Wetzlinger, A. Auinger, and M. Dörflinger. 2014. Comparing effectiveness, efficiency, ease of use, usability and user experience when using tablets and laptops. In Proceedings of the International Conference of Design, User Experience, and Usability. 402–412.Google ScholarGoogle Scholar
  55. J. Brooke. 2013. SUS: A retrospective. Journal of Usability Studies 8, 2 (2013), 29–40.Google ScholarGoogle ScholarDigital LibraryDigital Library
  56. M. Hassenzahl, M. Burmester, and F. Koller. 2003. AttrakDiff: Ein fragebogen zur messung wahrgenommener hedonischer und pragmatischer qualität. In Mensch & Computer 2003. Vieweg+ Teubner Verlag, 187–196.Google ScholarGoogle Scholar
  57. G. Christou. 2014. The interplay between immersion and appeal in video games. Computers in Human Behavior 32 (2014), 92–100.Google ScholarGoogle ScholarCross RefCross Ref
  58. A. Bangor, P. Kortum, and J. Miller. 2009. Determining what individual SUS scores mean: Adding an adjective rating scale. Journal of Usability Studies 4, 3 (2009), 114–123.Google ScholarGoogle ScholarDigital LibraryDigital Library
  59. J. Isleifsdottir and M. Larusdottir. 2008. Measuring the user experience of a task oriented software. In Proceedings of the International Workshop on Meaningful Measures: Valid Useful User Experience Measurement. 8, 97–101.Google ScholarGoogle Scholar
  60. A. M. Toda, A. C. Klock, W. Oliveira, P. T. Palomino, L. Rodrigues, L. Shi, and A. I. Cristea. 2019. Analysing gamification elements in educational environments using an existing gamification taxonomy. Smart Learning Environments 6, 1 (2019), 1–14.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. The Role of Haptic Feedback and Gamification in Virtual Museum Systems

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    • Published in

      cover image Journal on Computing and Cultural Heritage
      Journal on Computing and Cultural Heritage   Volume 14, Issue 3
      July 2021
      315 pages
      ISSN:1556-4673
      EISSN:1556-4711
      DOI:10.1145/3473560
      Issue’s Table of Contents

      Copyright © 2021 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 1 July 2021
      • Accepted: 1 February 2021
      • Revised: 1 December 2020
      • Received: 1 September 2020
      Published in jocch Volume 14, Issue 3

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Research
      • Refereed

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format .

    View HTML Format