Skip to main content
SpringerLink
Log in

A recommender system to generate museum itineraries applying augmented reality and social-sensor mining techniques

  • S.I. : Virtual Reality, Augmented Reality and Commerce
  • Published:
Virtual Reality Aims and scope Submit manuscript

Abstract

Nowadays, museums offer technological and digital options to enrich the user experience in a visit. However, questions arise like which exhibition/museum could I visit? How to tour it and get the best experience? These questions are not easy to answer, because they do not represent tasks straightforward. Considering that the experiences of visiting a museum are now available in social networks, in which users describe, rate, and disseminate a work of art/exhibition of a museum, this information can be mined to generate tour recommendations in museums. Such recommendations could be improved by combining and applying data mining obtained from Internet of Things sensors installed in museums. In this paper, a hybrid approach to make recommendations for museum visits is proposed. It includes an Internet of Things architecture of beacons, incorporating some technologies based on semantic analysis, data mining, and machine learning. This approach integrates and combines data sources for generating and recommending indoor and outdoor itineraries for museums, which are visualized with augmented reality. The itinerary is built, taking into consideration opinions and assessments from social networks, the semantic classification of museums, and cultural activities, as well as data measured by beacon sensors in museum exhibitions. The result is a customized tour with augmented reality that contains a set of recommendations of how to visit a set of museums and obtain a better experience of the visit. A prototype of mobile application is available in the Google Play, called the “Historic Center,” with almost 500 downloads and an acceptable evaluation.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Notes

  1. http://www.geonames.org/.

References

  • Abu-Mostafa YS, Lin HT, Magdon-Ismail M (2012) Learning from data: a short course: AMLbook. View Article PubMed/NCBI Google Scholar

  • Adu-Poku S (2012) Comparing classification algorithms in data mining. Doctoral dissertation, Central Connecticut State University

  • Alexander EP, Alexander M, Decker J (2017) Museums in motion: an introduction to the history and functions of museums. Rowman & Littlefield, Lanham

    Google Scholar 

  • Amores M, Arco L, Borroto C (2016) Unsupervised opinion polarity detection based on new lexical resources. Computación y Sistemas 20(2):263–277

    Article  Google Scholar 

  • Araújo C, Martini RG, Henriques PR, Almeida JJ (2018) Annotated documents and expanded CIDOC-CRM ontology in the automatic construction of a virtual museum. In: Rocha Á, Reis LP (eds) Developments and advances in intelligent systems and applications. Springer, Cham, pp 91–110

    Chapter  Google Scholar 

  • Baraldi L, Paci F, Serra G, Benini L, Cucchiara R (2015) Gesture recognition using wearable vision sensors to enhance visitors’ museum experiences. IEEE Sens J 15(5):2705–2714

    Google Scholar 

  • Bello-Orgaz G, Jung JJ, Camacho D (2016) Social big data: recent achievements and new challenges. Inf Fusion 28:45–59

    Article  Google Scholar 

  • Bishop CM (2006) Pattern recognition and machine learning. Springer, Berlin

    MATH  Google Scholar 

  • Blazquez D, Domenech J (2017) Big data sources and methods for social and economic analyses. Technological forecasting and social change. Elsevier, Amsterdam

    Google Scholar 

  • Capuano N, Gaeta A, Guarino G, Miranda S, Tomasiello S (2016) Enhancing augmented reality with cognitive and knowledge perspectives: a case study in museum exhibitions. Behav Inf Technol 35(11):968–979

    Article  Google Scholar 

  • Carrozzino M, Bergamasco M (2010) Beyond virtual museums: experiencing immersive virtual reality in real museums. J Cult Heritage 11(4):452–458

    Article  Google Scholar 

  • Chianese A, Marulli F, Moscato V, Piccialli F (2013) SmARTweet: a location-based smart application for exhibits and museums. In: 2013 International conference on signal-image technology and internet-based systems (SITIS). IEEE, pp 408–415

  • Choi HS, Kim SH (2017) A content service deployment plan for metaverse museum exhibitions—centering on the combination of beacons and HMDs. Int J Inf Manage 37(1):1519–1527

    Article  Google Scholar 

  • Dim E, Kuflik T (2015) Automatic detection of social behavior of museum visitor pairs. ACM Trans Interact Intell Syst 4(4):17

    Google Scholar 

  • Falk JH, Dierking LD (2000) Learning from museums: visitor experiences and the making of meaning. Altamira Press, Lanham

    Google Scholar 

  • Fayyad U, Piatetsky-Shapiro G, Smyth P (1996) The KDD process for extracting useful knowledge from volumes of data. Commun ACM 39(11):27–34

    Article  Google Scholar 

  • Gandomi A, Haider M (2015) Beyond the hype: big data concepts, methods, and analytics. Int J Inf Manage 35(2):137–144

    Article  Google Scholar 

  • García-Palomares JC, Gutiérrez J, Mínguez C (2015) Identification of tourist hot spots based on social networks: a comparative analysis of European metropolises using photo-sharing services and GIS. Appl Geogr 63:408–417

    Article  Google Scholar 

  • Hajmoosaei A, Skoric P (2016) Museum ontology-based metadata. In: 2016 IEEE tenth international conference on semantic computing (ICSC). IEEE, pp 100–103

  • Hu Y, Gao S, Janowicz K, Yu B, Li W, Prasad S (2015) Extracting and understanding urban areas of interest using geotagged photos. Comput Environ Urban Syst 54:240–254

    Article  Google Scholar 

  • Huang W, Sun M, Li S (2016) A 3D GIS-based interactive registration mechanism for outdoor augmented reality system. Expert Syst Appl 55:48–58

    Article  Google Scholar 

  • Javornik A (2016) Augmented reality: research agenda for studying the impact of its media characteristics on consumer behaviour. J Retail Consum Serv 30:252–261

    Article  Google Scholar 

  • Jung T, tom Dieck MC, Lee H, Chung N (2016) Effects of virtual reality and augmented reality on visitor experiences in museum. In: Inversini A, Schegg R (eds) Information and communication technologies in tourism 2016. Springer, Cham, pp 621–635

    Chapter  Google Scholar 

  • Lara JA, Lizcano D, Martínez MA, Pazos J (2014) Data preparation for KDD through automatic reasoning based on description logic. Inf Syst 44:54–72

    Article  Google Scholar 

  • Lindqvist J, Cranshaw J, Wiese J, Hong J, Zimmerman J (2011). I’m the mayor of my house: examining why people use foursquare-a social-driven location sharing application. In: Proceedings of the SIGCHI conference on human factors in computing systems. ACM, pp 2409–2418

  • Lytras MD, Raghavan V, Damiani E (2017) Big data and data analytics research: from metaphors to value space for collective wisdom in human decision making and smart machines. Int J Semant Web Inf Syst 13(1):1–10

    Article  Google Scholar 

  • Martini RG, Araújo C, Librelotto GR, Henriques PR (2016) A reduced CRM-compatible form ontology for the virtual Emigration Museum. In: Rocha Á, Correia AM, Adeli H, Reis LP, Teixeira MM (eds) New advances in information systems and technologies. Springer, Cham, pp 401–410

    Chapter  Google Scholar 

  • Mata F, Claramunt C (2011) GeoST: geographic, thematic and temporal information retrieval from heterogeneous web data sources. In: Agrawal D, Cruz I, Jensen CS, Ofek E, Tanin E (eds) Web and wireless geographical information systems, pp 5–20

    Chapter  Google Scholar 

  • Mata F, Claramunt C, Juarez A (2011) An experimental virtual museum based on augmented reality and navigation. In Proceedings of the 19th ACM SIGSPATIAL international conference on advances in geographic information systems. ACM, pp 497–500

  • Mata F, Torres-Ruiz M, Guzmán G, Quintero R, Zagal-Flores R, Moreno-Ibarra M, Loza E (2016) A mobile information system based on crowd-sensed and official crime data for finding safe routes: a case study of Mexico City. Mob Inf Syst 2016:1–11. https://doi.org/10.1155/2016/8068209

    Article  Google Scholar 

  • McKercher B (2016) Towards a taxonomy of tourism products. Tour Manag 54:196–208

    Article  Google Scholar 

  • Pallud J (2017) Impact of interactive technologies on stimulating learning experiences in a museum. Inf Manag 54(4):465–478

    Article  Google Scholar 

  • Papatheodorou A, Rosselló J, Xiao H (2010) Global economic crisis and tourism: consequences and perspectives. J Travel Res 49(1):39–45

    Article  Google Scholar 

  • Perkins J (2010) Python text processing with NLTK 2.0 cookbook. Packt Publishing Ltd, Birmingham

    Google Scholar 

  • Reyes JA, Montes A, González JG, Pinto DE (2013) Classifying case relations using syntactic, semantic and contextual features. Comput Sist 17(2):263–272

    Google Scholar 

  • Sampson A (2012) Comparing classification algorithms in data mining. A Thesis, Central Connecticut State University New Britain, Connecticut

  • Styliani S, Fotis L, Kostas K, Petros P (2009) Virtual museums, a survey and some issues for consideration. J Cult Heritage 10(4):520–528

    Article  Google Scholar 

  • Su S, Wan C, Hu Y, Cai Z (2016) Characterizing geographical preferences of international tourists and the local influential factors in China using geo-tagged photos on social media. Appl Geogr 73:26–37

    Article  Google Scholar 

  • Tan PN (2006) Introduction to data mining. Pearson Education India, Noida

    Google Scholar 

  • Visvizi A, Mazzucelli C, Lytras M (2017) Irregular migratory flows: towards an ICTs’ enabled integrated framework for resilient urban systems. J Sci Technol Policy Manag 8(2):227–242

    Article  Google Scholar 

  • Waske, B., Benediktsson, J., & Sveinsson, J. (2009). Classifying remote sensing data with support vector machines and imbalanced training data. In: Benediktsson JA, Kittler J, Roli F (eds) Multiple classifier systems, pp 375–384

    Chapter  Google Scholar 

  • Younes G, Kahil R, Jallad M, Asmar D, Elhajj I, Turkiyyah G, Al-Harithy H (2017) Virtual and augmented reality for rich interaction with cultural heritage sites: a case study from the Roman Theater at Byblos. Digit Appl Archaeol Cult Heritage 5:1–9

    Google Scholar 

  • Zhang C, Liu C, Zhang X, Almpanidis G (2017) An up-to-date comparison of state-of-the-art classification algorithms. Expert Syst Appl 82:128–150

    Article  Google Scholar 

  • Zhou X, Xu C, Kimmons B (2015) Detecting tourism destinations using scalable geospatial analysis based on cloud computing platform. Comput Environ Urban Syst 54:144–153

    Article  Google Scholar 

Download references

Acknowledgments

This work was partially sponsored by the Instituto Politécnico Nacional (IPN), the Secretaría de Investigación y Posgrado (SIP) under Grants 20171918, 20171086, 20171463, and 20171192, as well as the Consejo Nacional de Ciencia y Tecnología (CONACYT) with the grant 1051. Additionally, we are thankful to the reviewers for their invaluable and constructive feedback that helped improve the quality of the paper.

Author information

Authors and Affiliations

  1. Instituto Politécnico Nacional, CIC, UPALM-Zacatenco, 07320, Mexico City, Mexico

    Miguel Torres-Ruiz, Felix Mata, Roberto Zagal, Giovanni Guzmán, Rolando Quintero & Marco Moreno-Ibarra

Authors
  1. Miguel Torres-Ruiz
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Felix Mata
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Roberto Zagal
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Giovanni Guzmán
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Rolando Quintero
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Marco Moreno-Ibarra
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Miguel Torres-Ruiz.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Torres-Ruiz, M., Mata, F., Zagal, R. et al. A recommender system to generate museum itineraries applying augmented reality and social-sensor mining techniques. Virtual Reality 24, 175–189 (2020). https://doi.org/10.1007/s10055-018-0366-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10055-018-0366-z

Keywords

Search

Navigation