Abstract
Travel photos inform and inspire consumers by conveying a first-hand destination experience. Despite the proliferation of consumer-generated travel photos in online travel review sites, deconstructing the effects of photos on consumer engagement remains a challenge to the tourism industry. We provide a framework to process and interpret various photographic elements on user engagement using deep learning algorithms. We posit that a photo can invoke consumers’ subjective interpretations of photos representing authentic, creative, or emotional dimensions of the destination experience. A structured crowdsourced categorization process was deployed to measure the interpretive dimensions of the photos. The objects in photographs are identified using a novel deep learning algorithm for controls. We use narrative framing concepts to theorize their influence on user engagement in an online travel review site setting. Relevant three sets of hypotheses are tested using a large dataset of photo-based travel reviews sampled between 2012 and 2014. A negative zero-inflated binomial regression is used to estimate the effect of subjective interpretation of photos on user engagement, accounting for overdispersed excess zeros associated with count outcomes. Results support the hypotheses. The additional analyses explore other plausible influential attributes to user engagements to complement our main findings. We discuss the theoretical contributions to the online-image-persuasion stream of research and practical implications for online tourist review sites.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Notes
The company has been acquired by a large online travel agent (OTA) in 2016 and remained operational until 2020. The mobile app’s repository of travel photos were combined with the OTA’s existing library of photos. When visitors click a photo on the OTA site, the Trover app would enable user interaction.
References
Adam, M. T., Astor, P. J., & Krämer, J. (2016). Affective images, emotion regulation and bidding behavior: An experiment on the influence of competition and community emotions in internet auctions. Journal of Interactive Marketing, 35, 56–69. https://doi.org/10.1016/j.intmar.2015.12.002.
Ali, F., Ryu, K., & Hussain, K. (2016). Influence of experiences on memories, satisfaction and behavioral intentions: A study of creative tourism. Journal of Travel & Tourism Marketing, 33(1), 85–100. https://doi.org/10.1080/10548408.2015.1038418.
Batey, M. (2012). The measurement of creativity: From definitional consensus to the introduction of a new heuristic framework. Creativity Research Journal, 24(1), 55–65. https://doi.org/10.1080/10400419.2012.649181.
Baumgartner, H. (2002). Toward a personology of the consumer. Journal of Consumer Research, 29(2), 286–292. https://doi.org/10.1086/341578.
Beverland, M. B., & Farrelly, F. J. (2010). The quest for authenticity in consumption: Consumers’ purposive choice of authentic cues to shape experienced outcomes. Journal of Consumer Research, 36(5), 838–856. https://doi.org/10.1086/615047.
Bhattacharya, S., Sukthankar, R., & Shah, M. (2010). A framework for photo-quality assessment and enhancement based on visual aesthetics. Proceedings of the 18th ACM International Conference on Multimedia. https://doi.org/10.1145/1873951.1873990.
Blain, C., Levy, S. E., & Ritchie, J. B. (2005). Destination branding: Insights and practices from destination management organizations. Journal of Travel Research, 43(4), 328–338. https://doi.org/10.1177/0047287505274646.
boyd, d. (2008). Can social network sites enable political action. International Journal of Media and Cultural Politics, 4(2), 241–244. https://doi.org/10.1386/macp.4.2.241_3.
Boyd, D., & Crawford, K. (2011). Six provocations for big data. A decade in internet time: Symposium on the dynamics of the internet and society. https://doi.org/10.2139/ssrn.1926431.
Bratitsis, T., & Ziannas, P. (2015). From early childhood to special education: Interactive digital storytelling as a coaching approach for fostering social empathy. Procedia Computer Science, 67, 231–240. https://doi.org/10.1016/j.procs.2015.09.267.
Cameron, A., & Trivedi, P. (2010). Microeconometrics using using Stata. Revised edition TX: Stata Press.
Campbell, T. A. (2012). Digital storytelling in an elementary classroom: Going beyond entertainment. Procedia-Social and Behavioral Sciences, 69, 385–393. https://doi.org/10.1016/j.sbspro.2012.11.424.
Carter, E. (2017). Social media, Mobile, and travel: Like, tweet, and share your way across the globe. WebFX. https://www.webfx.com/blog/social-media/social-media-mobile-travel/.
Chen, T., Borth, D., Darrell, T., & Chang, S.-F. (2014). DeepSentiBank: Visual sentiment concept classification with deep convolutional neural networks. arXiv preprint.arXiv:1410.8586.
Cheng, G., Han, J., & Lu, X. (2017). Remote sensing image scene classification: Benchmark and state of the art. Proceedings of the IEEE, 105(10), 1865–1883. https://doi.org/10.1109/JPROC.2017.2675998.
Chon, Y., Lane, N. D., Li, F., Cha, H., & Zhao, F. (2012). Automatically characterizing places with opportunistic crowdsensing using smartphones. Proceedings of the 2012 ACM Conference on Ubiquitous Computing. https://doi.org/10.1145/2370216.2370288.
Ciregan, D., Meier, U., & Schmidhuber, J. (2012). Multi-column deep neural networks for image classification. IEEE Conference on Computer Vision and Pattern recognition, 3642–3649. https://doi.org/10.1109/CVPR.2012.6248110.
Constantinides, P., Henfridsson, O., & Parker, G. G. (2018). Introduction—Platforms and infrastructures in the digital age. Information Systems Research, 29(2), 381–400. https://doi.org/10.1287/isre.2018.0794.
Coudounaris, D. N., & Sthapit, E. (2017). Antecedents of memorable tourism experience related to behavioral intentions. Psychology & Marketing, 34(12), 1084–1093. https://doi.org/10.1002/mar.21048.
Datta, R., & Wang, J. Z. (2010). ACQUINE: Aesthetic quality inference engine-real-time automatic rating of photo aesthetics. Proceedings of the International Conference on Multimedia information retrieval. https://doi.org/10.1145/1743384.1743457.
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009). Imagenet: A large-scale hierarchical image database. IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA, 248–255. https://doi.org/10.1109/CVPR.2009.5206848.
Deng, L., & Yu, D. (2014). Deep learning: Methods and applications. Foundations and Trends in Signal Processing, 7(3–4), 197–387. https://doi.org/10.1561/2000000039.
Duarte, J., Siegel, S., & Young, L. (2012). Trust and credit: The role of appearance in peer-to-peer lending. Review of Financial Studies, 25(8), 2455–2484. https://doi.org/10.1093/rfs/hhs071.
Escalas, J. E., & Stern, B. B. (2003). Sympathy and empathy: Emotional responses to advertising dramas. Journal of Consumer Research, 29(4), 566–578. https://doi.org/10.1086/346251.
Faraj, S., Kwon, D., & Watts, S. (2004). Contested artifact: Technology sensemaking, actor networks, and the shaping of the web browser. Information Technology & People, 17(2), 186–209. https://doi.org/10.1108/09593840410542501.
Fei-Fei, L., & Li, L.-J. (2010). What, where and who? Telling the story of an image by activity classification, scene recognition and object categorization. In: Cipolla R., Battiato S., Farinella G.M. (Eds.) Computer Vision. Studies in Computational Intelligence, (Vol. 285, pp. 157–171). Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-12848-6_6
Floyd, M. F. (1997). Pleasure, arousal, and dominance: Exploring affective determinants of recreation satisfaction. Leisure Sciences, 19(2), 83–96. https://doi.org/10.1080/01490409709512241.
Gill, R. (2015). Why the PR strategy of storytelling improves employee engagement and adds value to CSR: An integrated literature review. Public Relations Review, 41(5), 662–674. https://doi.org/10.1016/j.pubrev.2014.02.012.
Goffman, E. (1974). Frame analysis: An essay on the organization of experience. Boston: Northeastern University Press.
Goossens, C. (2000). Tourism information and pleasure motivation. Annals of Tourism Research, 27(2), 301–321. https://doi.org/10.1016/S0160-7383(99)00067-5.
Grayson, K., & Martinec, R. (2004). Consumer perceptions of iconicity and indexicality and their influence on assessments of authentic market offerings. Journal of Consumer Research, 31(2), 296–312. https://doi.org/10.1086/422109.
Green, M. C., & Brock, T. C. (2000). The role of transportation in the persuasiveness of public narratives. Journal of Personality and Social Psychology, 79(5), 701–721. https://doi.org/10.1037/0022-3514.79.5.701.
Grissemann, U. S., & Stokburger-Sauer, N. E. (2012). Customer co-creation of travel services: The role of company support and customer satisfaction with the co-creation performance. Tourism Management, 33(6), 1483–1492. https://doi.org/10.1016/j.tourman.2012.02.002.
Harvey, S. (2014). Creative synthesis: Exploring the process of extraordinary group creativity. Academy of Management Review, 39(3), 324–343. https://doi.org/10.5465/amr.2012.0224.
Hiltunen, A. (2002). Aristotle in Hollywood: The anatomy of successful storytelling: Intellect books.
Hlee, S., Lee, H., & Koo, C. (2018). Hospitality and tourism online review research: A systematic analysis and heuristic-systematic model. Sustainability, 10(4), 1141. https://doi.org/10.3390/su10041141.
Holt, D. B. (2004). How brands become icons: The principles of cultural branding: Harvard business press.
Horst, H. A. (2012). New media technologies in everyday life. New York: Berg.
Hung, W.-L., Lee, Y.-J., & Huang, P.-H. (2016). Creative experiences, memorability and revisit intention in creative tourism. Current Issues in Tourism, 19(8), 763–770. https://doi.org/10.1080/13683500.2013.877422.
Iivari, J. (2003). The IS core-VII: Towards information systems as a science of meta-artifacts. Communications of the Association for Information Systems, 12(1), 37. https://doi.org/10.17705/1CAIS.01237
Isola, P., Xiao, J., Torralba, A., & Oliva, A. (2011). What makes an image memorable? CVPR, 2011, 145–152. https://doi.org/10.1109/CVPR.2011.5995721.
Jiang, W., Loui, A. C., & Cerosaletti, C. D. (2010). Automatic aesthetic value assessment in photographic images. Proceedings of the 2010 IEEE International Conference on Multimedia and Expo. https://doi.org/10.1109/ICME.2010.5582588.
Jung, K., Zhang, B.-T., & Mitra, P. (2015). Deep learning for the web. Proceedings of the 24th International Conference on World Wide Web Companion. https://doi.org/10.1145/2740908.2741982.
Kahneman, D. (2003). Maps of bounded rationality: Psychology for behavioral economics. The American Economic Review, 93(5), 1449–1475. https://doi.org/10.1257/000282803322655392.
Khosla, A., Raju, A. S., Torralba, A., & Oliva, A. (2015). Understanding and predicting image memorability at a large scale. Proceedings of the IEEE International Conference on Computer Vision. https://doi.org/10.1109/ICCV.2015.275.
Kim, H., & Jamal, T. (2007). Touristic quest for existential authenticity. Annals of Tourism Research, 34(1), 181–201. https://doi.org/10.1016/j.annals.2006.07.009.
Kim, H., & Richardson, S. L. (2003). Motion picture impacts on destination images. Annals of Tourism Research, 30(1), 216–237. https://doi.org/10.1016/S0160-7383(02)00062-2.
Kim, J.-H., Ritchie, J. B., & McCormick, B. (2012). Development of a scale to measure memorable tourism experiences. Journal of Travel Research, 51(1), 12–25. https://doi.org/10.1177/0047287510385467.
Kittur, A., Chi, E. H., & Suh, B. (2008). Crowdsourcing user studies with mechanical Turk. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/1357054.1357127.
Kolar, T., & Zabkar, V. (2010). A consumer-based model of authenticity: An oxymoron or the foundation of cultural heritage marketing? Tourism Management, 31(5), 652–664. https://doi.org/10.1016/j.tourman.2009.07.010.
Križman Pavlović, D., & Belullo, A. (2007). Internet-An agent of tourism destination image formation: Content and correspondence analysis of Istria travel related websites. International Conference on Global Challenges for Competitiveness : Business and Government Perspective, Pula, Hrvatska.
Labov, W. (1972). Language in the Inner City (Vol. 3). Philadelphia: University of Pennsylvania Press.
Lang, P. J., Bradley, M. M., & Cuthbert, B. N. (1997). Motivated attention: Affect, activation, and action. New York: NY.
LeCun, Y., & Bengio, Y. (1995). Pattern recognition and neural networks. Cambridge: MIT Press.
LeCun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998). Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86(11), 2278–2324. https://doi.org/10.1109/5.726791.
Lee, A. S., Thomas, M., & Baskerville, R. L. (2015). Going back to basics in design science: From the information technology artifact to the information systems artifact. Information Systems Journal, 25(1), 5–21. https://doi.org/10.1111/isj.12054.
Li, C., Gallagher, A., Loui, A. C., & Chen, T. (2010a). Aesthetic quality assessment of consumer photos with faces. IEEE International Conference on Image Processing. https://doi.org/10.1109/ICIP.2010.5651833.
Li, C., Loui, A. C., & Chen, T. (2010b). Towards aesthetics: A photo quality assessment and photo selection system. Proceedings of the 18th ACM International Conference on Multimedia. https://doi.org/10.1145/1873951.1874089.
Litvin, S. W., & Hoffman, L. M. (2012). Responses to consumer-generated media in the hospitality marketplace: An empirical study. Journal of Vacation Marketing, 18(2), 135–145. https://doi.org/10.1177/1356766712443467.
Liu, L., Chen, R., Wolf, L., & Cohen-Or, D. (2010). Optimizing photo composition. Computer Graphics Forum, 29, 469–478. https://doi.org/10.1111/j.1467-8659.2009.01616.x.
McCabe, A., & Peterson, C. (1990). What makes a narrative memorable? Applied PsychoLinguistics, 11(01), 73–82. https://doi.org/10.1017/S0142716400008298.
McKee, R., & Fryer, B. (2003). Storytelling that moves people. Harvard Business Review, 81(6), 51–55.
Morgan, M., Elbe, J., & de Esteban Curiel, J. (2009). Has the experience economy arrived? The views of destination managers in three visitor-dependent areas. International Journal of Tourism Research, 11(2), 201–216. https://doi.org/10.1002/jtr.719.
Munar, A. M. (2012). Social media strategies and destination management. Scandinavian Journal of Hospitality and Tourism, 12(2), 101–120. https://doi.org/10.1080/15022250.2012.679047.
Naaman, M., Nair, R., & Kaplun, V. (2008). Photos on the go: A mobile application case study. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/1357054.1357326.
Nunnally, J. C., Bernstein, I. H., & Berge, J. M.. (1967). Psychometric theory (Vol. 226): JSTOR.
Otto, J. E., & Ritchie, J. B. (1996). The service experience in tourism. Tourism Management, 17(3), 165–174. https://doi.org/10.1016/0261-5177(96)00003-9.
Park, E., Choi, B.-K., & Lee, T. J. (2019). The role and dimensions of authenticity in heritage tourism. Tourism Management, 74, 99–109. https://doi.org/10.1016/j.tourman.2019.03.001.
Pine, B. J., & Gilmore, J. H. (1998). Welcome to the experience economy. Harvard Business Review, 76, 97–105.
Preece, J., & Shneiderman, B. (2009). The reader-to-leader framework: Motivating technology-mediated social participation. AIS Transactions on Human-Computer Interaction, 1(1), 13–32. https://aisel.aisnet.org/thci/vol1/iss1/5
Ram, Y., Björk, P., & Weidenfeld, A. (2016). Authenticity and place attachment of major visitor attractions. Tourism Management, 52, 110–122. https://doi.org/10.1016/j.tourman.2015.06.010.
Ravina, E. (2012). Love & loans: The effect of beauty and personal characteristics in credit markets. New York: Columbia University.
Richards, G. (2011). Creativity and tourism: The state of the art. Annals of Tourism Research, 38(4), 1225–1253. https://doi.org/10.1016/j.annals.2011.07.008.
Richards, G., & Wilson, J. (2006). Developing creativity in tourist experiences: A solution to the serial reproduction of culture? Tourism Management, 27(6), 1209–1223. https://doi.org/10.1016/j.tourman.2005.06.002.
Ross, J., Irani, L., Silberman, M., Zaldivar, A., & Tomlinson, B. (2010). Who are the crowdworkers?: shifting demographics in mechanical turk. CHI'10 Extended Abstracts on Human Factors in Computing Systems. https://doi.org/10.1145/1753846.1753873.
Russell, J. A., & Pratt, G. (1980). A description of the affective quality attributed to environments. Journal of Personality and Social Psychology, 38(2), 311–322. https://doi.org/10.1037/0022-3514.38.2.311.
Sasser, S. L., & Koslow, S. (2008). Desperately seeking advertising creativity: Engaging an imaginative" 3Ps" research agenda. Journal of Advertising, 37(4), 5–20. https://doi.org/10.2753/JOA0091-3367370401.
Schank, R. C. (1990). Tell me a story: A new look at real and artificial memory: Charles Scribner's sons.
Shaw, G., Bailey, A., & Williams, A. (2011). Aspects of service-dominant logic and its implications for tourism management: Examples from the hotel industry. Tourism Management, 32(2), 207–214. https://doi.org/10.1016/j.tourman.2010.05.020.
Smith, C. S. (2003). Modes of discourse: The local structure of texts (Vol. 103): Cambridge University press.
Smith, R. E., Chen, J., & Yang, X. (2008). The impact of advertising creativity on the hierarchy of effects. Journal of Advertising, 37(4), 47–62. https://doi.org/10.2753/JOA0091-3367370404.
Smith, R. E., MacKenzie, S. B., Yang, X., Buchholz, L. M., & Darley, W. K. (2007). Modeling the determinants and effects of creativity in advertising. Marketing Science, 26(6), 819–833. https://doi.org/10.1287/mksc.1070.0272.
Sparks, B. A., & Browning, V. (2011). The impact of online reviews on hotel booking intentions and perception of trust. Tourism Management, 32(6), 1310–1323. https://doi.org/10.1016/j.tourman.2010.12.011.
Sthapit, E., & Coudounaris, D. N. (2018). Memorable tourism experiences: Antecedents and outcomes. Scandinavian Journal of Hospitality and Tourism, 18(1), 72–94. https://doi.org/10.1080/15022250.2017.1287003.
Sundar, S. S., & Kalyanaraman, S. (2004). Arousal, memory, and impression-formation effects of animation speed in web advertising. Journal of Advertising, 33(1), 7–17. https://doi.org/10.1080/00913367.2004.10639152.
Tung, V. W. S., & Ritchie, J. B. (2011). Exploring the essence of memorable tourism experiences. Annals of Tourism Research, 38(4), 1367–1386. https://doi.org/10.1016/j.annals.2011.03.009.
Tversky, A., & Kahneman, D. (1986). Rational choice and the framing of decisions. The Journal of Business, 59(4), S251–S278.
Vailaya, A., Figueiredo, M. A., Jain, A. K., & Zhang, H.-J. (2001). Image classification for content-based indexing. IEEE Transactions on Image Processing, 10(1), 117–130. https://doi.org/10.1109/83.892448.
Van Rompay, T. J., De Vries, P. W., & Van Venrooij, X. G. (2010). More than words: On the importance of picture–text congruence in the online environment. Journal of Interactive Marketing, 24(1), 22–30. https://doi.org/10.1016/j.intmar.2009.10.003.
Wang, Y., & Fesenmaier, D. R. (2004). Towards understanding members’ general participation in and active contribution to an online travel community. Tourism Management, 25(6), 709–722. https://doi.org/10.1016/j.tourman.2003.09.011.
Weick, K. E. (1995). Sensemaking in organizations (Vol. 3): Sage.
West, P. M., Huber, J., & Min, K. S. (2004). Altering experienced utility: The impact of story writing and self-referencing on preferences. Journal of Consumer Research, 31(3), 623–630. https://doi.org/10.1086/425097.
Williams, A. (2006). Tourism and hospitality marketing: Fantasy, feeling and fun. International Journal of Contemporary Hospitality Management, 18(6), 482–495. https://doi.org/10.1108/09596110610681520.
Wu, C. H., Huang, Y. M., & Hwang, J. P. (2015). Review of affective computing in education/learning: Trends and challenges. British Journal of Educational Technology., 47, 1304–1323. https://doi.org/10.1111/bjet.12324.
Yang, X., & Smith, R. E. (2009). Beyond attention effects: Modeling the persuasive and emotional effects of advertising creativity. Marketing Science, 28(5), 935–949. https://doi.org/10.1287/mksc.1080.0460.
You, Q., Jin, H., Wang, Z., Fang, C., & Luo, J. (2016). Image captioning with semantic attention. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. https://doi.org/10.1109/CVPR.2016.503.
Yüksel, A. (2007). Tourist shopping habitat: Effects on emotions, shopping value and behaviours. Tourism Management, 28(1), 58–69. https://doi.org/10.1016/j.tourman.2005.07.017.
Author information
Authors and Affiliations
Corresponding author
Additional information
Responsible Editor: Chulmo Koo
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This article is part of the Topical Collection on Artificial Intelligence (AI) and Robotics in Travel, Tourism and Leisure
Appendix
Appendix
Rights and permissions
About this article
Cite this article
Yim, D., Malefyt, T. & Khuntia, J. Is a picture worth a thousand views? Measuring the effects of travel photos on user engagement using deep learning algorithms. Electron Markets 31, 619–637 (2021). https://doi.org/10.1007/s12525-021-00472-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12525-021-00472-5
Keywords
- Image classification
- Object detection
- Subjective interpretation
- Artificial intelligence
- Deep learning
- Travel reviews
- User engagement