Skip to main content
Log in

NEXT: a neural network framework for next POI recommendation

  • Research Article
  • Published:
Frontiers of Computer Science Aims and scope Submit manuscript

Abstract

The task of next POI recommendations has been studied extensively in recent years. However, developing a unified recommendation framework to incorporate multiple factors associated with both POIs and users remains challenging, because of the heterogeneity nature of these information. Further, effective mechanisms to smoothly handle cold-start cases are also a difficult topic. Inspired by the recent success of neural networks in many areas, in this paper, we propose a simple yet effective neural network framework, named NEXT, for next POI recommendations. NEXT is a unified framework to learn the hidden intent regarding user’s next move, by incorporating different factors in a unified manner. Specifically, in NEXT, we incorporate meta-data information, e.g., user friendship and textual descriptions of POIs, and two kinds of temporal contexts (i.e., time interval and visit time). To leverage sequential relations and geographical influence, we propose to adopt DeepWalk, a network representation learning technique, to encode such knowledge. We evaluate the effectiveness of NEXT against other state-of-the-art alternatives and neural networks based solutions. Experimental results on three publicly available datasets demonstrate that NEXT significantly outperforms baselines in real-time next POI recommendations. Further experiments show inherent ability of NEXT in handling cold-start.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. He X, Liao L, Zhang H, Nie L, Hu X, Chua T S. Neural collaborative filtering. In: Proceedings of International Conference on World Wide Web. 2017, 173–182

    Google Scholar 

  2. Cheng C, Yang H, Lyu M R, King I. Where you like to go next: successive point-of-interest recommendation. In: Proceedings of International Joint Conference on Artificial Intelligence. 2013, 2605–2611

    Google Scholar 

  3. Feng S, Li X, Zeng Y, Cong G, Chee Y M, Yuan Q. Personalized ranking metric embedding for next new POI recommendation. In: Proceedings of International Joint Conference on Artificial Intelligence. 2015, 2069–2075

    Google Scholar 

  4. Ye M, Yin P, Lee W C, Lee D L. Exploiting geographical influence for collaborative point-of-interest recommendation. In: Proceedings of International ACM SIGIR Conference on Research and Development in Information Retrieval. 2011, 325–334

    Google Scholar 

  5. Li X, Cong G, Li X L, Pham T A N, Krishnaswamy S. Rank-GeoFM: a ranking based geographical factorization method for point of interest recommendation. In: Proceedings of International ACM SIGIR Conference on Research and Development in Information Retrieval. 2015, 433–442

    Google Scholar 

  6. Ye M, Yin P, Lee W C. Location recommendation for location-based social networks. In: Proceedings of SIGSPATIAL International Conference on Advances in Geographic Information Systems. 2010, 458–461

    Google Scholar 

  7. Xiong L, Chen X, Huang T K, Schneider J G, Carbonell J G. Temporal collaborative filtering with bayesian probabilistic tensor factorization. In: Proceedings of SIAM International Conference on Data Mining. 2010, 211–222

    Google Scholar 

  8. Yuan Q, Cong G, Ma Z, Sun A, Thalmann N M. Time-aware point-of-interest recommendation. In: Proceedings of International ACM SIGIR Conference on Research and Development in Information Retrieval. 2013, 363–372

    Google Scholar 

  9. Xie M, Yin H, Wang H, Xu F, Chen W, Wang S. Learning graph-based POI embedding for location-based recommendation. In: Proceedings of ACM International Conference on Information and Knowledge Management. 2016, 15–24

    Google Scholar 

  10. Zhang W, Wang J. Location and time aware social collaborative retrieval for new successive point-of-interest recommendation. In: Proceedings of ACM International Conference on Information and Knowledge Management. 2015, 1221–1230

    Google Scholar 

  11. Yin H, Cui B, Zhou X, Wang W, Huang Z, Sadiq S. Joint modeling of user check-in behaviors for real-time point-of-interest recommendation. ACM Transaction on Information Systems, 2016, 35(2): 11

    Google Scholar 

  12. Cheng C, Yang H, King I, Lyu M R. Fused matrix factorization with geographical and social influence in location-based social networks. In: Proceedings of AAAI Conference on Artificial Intelligence. 2012, 17–23

    Google Scholar 

  13. Liu B, Fu Y, Yao Z, Xiong H. Learning geographical preferences for point-of-interest recommendation. In: Proceedings of ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2013, 1043–1051

    Google Scholar 

  14. Liu B, Xiong H, Papadimitriou S, Fu Y, Yao Z. A general geographical probabilistic factor model for point of interest recommendation. IEEE Transactions on Knowledge and Data Engineering, 2015, 27(5): 1167-1179

    Google Scholar 

  15. Gao H, Tang J, Liu H. gSCorr: modeling geo-social correlations for new check-ins on location-based social networks. In: Proceedings of ACM International Conference on Information and Knowledge Management. 2012, 1582–1586

    Google Scholar 

  16. He J, Li X, Liao L, Song D, Cheung W K. Inferring a personalized next point-of-interest recommendation model with latent behavior patterns. In: Proceedings of AAAI Conference on Artificial Intelligence. 2016, 137–143

    Google Scholar 

  17. Zhao S, Zhao T, Yang H, Lyu M R, King I. STELLAR: spatial-temporal latent ranking for successive point-of-interest recommendation. In: Proceedings of AAAI Conference on Artificial Intelligence. 2016, 315–322

    Google Scholar 

  18. Mikolov T, Karafiát M, Burget L, Černocký J, Khudanpur S. Recurrent neural network based language model. In: Proceedings of Annual Conference of the International Speech Communication Association. 2010, 1045–1048

    Google Scholar 

  19. Mikolov T, Chen K, Corrada G, Dean J. Efficient estimation of word representations in vector space. 2013, arXiv preprint arXiv: 1301.3781

    Google Scholar 

  20. Cho K, Merrienboer B V, Gülçehre Ç, Bahdanau D, Bougares F, Schwenk H, Bengio Y. Learning phrase representations using RNN encoder-decoder for statistical machine translation. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing. 2014, 1724–1734

    Google Scholar 

  21. Bahdanau D, Cho K, Bengio Y. Neural machine translation by jointly learning to align and translate. In: Proceedings of International Conference on Learning Representations. 2015

    Google Scholar 

  22. Wang B, Liu K, Zhao J. Inner attention based recurrent neural networks for answer selection. In: Proceedings of Annual Meeting of the Association for Computational Linguistics. 2016, 1288–1297

    Google Scholar 

  23. Allamanis M, Peng H, Sutton C. A convolutional attention network for extreme summarization of source code. In: Proceedings of International Conference on Machine Learning. 2016, 2091–2100

    Google Scholar 

  24. Rumelhart D E, Hinton G E, Williams R J. Learning internal representations by error propagation. Technical Report, DTIC Document, 1985

    Google Scholar 

  25. Werbos P J. Generalization of backpropagation with application to a recurrent gas market model. Neural Networks, 1988, 1(4): 339–356

    Google Scholar 

  26. Bishop C M. Neural Networks for Pattern Recognition. Oxford: Oxford University Press, 1995

    MATH  Google Scholar 

  27. Hornik K, Stinchcombe M B, White H. Multilayer feedforward networks are universal approximators. Neural Networks, 1989, 2(5): 359–366

    MATH  Google Scholar 

  28. Covington P, Adams J, Sargin E. Deep neural networks for youtube recommendations. In: Proceedings of ACM Conference on Recommender Systems. 2016, 191–198

    Google Scholar 

  29. Kim D H, Park C, Oh J, Lee S, Yu H. Convolutional matrix factorization for document context-aware recommendation. In: Proceedings of ACM Conference on Recommender Systems. 2016, 233–240

    Google Scholar 

  30. Liu Q, Wu S, Wang L, Tan T. Predicting the next location: a recurrent model with spatial and temporal contexts. In: Proceedings of AAAI Conference on Artificial Intelligence. 2016, 194–200

    Google Scholar 

  31. Zheng L, Noroozi V, Philip S Y. Joint deep modeling of users and items using reviews for recommendation. In: Proceedings of ACM International Conference on Web Search and Data Mining. 2017, 425–434

    Google Scholar 

  32. Rendle S. Factorization machines with libFM. ACM Transactions Intelligent Systems and Technology, 2012, 3(3): 57

    Google Scholar 

  33. Elman J L. Finding structure in time. Cognitive Science, 1990, 14(2): 179–211

    Google Scholar 

  34. Yan R. i, poet: automatic poetry composition through recurrent neural networks with iterative polishing schema. In: Proceedings of International Joint Conference on Artificial Intelligence. 2016, 2238–2244

    Google Scholar 

  35. Zhang Y, Dai H, Xu C, Feng J, Wang T, Bian J, Wang B, Liu T Y. Sequential click prediction for sponsored search with recurrent neural networks. In: Proceedings of AAAI Conference on Artificial Intelligence. 2014, 1369–1375

    Google Scholar 

  36. Hochreiter S, Schmidhuber J. Long short-term memory. Neural Computation, 1997, 9(8): 1735–1780

    Google Scholar 

  37. Chen X, Qiu X, Zhu C, Liu P, Huang X. Long short-term memory neural networks for Chinese word segmentation. In: Proceedings of Conference on Empirical Methods in Natural Language Processing. 2015, 1197–1206

    Google Scholar 

  38. Rocktäschel T, Grefenstette E, Hermann K M, Kociský T, Blunsom P. Reasoning about entailment with neural attention. In: Proceedings of International Conference on Learning Representations. 2016

    Google Scholar 

  39. Chung J, Gülçehre C, Cho K, Bengio Y. Empirical evaluation of gated recurrent neural networks on sequence modeling. In: Proceedings of 2014 Workshop on Deep Learning. 2014

    Google Scholar 

  40. Manotumruksa J, Macdonald C, Ounis I. A deep recurrent collaborative filtering framework for venue recommendation. In: Proceedings of ACM International Conference on Information and Knowledge Management. 2017, 1429–1438

    Google Scholar 

  41. Feng J, Li Y, Zhang C, Sun F, Meng F, Guo A, Jin D. Deepmove: predicting human mobility with attentional recurrent networks. In: Proceedings of International Conference on World Wide Web. 2018, 1459–1468

    Google Scholar 

  42. Perozzi B, Rami A R, Skiena S. Deepwalk: online learning of social representations. In: Proceedings of ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2014, 701–710

    Google Scholar 

  43. Cho E, Myers S A, Leskovec J. Friendship and mobility: user movement in location-based social networks. In: Proceedings of ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2011, 1082–1090

    Google Scholar 

  44. Zhang J D, Chow C Y. Geosoca: exploiting geographical, social and categorical correlations for point-of-interest recommendations. In: Proceedings of International ACM SIGIR Conference on Research and Development in Information Retrieval. 2015, 443–452

    Google Scholar 

  45. Yang C, Liu Z, Zhao D, Sun M, Chang E Y. Network representation learning with rich text information. In: Proceedings of International Joint Conference on Artificial Intelligence. 2015, 2111–2117

    Google Scholar 

  46. Chen J, Zhang Q, Huang X. Incorporate group information to enhance network embedding. In: Proceedings of ACM International Conference on Information and Knowledge Management. 2016, 1901–1904

    Google Scholar 

  47. Salakhutdinov R, Mnih A. Probabilistic matrix factorization. In: Proceedings of International Conference on Neural Information Processing Systems. 2007, 1257–1264

    Google Scholar 

  48. Hu Y, Koren Y, Volinsky C. Collaborative filtering for implicit feedback datasets. In: Proceedings of IEEE International Conference on Data Mining. 2008, 263–272

    Google Scholar 

  49. Srivastava N, Salakhutdinov R. Multimodal learning with deep boltzmann machines. In: Proceedings of International Conference on Neural Information Processing Systems. 2012, 2231–2239

    Google Scholar 

  50. Glorot X, Bordes A, Bengio Y. Deep sparse rectifier neural networks. In: Proceedings of International Conference on Artificial Intelligence and Statistics. 2011, 315–323

    Google Scholar 

Download references

Acknowledgments

This research was supported by the National Natural Science Foundation of China (Grant Nos. 61872278, 61502344, 1636219, U1636101), Natural Science Foundation of Hubei Province (2017CFB502), Academic Team Building Plan for Young Scholars from Wuhan University (Whu2016012) and Singapore Ministry of Education Academic Research Fund Tier 2 (MOE2014-T2-2-066). We gratefully acknowledge the support of NVIDIA Corporation with the donation of the Titan X GPU used for this research.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Chenliang Li.

Additional information

Zhiqian Zhang is currently a Master student at Wuhan University, under the supervision of Dr. Chenliang Li. She received Bachelor degree from Wuhan University, China in 2015. Her research interests include natural language processing, information retrieval, data mining, and social media analysis and mining.

Chenliang Li received PhD from Nanyang Technological University, Singapore in 2013. Currently, he is an associate professor at School of Cyber Science and Engineering, Wuhan University, China. His research interests include information retrieval, text/Web mining, data mining, and natural language processing. His papers appear in SIGIR, CIKM, ACL, AAAI, TOIS, TKDE, and JASIST.

Zhiyong Wu is a currently PhD student at Department of Computer Science, the University of Hong Kong, China. He received Bachelor degree from Wuhan University, China in 2017. His research interests include data mining, natural language processing, and database.

Aixin Sun is an associate professor with School of Computer Engineering, Nanyang Technological University, Singapore. He received PhD from the same school in 2004. His research interests include information retrieval, text mining, social computing, and multimedia. His papers appear in major international conferences like SIGIR, KDD, WSDM, ACM Multimedia, and journals including TOIS, TKDE, and JASIST.

Dengpan Ye is currently a professor in School of Cyber Science and Engineering, Wuhan University, China. He received the BASc in automatic control from SCUT in 1996 and PhD degree at NJUST in 2005 respectively. He worked as a Post-Doctoral Fellow in Information System School of Singapore Management University, Singapore.

His research interests include machine learning and multimedia security. He is the author or co-author of more than 30 refereed journal and conference papers.

Xiangyang Luo is currently a professor at Zhengzhou Science and Technology Institute and the State Key Laboratory of Mathematical Engineering and Advanced Computing, China. His research interests lie in multimedia security and cyberspace surveying and mapping. He is the author or co-author of more than 100 refereed international journal and conference papers. He has obtained the support of the National Natural Science Foundation of China and the National Key R&D Program of China.

Electronic supplementary material

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhang, Z., Li, C., Wu, Z. et al. NEXT: a neural network framework for next POI recommendation. Front. Comput. Sci. 14, 314–333 (2020). https://doi.org/10.1007/s11704-018-8011-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11704-018-8011-2

Keywords

Navigation