Skip to main content
SpringerLink
Log in

Sequence and graph structure co-awareness via gating mechanism and self-attention for session-based recommendation

  • Original Article
  • Published:
International Journal of Machine Learning and Cybernetics Aims and scope Submit manuscript

Abstract

Session-based recommendation (SR) is important in online applications for its ability to predict user’s next interactions solely based on ongoing sessions. To recommend proper items at proper time are two key aspects in SR. The sequence of items in a session implies user’s preferences shift, which may give us clues about when the user interacted. The graph constructed based on a session can give latent structural dependencies between items, which may give us clues about which items users interacted with. They complement each other and collaborate to boost the performance of recommendation. Based on the motivation, we propose a novel sequence and graph structure co-awareness session-based recommendation model, namely SeqGo for short. In this model, a gated recurrent unit is employed to obtain sequence information and a gated graph neural network to get graph structure information. A two-stage fusion strategy is built to combine these two types of information to generate the representation of the general interest of users. The gating mechanism is used to calculate the relative importance of sequence and graph structure information. Then, multi-head masked self-attention is applied to assign different weights to different items and ignore irrelevant items. The user's general interest and the last item representing the user's current interest are combined to get the session representation to predict the probability of clicking on the next items. Experiment results on two real-world datasets show that SeqGo outperforms the state-of-the-art baselines.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

Notes

  1. https://2015.recsyschallenge.com/challege.html

  2. http://cikm2016.cs.iupui.edu/cikm-cup

  3. https://github.com/CRIPAC-DIG/SR-GNN

References

  1. Phuong TM, Thanh TC, Bach NX (2019) Neural session-aware recommendation. IEEE Access 7:86884–86896. https://doi.org/10.1109/ACCESS.2019.2926074

    Article  Google Scholar 

  2. Cao Y, Zhang W, Song B, Pan W, Xu C (2020) Position-aware context attention for session-based recommendation. Neurocomputing 376:65–72. https://doi.org/10.1016/j.neucom.2019.09.016

    Article  Google Scholar 

  3. Yu R, Liu Q, Ye Y et al (2020) Collaborative list-and-pairwise filtering from implicit feedback. IEEE Trans Knowl Data Eng 99:1–1

    Google Scholar 

  4. Wang S, Cao L, Wang Y (2019) A survey on session-based recommender systems. https://arxiv.org/abs/1902.04864. Accessed 13 Feb 2019

  5. Guo Y, Zhang D, Ling Y, Chen H (2020) A Joint neural network for session-aware recommendation. IEEE Access 8:74205–74215. https://doi.org/10.1109/ACCESS.2020.2984287

    Article  Google Scholar 

  6. Peng B, Ren Z, Parthasarathy S, Ning X (2021) HAM: hybrid associations models for sequential recommendation. IEEE Trans Knowl Data Eng. https://doi.org/10.1109/TKDE.2021.3049692

  7. Wu S, Tang Y, Zhu Y, et al. (2019) Session-based recommendation with graph neural networks. In: AAAI '19: Proceedings of the 33th AAAI Conference on Artificial Intelligence. https://doi.org/10.1609/aaai.v33i01.3301346

  8. Xu C, Zhao P, Liu Y, et al. (2019) Graph contextualized self-attention network for session-based recommendation. In: IJCAI '19: Proceedings of the 28th International Joint Conference on Artificial Intelligence 3940–3946. https://doi.org/10.24963/ijcai.2019/547

  9. Hidasi B, Karatzoglou A, Baltrunas L, Tikk D (2015) Session-based recommendations with recurrent neural networks. https://arxiv.org/abs/1511.06939. Accessed 21 Nov 2015

  10. Tan YK, Xu X, Liu Y (2016) Improved recurrent neural networks for session-based recommendations. In: DLRS '19: Proceedings of the 1st Workshop on Deep Learning for Recommender Systems 17–22. https://doi.org/10.1145/2988450.2988452

  11. Davidson J, Liebald B, Liu J, et al. (2010) The YouTube video recommendation system. In: RecSys '10: Proceedings of the 4th ACM Conference on Recommender Systems 293–296. https://doi.org/10.1145/1864708.1864770

  12. Jannach D, Ludewig M (2017) When recurrent neural networks meet the neighborhood for session-based recommendation. In: RecSys '17: Proceedings of the 11th ACM Conference on Recommender Systems 306–310. https://doi.org/https://doi.org/10.1145/3109859.3109872

  13. Hidasi B, Karatzoglou A (2018) Recurrent neural networks with top-k gains for session-based recommendations. In: CIKM '18: Proceedings of the 27th ACM International Conference on Information and Knowledge Management 843–852. https://doi.org/10.1145/3269206.3271761

  14. Li J, Ren P, Chen Z, et al. (2017) Neural attentive session-based recommendation. In: CIKM '17: Proceedings of the 26th ACM International Conference on Information and Knowledge Management 1419–1428. https://doi.org/10.1145/3132847.3132926

  15. Liu Q, Zeng Y, Mokhosi R, Zhang H (2018) STAMP: short-term attention/memory priority model for session-based recommendation. In: KDD '18: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining 1831–1839. https://doi.org/10.1145/3219819.3219950

  16. Hidasi B, Quadrana M, Karatzoglou A, Tikk D (2016) Parallel recurrent neural network architectures for feature-rich session-based recommendations. In: RecSys '16: Proceedings of the 10th ACM conference on Recommender systems 241–248. https://doi.org/10.1145/2959100.2959167

  17. Bogina V, Kuflik T (2017) incorporating dwell time in session-based recommendations with recurrent neural networks. In: RecSys '17: Proceedings of the Poster Track of the 11th ACM Conference on Recommender Systems 1922:57–59. http://ceur-ws.org/Vol-1922/paper11.pdf

  18. Quadrana M, Karatzoglou A, Hidasi B, Cremonesi P (2017) Personalizing session-based recommendations with hierarchical recurrent neural networks. In: RecSys '17: Proceedings of the 11th ACM Conference on Recommender Systems 130–137. https://doi.org/10.1145/3109859.3109896

  19. Li Z, Zhao H, Liu Q, et al. (2018) Learning from history and present: next-item recommendation via discriminatively exploiting user behaviors. In: KDD '18: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining 1734–1743. https://doi.org/10.1145/3219819.3220014

  20. Gori M, Monfardini G, Scarselli F (2005) A new model for learning in graph domains. In: IJCNN '05: Proceedings of the 2005 IEEE International Joint Conference on Neural Networks 729–734. https://doi.org/10.1109/IJCNN.2005.1555942

  21. Scarselli F, Gori M, Tsoi AC et al (2009) The graph neural network model. IEEE Trans Neural Netw 20:61–80. https://doi.org/10.1109/TNN.2008.2005605

    Article  Google Scholar 

  22. Li Y, Tarlow D, Brockschmidt M, Zemel R (2016) Gated graph sequence neural networks. In: ICLR '16: Proceedings of the 4th International Conference on Learning Representations.

  23. Koren Y (2008) Factorization meets the neighborhood: a multifaceted collaborative filtering model. In: KDD '08: Proceedings of the 14th ACM SIGKDD conference on Knowledge discovery and data mining 426–434. https://doi.org/10.1145/1401890.1401944

  24. Rendle S, Freudenthaler C, Gantner Z, Schmidt-Thieme L (2009) BPR: bayesian personalized ranking from implicit feedback. In: UAI '09: Proceedings of the Twenty-Fifth Conference on Uncertainty in Artificial Intelligence 452–461.

  25. Sarwar B, Karypis G, Konstan J, Riedl J (2001) Item-based collaborative filtering recommendation algorithms. In: WWW '01: Proceedings of the 10th international conference on World Wide Web 285–295. https://doi.org/10.1145/371920.372071

  26. Linden G, Smith B, York J (2008) Amazon.com recommendations: item-to-item collaborative filtering. IEEE Internet Comput 7:76–80. https://doi.org/10.1109/MIC.2003.1167344

    Article  Google Scholar 

  27. He Q, Jiang D, Liao Z, et al. (2009) Web query recommendation via sequential query prediction. In: ICDE '09: Proceedings of the 2009 IEEE International Conference on Data Engineering. https://doi.org/10.1109/ICDE.2009.71

  28. Rendle S, Freudenthaler C, Schmidt-Thieme L (2010) Factorizing personalized Markov chains for next-basket recommendation. In: WWW '10: Proceedings of the 19th international conference on World wide web 811–820. https://doi.org/10.1145/1772690.1772773

  29. Aghdam MH, Hariri N, Mobasher B, Burke R (2015) Adapting recommendations to contextual changes using hierarchical hidden markov models. In: RecSys '15: Proceedings of the 9th ACM Conference on Recommender Systems 241–244. https://doi.org/10.1145/2792838.2799684

  30. He R, McAuley J (2016) Fusing similarity models with markov chains for sparse sequential recommendation. In: ICDM '16: Proceedings of the 2016 IEEE International Conference on Data Mining. https://doi.org/10.1109/ICDM.2016.0030

  31. Wang S, Cao L, Wang Y, et al. (2019) Modeling multi-purpose sessions for next-item recommendations via mixture-channel purpose routing networks. In: IJCAI '19: Proceedings of the 28th International Joint Conference on Artificial Intelligence. https://www.ijcai.org/Proceedings/2019/523

  32. Wang S, Cao L, Hu L, et al. (2018) Attention-based transactional context embedding for next-item recommendation. In: AAAI '18: Proceedings of the 32th AAAI Conference on Artificial Intelligence. https://doi.org/10.1609/aaai.v33i01.3301346

  33. Zhou J, Cui G, Zhang Z et al (2020) Graph neural networks: a review of methods and applications. AI Open 1:57–81. https://doi.org/10.1016/j.aiopen.2021.01.001

    Article  Google Scholar 

  34. Liu L, Wang L, Lian T (2021) CaSe4SR: using category sequence graph to augment session-based recommendation. Knowl Based Syst 212. https://linkinghub.elsevier.com/retrieve/pii/S0950705120306870

  35. Donkers T, Loepp B, Ziegler J (2017) Sequential user-based recurrent neural network recommendations. In: RecSys '17: Proceedings of the 11th ACM Conference on Recommender Systems 152–160. https://doi.org/10.1145/3109859.3109877

  36. Wang M, Ren P, Mei L, et al. (2019) A collaborative session-based recommendation approach with parallel memory modules. In: SIGIR'19: Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval 345–354. https://doi.org/10.1145/3331184.3331210

  37. Vaswani A, Shazeer N, Parmar N, et al. (2017) Attention is all you need. In: NIPS '17: Proceedings of the 31st Annual Conference on Neural Information Processing Systems 5999–6009.

  38. Kang W, McAuley J (2018) Self-attentive sequential recommendation. In: ICDM '18: Proceedings of the IEEE 18th International Conference on Data Mining. https://doi.org/10.1109/ICDM.2018.00035

  39. Li J, Wang Y, McAuley J (2018) Time interval aware self-attention for sequential recommendation. In: WSDM '20: Proceedings of the 13th International Conference on Web Search and Data Mining 322–330. https://doi.org/10.1145/3336191.3371786

  40. Sun F, Liu J, Wu J, et al. (2019) BERT4Rec: sequential recommendation with bidirectional encoder representations from transformer. In: CIKM '19: Proceedings of the 28th ACM International Conference on Information and Knowledge Management 1441–1450. https://doi.org/10.1145/3357384.3357895

  41. He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: CVPR '16: Proceedings of the 29th IEEE Conference on Computer Vision and Pattern Recognition. https://doi.org/10.1109/CVPR.2016.90

  42. Srivastava N, Hinton G, Krizhevsky A et al (2014) Dropout: a simple way to prevent neural networks from overfitting. J Mach Learn Res 15:1929–1958

    MathSciNet  MATH  Google Scholar 

  43. Ludewig M, Mauro N, Latifi S, Jannach D (2021) Empirical analysis of session-based recommendation algorithms. User Model User-Adap Inter 31:149–181. https://doi.org/10.1007/s11257-020-09277-1

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by National Natural Science Foundation of China under Grant No. 61872260.

Author information

Authors and Affiliations

  1. College of Information and Computer, Taiyuan University of Technology, Jinzhong, 030600, China

    Jingjing Qiao & Liguo Duan

  2. College of Data Science, Taiyuan University of Technology, Jinzhong, 030600, China

    Li Wang

Authors
  1. Jingjing Qiao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Li Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Liguo Duan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Li Wang.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Qiao, J., Wang, L. & Duan, L. Sequence and graph structure co-awareness via gating mechanism and self-attention for session-based recommendation. Int. J. Mach. Learn. & Cyber. 12, 2591–2605 (2021). https://doi.org/10.1007/s13042-021-01343-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13042-021-01343-3

Keywords

Search

Navigation