Skip to main content
Log in

Recommending content using side information

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Collaborative Filtering methods predict user interests and make recommendations just by using the rating matrix. However, in practice there is extensive side information about users and items, such as the age of the user, the actors in a movie, or the abstract of a journal article. In this paper, a novel model called Collaborative Poisson Factorization with Side-information (CPFS) is proposed which extends CTPF by incorporating richer kinds of side information conditionally as a prior to the model. CPFS is a monolithic hybridization model that combines features from different data sources into a single recommendation algorithm. We develop a Gibbs sampler and also a Variational method with closed-form updates for the inference of CPFS and demonstrate its applicability on a range of datasets including movies, books, academic papers, and travel. The extension improves prediction quality, especially in the cold start scenario. The connections between side information and topics are also intuitive.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Notes

  1. CTM models topic correlation by using logistic normal distribution instead of Dirichlet distribution.

  2. Both CTPF and CPFS refer to this variable as 𝜖.

  3. https://grouplens.org/datasets/movielens/

  4. This method can be replaced with any available word embedding methods.

  5. The values of X, i and j are related. For example, if X = 𝜃 then i = d (I = D) and j = l (J = L).

  6. For example, \( \alpha ^{\theta }_{d,k} = {\prod }_{l=1}^{L}(\lambda ^{\theta }_{k,l})^{f^{\theta }_{d,l}}\).

  7. https://grouplens.org/datasets/movielens/1m/

  8. http://www.omdbapi.com/

  9. http://mallet.cs.umass.edu/topics.php

  10. http://www.citeulike.org/

  11. http://www.tripadvisor.com/

  12. http://www.cs.cmu.edu/~dbamman/booksummaries.html

  13. http://www.bookcrossing.com/

  14. https://doi.org/10.7910/DVN/HFM52Uhttps://doi.org/10.7910/DVN/Y9DYL6https://doi.org/10.7910/DVN/0BEMJLhttps://doi.org/10.7910/DVN/H8AR2H

  15. The code can be found at https://github.com/premgopalan/collabtm

  16. The code can be found at https://www.cs.toronto.edu/~rsalakhu/BPMF.html

  17. The code can be found at https://github.com/eelxpeng/CollaborativeVAEhttps://github.com/eelxpeng/CollaborativeVAE

  18. The code can be found at https://github.com/hexiangnan/neural_collaborative_filtering

References

  1. Agarwal D, Chen BC (2010) FLDA : matrix factorization through latent Dirichlet allocation. In: Proceedings of the third ACM international conference on web search and data mining, ACM, pp 91–100

  2. Attias H (2000) A variational Bayesian framework for graphical models. In: Solla SA, Leen TK, Müller K (eds) Advances in neural information processing systems 12. MIT Press, Cambridge, pp 209–215

  3. Bansal T, Belanger D, McCallum A (2016) Ask the gru: Multi-task learning for deep text recommendations. In: Proceedings of the 10th ACM conference on recommender systems, ACM, pp 107–114

  4. Blei DM, Lafferty JD (2005) Correlated topic models. In: Proceedings of the 18th international conference on neural information processing systems. MIT Press, Cambridge, pp 147–154

  5. Blei DM, Ng AY, Jordan MI (2003) Latent Dirichlet allocation. J Mach Learn Res 3 (Jan):993–1022

    MATH  Google Scholar 

  6. Bobadilla J, Ortega F, Hernando A, Gutiérrez A (2013) Recommender systems survey. Knowl-Based Syst 46:109–132

    Article  Google Scholar 

  7. Buntine W, Hutter M (2010) A Bayesian view of the poisson-Dirichlet process. arXiv:10070296

  8. Buntine WL, Mishra S (2014) Experiments with non-parametric topic models. In: Proceedings of the 20th ACM SIGKDD international conference on knowledge discovery and data mining, pp 881–890

  9. Chaney AJ, Blei DM, Eliassi-Rad T (2015) A probabilistic model for using social networks in personalized item recommendation. In: Proceedings of the 9th ACM conference on recommender systems, ACM, pp 43–50

  10. Chen C, Du L, Buntine W (2011) Sampling table configurations for the hierarchical poisson-Dirichlet process. In: Joint european conference on machine learning and knowledge discovery in databases. Springer, New York, pp 296–311

  11. Chen C, Zheng X, Wang Y, Hong F, Lin Z, et al. (2014) Context-aware collaborative topic regression with social matrix factorization for recommender systems. In: AAAI, pp 9–15

  12. Chu WT, Tsai YL (2017) A hybrid recommendation system considering visual information for predicting favorite restaurants. World Wide Web 20(6):1313–1331

    Article  Google Scholar 

  13. Gopalan P, Hofman JM, Blei DM (2013) Scalable recommendation with poisson factorization. arXiv:13111704

  14. Gopalan PK, Charlin L, Blei D (2014) Content-based recommendations with poisson factorization. In: Advances in neural information processing systems, pp 3176–3184

  15. Guo G, Zhang J, Yorke-Smith N (2015) TrustSVD: Collaborative filtering with both the explicit and implicit influence of user trust and of item ratings. In: AAAI, vol 15, pp 123–125

  16. Han J, Zheng L, Xu Y, Zhang B, Zhuang F, Philip SY, Zuo W (2019) Adaptive deep modeling of users and items using side information for recommendation. IEEE Trans Neural Netw Learn Syst 31 (3):737–748

    Article  Google Scholar 

  17. Harper FM, Konstan JA (2016) The movielens datasets: history and context. ACM Trans Interact Intell Syst (TiiS) 5(4):19

    Google Scholar 

  18. He X, Liao L, Zhang H, Nie L, Hu X, Chua TS (2017) Neural collaborative filtering. In: Proceedings of the 26th international conference on world wide web, pp 173–182

  19. Johnson M, Saunderson J, Willsky A (2013) Analyzing hogwild parallel gaussian gibbs sampling. In: Advances in neural information processing systems, pp 2715–2723

  20. Kim D, Park C, Oh J, Lee S, Yu H (2016) Convolutional matrix factorization for document context-aware recommendation. In: Proceedings of the 10th ACM conference on recommender systems, ACM, pp 233–240

  21. Koren Y, Bell R, Volinsky C (2009) Matrix factorization techniques for recommender systems. Computer 42(8)

  22. Li WJ, Yeung DY, Zhang Z (2011) Generalized latent factor models for social network analysis. In: Proceedings of the 22nd international joint conference on artificial intelligence (IJCAI), Barcelona, Spain, p 1705

  23. Li X, She J (2017) Collaborative variational autoencoder for recommender systems. In: Proceedings of the 23rd ACM SIGKDD international conference on knowledge discovery and data mining, ACM, pp 305–314

  24. Liang D, Charlin L, McInerney J, Blei DM (2016) Modeling user exposure in recommendation. In: Proceedings of the 25th international conference on World Wide Web, international world wide web conferences steering committee, pp 951–961

  25. Liu T, Wang Z, Tang J, Yang S, Huang GY, Liu Z (2019) Recommender systems with heterogeneous side information. In: The World Wide Web conference, pp 3027–3033

  26. Ma H, Yang H, Lyu MR, King I (2008) SoRec: social recommendation using probabilistic matrix factorization. In: Proceedings of the 17th ACM conference on information and knowledge management, ACM, pp 931–940

  27. Ma H, Zhou D, Liu C, Lyu MR, King I (2011) Recommender systems with social regularization. In: Proceedings of the fourth ACM international conference on web search and data mining, ACM, pp 287–296

  28. Mnih A, Salakhutdinov RR (2008) Probabilistic matrix factorization. In: Advances in neural information processing systems, pp 1257–1264

  29. Van den Oord A, Dieleman S, Schrauwen B (2013) Deep content-based music recommendation. In: Advances in neural information processing systems, pp 2643–2651

  30. Park C, Kim D, Oh J, Yu H (2016a) Improving top-k recommendation with truster and trustee relationship in user trust network. Inform Sci 374:100–114

    Article  Google Scholar 

  31. Park C, Kim D, Oh J, Yu H (2016b) Trecso: Enhancing top-k recommendation with social information. In: Proceedings of the 25th international conference companion on World Wide Web, international World Wide Web conferences steering committee, pp 89–90

  32. Purushotham S, Liu Y, Kuo CCJ (2012) Collaborative topic regression with social matrix factorization for recommendation systems. arXiv:12064684

  33. Rendle S, Freudenthaler C, Gantner Z, Schmidt-Thieme L (2009) BPR: Bayesian personalized ranking from implicit feedback. In: Proceedings of the twenty-fifth conference on uncertainty in artificial intelligence. AUAI Press, New Jersey, pp 452–461

  34. Salakhutdinov R, Mnih A (2008) Bayesian probabilistic matrix factorization using markov chain monte carlo. In: Proceedings of the 25th international conference on Machine learning, pp 880–887

  35. Shan H, Banerjee A (2010) Generalized probabilistic matrix factorizations for collaborative filtering. In: Data mining (ICDM), 2010 IEEE 10th international conference on, IEEE, pp 1025–1030

  36. Sun Z, Guo Q, Yang J, Fang H, Guo G, Zhang J, Burke R (2019) Research commentary on recommendations with side information: a survey and research directions. Electron Commer Res Appl 37:100879

    Article  Google Scholar 

  37. Teh YW, Jordan MI, Beal MJ, Blei DM (2005) Sharing clusters among related groups: Hierarchical Dirichlet processes. In: Advances in neural information processing systems, pp 1385–1392

  38. Wang C, Blei DM (2011) Collaborative topic modeling for recommending scientific articles. In: Proceedings of the 17th ACM SIGKDD international conference on knowledge discovery and data mining, ACM, pp 448–456

  39. Wang H, Lu Y, Zhai C (2010) Latent aspect rating analysis on review text data: a rating regression approach. In: Proceedings of the 16th ACM SIGKDD international conference on knowledge discovery and data mining, ACM, pp 783–792

  40. Wang H, Lu Y, Zhai C (2011) Latent aspect rating analysis without aspect keyword supervision. In: Proceedings of the 17th ACM SIGKDD international conference on knowledge discovery and data mining, ACM, pp 618–626

  41. Wang H, Chen B, Li WJ (2013) Collaborative topic regression with social regularization for tag recommendation. In: IJCAI, pp 2719–2725

  42. Wang H, Wang N, Yeung DY (2015) Collaborative deep learning for recommender systems. In: Proceedings of the 21th ACM SIGKDD international conference on knowledge discovery and data mining, ACM, pp 1235–1244

  43. Wang X, Wang Y (2014) Improving content-based and hybrid music recommendation using deep learning. In: Proceedings of the 22nd ACM international conference on multimedia, ACM, pp 627–636

  44. Zhang S, Yao L, Sun A, Tay Y (2019) Deep learning based recommender system: a survey and new perspectives. ACM Computing Surveys (CSUR) 52(1):5

    Google Scholar 

  45. Zhao H, Du L, Buntine W, Liu G (2019) Leveraging external information in topic modelling. Knowl Inf Syst 61(2):661– 693

    Article  Google Scholar 

  46. Zheng L, Noroozi V, Yu PS (2017) Joint deep modeling of users and items using reviews for recommendation. In: Proceedings of the tenth ACM international conference on web search and data mining, pp 425–434

  47. Zhou M (2015) Infinite edge partition models for overlapping community detection and link prediction. In: 18th international conferenceon artificial intelligence and statistics, pp 1135–1143

  48. Zhou M, Carin L (2015) Negative binomial process count and mixture modeling. IEEE Trans Pattern Anal Mach Intell 37(2):307–320

    Article  Google Scholar 

  49. Ziegler CN, McNee SM, Konstan JA, Lausen G (2005) Improving recommendation lists through topic diversification. In: Proceedings of the 14th international conference on World Wide Web, ACM, pp 22–32

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Abdolreza Mirzaei.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ravanifard, R., Buntine, W. & Mirzaei, A. Recommending content using side information. Appl Intell 51, 3353–3374 (2021). https://doi.org/10.1007/s10489-020-01945-4

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-020-01945-4

Keywords

Navigation