Abstract
Collaborative Filtering methods predict user interests and make recommendations just by using the rating matrix. However, in practice there is extensive side information about users and items, such as the age of the user, the actors in a movie, or the abstract of a journal article. In this paper, a novel model called Collaborative Poisson Factorization with Side-information (CPFS) is proposed which extends CTPF by incorporating richer kinds of side information conditionally as a prior to the model. CPFS is a monolithic hybridization model that combines features from different data sources into a single recommendation algorithm. We develop a Gibbs sampler and also a Variational method with closed-form updates for the inference of CPFS and demonstrate its applicability on a range of datasets including movies, books, academic papers, and travel. The extension improves prediction quality, especially in the cold start scenario. The connections between side information and topics are also intuitive.
Similar content being viewed by others
Notes
CTM models topic correlation by using logistic normal distribution instead of Dirichlet distribution.
Both CTPF and CPFS refer to this variable as 𝜖.
This method can be replaced with any available word embedding methods.
The values of X, i and j are related. For example, if X = 𝜃 then i = d (I = D) and j = l (J = L).
For example, \( \alpha ^{\theta }_{d,k} = {\prod }_{l=1}^{L}(\lambda ^{\theta }_{k,l})^{f^{\theta }_{d,l}}\).
The code can be found at https://github.com/premgopalan/collabtm
The code can be found at https://www.cs.toronto.edu/~rsalakhu/BPMF.html
The code can be found at https://github.com/eelxpeng/CollaborativeVAEhttps://github.com/eelxpeng/CollaborativeVAE
The code can be found at https://github.com/hexiangnan/neural_collaborative_filtering
References
Agarwal D, Chen BC (2010) FLDA : matrix factorization through latent Dirichlet allocation. In: Proceedings of the third ACM international conference on web search and data mining, ACM, pp 91–100
Attias H (2000) A variational Bayesian framework for graphical models. In: Solla SA, Leen TK, Müller K (eds) Advances in neural information processing systems 12. MIT Press, Cambridge, pp 209–215
Bansal T, Belanger D, McCallum A (2016) Ask the gru: Multi-task learning for deep text recommendations. In: Proceedings of the 10th ACM conference on recommender systems, ACM, pp 107–114
Blei DM, Lafferty JD (2005) Correlated topic models. In: Proceedings of the 18th international conference on neural information processing systems. MIT Press, Cambridge, pp 147–154
Blei DM, Ng AY, Jordan MI (2003) Latent Dirichlet allocation. J Mach Learn Res 3 (Jan):993–1022
Bobadilla J, Ortega F, Hernando A, Gutiérrez A (2013) Recommender systems survey. Knowl-Based Syst 46:109–132
Buntine W, Hutter M (2010) A Bayesian view of the poisson-Dirichlet process. arXiv:10070296
Buntine WL, Mishra S (2014) Experiments with non-parametric topic models. In: Proceedings of the 20th ACM SIGKDD international conference on knowledge discovery and data mining, pp 881–890
Chaney AJ, Blei DM, Eliassi-Rad T (2015) A probabilistic model for using social networks in personalized item recommendation. In: Proceedings of the 9th ACM conference on recommender systems, ACM, pp 43–50
Chen C, Du L, Buntine W (2011) Sampling table configurations for the hierarchical poisson-Dirichlet process. In: Joint european conference on machine learning and knowledge discovery in databases. Springer, New York, pp 296–311
Chen C, Zheng X, Wang Y, Hong F, Lin Z, et al. (2014) Context-aware collaborative topic regression with social matrix factorization for recommender systems. In: AAAI, pp 9–15
Chu WT, Tsai YL (2017) A hybrid recommendation system considering visual information for predicting favorite restaurants. World Wide Web 20(6):1313–1331
Gopalan P, Hofman JM, Blei DM (2013) Scalable recommendation with poisson factorization. arXiv:13111704
Gopalan PK, Charlin L, Blei D (2014) Content-based recommendations with poisson factorization. In: Advances in neural information processing systems, pp 3176–3184
Guo G, Zhang J, Yorke-Smith N (2015) TrustSVD: Collaborative filtering with both the explicit and implicit influence of user trust and of item ratings. In: AAAI, vol 15, pp 123–125
Han J, Zheng L, Xu Y, Zhang B, Zhuang F, Philip SY, Zuo W (2019) Adaptive deep modeling of users and items using side information for recommendation. IEEE Trans Neural Netw Learn Syst 31 (3):737–748
Harper FM, Konstan JA (2016) The movielens datasets: history and context. ACM Trans Interact Intell Syst (TiiS) 5(4):19
He X, Liao L, Zhang H, Nie L, Hu X, Chua TS (2017) Neural collaborative filtering. In: Proceedings of the 26th international conference on world wide web, pp 173–182
Johnson M, Saunderson J, Willsky A (2013) Analyzing hogwild parallel gaussian gibbs sampling. In: Advances in neural information processing systems, pp 2715–2723
Kim D, Park C, Oh J, Lee S, Yu H (2016) Convolutional matrix factorization for document context-aware recommendation. In: Proceedings of the 10th ACM conference on recommender systems, ACM, pp 233–240
Koren Y, Bell R, Volinsky C (2009) Matrix factorization techniques for recommender systems. Computer 42(8)
Li WJ, Yeung DY, Zhang Z (2011) Generalized latent factor models for social network analysis. In: Proceedings of the 22nd international joint conference on artificial intelligence (IJCAI), Barcelona, Spain, p 1705
Li X, She J (2017) Collaborative variational autoencoder for recommender systems. In: Proceedings of the 23rd ACM SIGKDD international conference on knowledge discovery and data mining, ACM, pp 305–314
Liang D, Charlin L, McInerney J, Blei DM (2016) Modeling user exposure in recommendation. In: Proceedings of the 25th international conference on World Wide Web, international world wide web conferences steering committee, pp 951–961
Liu T, Wang Z, Tang J, Yang S, Huang GY, Liu Z (2019) Recommender systems with heterogeneous side information. In: The World Wide Web conference, pp 3027–3033
Ma H, Yang H, Lyu MR, King I (2008) SoRec: social recommendation using probabilistic matrix factorization. In: Proceedings of the 17th ACM conference on information and knowledge management, ACM, pp 931–940
Ma H, Zhou D, Liu C, Lyu MR, King I (2011) Recommender systems with social regularization. In: Proceedings of the fourth ACM international conference on web search and data mining, ACM, pp 287–296
Mnih A, Salakhutdinov RR (2008) Probabilistic matrix factorization. In: Advances in neural information processing systems, pp 1257–1264
Van den Oord A, Dieleman S, Schrauwen B (2013) Deep content-based music recommendation. In: Advances in neural information processing systems, pp 2643–2651
Park C, Kim D, Oh J, Yu H (2016a) Improving top-k recommendation with truster and trustee relationship in user trust network. Inform Sci 374:100–114
Park C, Kim D, Oh J, Yu H (2016b) Trecso: Enhancing top-k recommendation with social information. In: Proceedings of the 25th international conference companion on World Wide Web, international World Wide Web conferences steering committee, pp 89–90
Purushotham S, Liu Y, Kuo CCJ (2012) Collaborative topic regression with social matrix factorization for recommendation systems. arXiv:12064684
Rendle S, Freudenthaler C, Gantner Z, Schmidt-Thieme L (2009) BPR: Bayesian personalized ranking from implicit feedback. In: Proceedings of the twenty-fifth conference on uncertainty in artificial intelligence. AUAI Press, New Jersey, pp 452–461
Salakhutdinov R, Mnih A (2008) Bayesian probabilistic matrix factorization using markov chain monte carlo. In: Proceedings of the 25th international conference on Machine learning, pp 880–887
Shan H, Banerjee A (2010) Generalized probabilistic matrix factorizations for collaborative filtering. In: Data mining (ICDM), 2010 IEEE 10th international conference on, IEEE, pp 1025–1030
Sun Z, Guo Q, Yang J, Fang H, Guo G, Zhang J, Burke R (2019) Research commentary on recommendations with side information: a survey and research directions. Electron Commer Res Appl 37:100879
Teh YW, Jordan MI, Beal MJ, Blei DM (2005) Sharing clusters among related groups: Hierarchical Dirichlet processes. In: Advances in neural information processing systems, pp 1385–1392
Wang C, Blei DM (2011) Collaborative topic modeling for recommending scientific articles. In: Proceedings of the 17th ACM SIGKDD international conference on knowledge discovery and data mining, ACM, pp 448–456
Wang H, Lu Y, Zhai C (2010) Latent aspect rating analysis on review text data: a rating regression approach. In: Proceedings of the 16th ACM SIGKDD international conference on knowledge discovery and data mining, ACM, pp 783–792
Wang H, Lu Y, Zhai C (2011) Latent aspect rating analysis without aspect keyword supervision. In: Proceedings of the 17th ACM SIGKDD international conference on knowledge discovery and data mining, ACM, pp 618–626
Wang H, Chen B, Li WJ (2013) Collaborative topic regression with social regularization for tag recommendation. In: IJCAI, pp 2719–2725
Wang H, Wang N, Yeung DY (2015) Collaborative deep learning for recommender systems. In: Proceedings of the 21th ACM SIGKDD international conference on knowledge discovery and data mining, ACM, pp 1235–1244
Wang X, Wang Y (2014) Improving content-based and hybrid music recommendation using deep learning. In: Proceedings of the 22nd ACM international conference on multimedia, ACM, pp 627–636
Zhang S, Yao L, Sun A, Tay Y (2019) Deep learning based recommender system: a survey and new perspectives. ACM Computing Surveys (CSUR) 52(1):5
Zhao H, Du L, Buntine W, Liu G (2019) Leveraging external information in topic modelling. Knowl Inf Syst 61(2):661– 693
Zheng L, Noroozi V, Yu PS (2017) Joint deep modeling of users and items using reviews for recommendation. In: Proceedings of the tenth ACM international conference on web search and data mining, pp 425–434
Zhou M (2015) Infinite edge partition models for overlapping community detection and link prediction. In: 18th international conferenceon artificial intelligence and statistics, pp 1135–1143
Zhou M, Carin L (2015) Negative binomial process count and mixture modeling. IEEE Trans Pattern Anal Mach Intell 37(2):307–320
Ziegler CN, McNee SM, Konstan JA, Lausen G (2005) Improving recommendation lists through topic diversification. In: Proceedings of the 14th international conference on World Wide Web, ACM, pp 22–32
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Ravanifard, R., Buntine, W. & Mirzaei, A. Recommending content using side information. Appl Intell 51, 3353–3374 (2021). https://doi.org/10.1007/s10489-020-01945-4
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10489-020-01945-4