Abstract
Among various recommendation methods, latent factor models are usually considered to be state-of-the-art techniques, which aim to learn user and item embeddings for predicting user-item preferences. When applying latent factor models to the recommendation with implicit feedback, the quality of embeddings always suffers from inadequate positive feedback and noisy negative feedback. Inspired by the idea of NSVD that represents users based on their interacted items, this article proposes a dual-embedding based deep latent factor method for recommendation with implicit feedback. In addition to learning a primitive embedding for a user (resp. item), we represent each user (resp. item) with an additional embedding from the perspective of the interacted items (resp. users) and propose attentive neural methods to discriminate the importance of interacted users/items for dual-embedding learning. We design two dual-embedding based deep latent factor models, DELF and DESEQ, for pure collaborative filtering and temporal collaborative filtering (i.e., sequential recommendation), respectively. The novel attempt of the proposed models is to capture each user-item interaction with four deep representations that are subtly fused for preference prediction. We conducted extensive experiments on four real-world datasets. The results verify the effectiveness of user/item dual embeddings and the superior performance of our methods on item recommendation.
- Charu C. Aggarwal. 2016. Recommender Systems - The Textbook. Springer. DOI:https://doi.org/10.1007/978-3-319-29659-3Google ScholarDigital Library
- Charu C. Aggarwal and Srinivasan Parthasarathy. 2001. Mining massively incomplete data sets by conceptual reconstruction. In Proceedings of the 7th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 227--232.Google Scholar
- Georgios Alexandridis, Georgios Siolas, and Andreas Stafylopatis. 2017. ParVecMF: A paragraph vector-based matrix factorization recommender system. arXiv preprint arXiv:1706.07513 (2017).Google Scholar
- Georgios Alexandridis, Thanos Tagaris, Giorgos Siolas, and Andreas Stafylopatis. 2019. From free-text user reviews to product recommendation using paragraph vectors and matrix factorization. In Proceedings of the Companion of the 2019 World Wide Web Conference. 335--343. DOI:https://doi.org/10.1145/3308560.3316601Google ScholarDigital Library
- Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2014. Neural machine translation by jointly learning to align and translate. In Proceedings of the 3rd International Conference on Learning Representations (ICLR'15).Google Scholar
- Immanuel Bayer, Xiangnan He, Bhargav Kanagal, and Steffen Rendle. 2017. A generic coordinate descent framework for learning from implicit feedback. In Proceedings of the 26th International Conference on World Wide Web. 1341--1350. DOI:https://doi.org/10.1145/3038912.3052694Google ScholarDigital Library
- Yoshua Bengio, Aaron C. Courville, and Pascal Vincent. 2013. Representation learning: A review and new perspectives. IEEE Trans. Pattern Anal. Mach. Intell. 35, 8 (2013), 1798--1828. DOI:https://doi.org/10.1109/TPAMI.2013.50Google ScholarDigital Library
- John S. Breese, David Heckerman, and Carl Myers Kadie. 1998. Empirical analysis of predictive algorithms for collaborative filtering. In Proceedings of the 14th Conference on Uncertainty in Artificial Intelligence. 43--52.Google Scholar
- John F. Canny. 2002. Collaborative filtering with privacy via factor analysis. In Proceedings of the 25th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. 238--245. DOI:https://doi.org/10.1145/564376.564419Google ScholarDigital Library
- Jingyuan Chen, Hanwang Zhang, Xiangnan He, Liqiang Nie, Wei Liu, and Tat-Seng Chua. 2017. Attentive collaborative filtering: Multimedia recommendation with item- and component-level attention. In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval. 335--344. DOI:https://doi.org/10.1145/3077136.3080797Google ScholarDigital Library
- Lei Chen, Le Wu, Richang Hong, Kun Zhang, and Meng Wang. 2020. Revisiting graph based collaborative filtering: A Linear residual graph convolutional network approach. In Proceedings of the 34th AAAI Conference on Artificial Intelligence. 27--34.Google ScholarCross Ref
- Xu Chen, Hongteng Xu, Yongfeng Zhang, Jiaxi Tang, Yixin Cao, Zheng Qin, and Hongyuan Zha. 2018. Sequential recommendation with user memory networks. In Proceedings of the 11th ACM International Conference on Web Search and Data Mining. Yi Chang, Chengxiang Zhai, Yan Liu, and Yoelle Maarek (Eds.). ACM, 108--116. DOI:https://doi.org/10.1145/3159652.3159668Google ScholarDigital Library
- Chen Cheng, Haiqin Yang, Michael R. Lyu, and Irwin King. 2013. Where you like to go next: Successive point-of-interest recommendation. In Proceedings of the 23rd International Joint Conference on Artificial Intelligence. 2605--2611.Google ScholarDigital Library
- Weiyu Cheng, Yanyan Shen, and Linpeng Huang. 2020. Adaptive factorization network: Learning adaptive-order feature interactions. In Proceedings of the 34th AAAI Conference on Artificial Intelligence. 3609--3616. Retrieved from https://aaai.org/ojs/index.php/AAAI/article/view/5768Google ScholarCross Ref
- Weiyu Cheng, Yanyan Shen, Yanmin Zhu, and Linpeng Huang. 2018. DELF: A dual-embedding based deep latent factor model for recommendation. In Proceedings of the 27th International Joint Conference on Artificial Intelligence. 3329--3335. DOI:https://doi.org/10.24963/ijcai.2018/462Google ScholarCross Ref
- Qiang Cui, Shu Wu, Qiang Liu, Wen Zhong, and Liang Wang. 2020. MV-RNN: A multi-view recurrent neural network for sequential recommendation. IEEE Trans. Knowl. Data Eng. 32, 2 (2020), 317--331. DOI:https://doi.org/10.1109/TKDE.2018.2881260Google ScholarDigital Library
- Robin Devooght, Nicolas Kourtellis, and Amin Mantrach. 2015. Dynamic matrix factorization with priors on unknown values. In Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 189--198. DOI:https://doi.org/10.1145/2783258.2783346Google ScholarDigital Library
- Jingtao Ding, Yuhan Quan, Xiangnan He, Yong Li, and Depeng Jin. 2019. Reinforced negative sampling for recommendation with exposure data. In Proceedings of the 28th International Joint Conference on Artificial Intelligence. 2230--2236. DOI:https://doi.org/10.24963/ijcai.2019/309Google ScholarCross Ref
- Xue Geng, Hanwang Zhang, Jingwen Bian, and Tat-Seng Chua. 2015. Learning image and user features for recommendation in social networks. In Proceedings of the 2015 IEEE International Conference on Computer Vision. 4274--4282. DOI:https://doi.org/10.1109/ICCV.2015.486Google ScholarDigital Library
- Xavier Glorot, Antoine Bordes, and Yoshua Bengio. 2011. Deep sparse rectifier neural networks. In Proceedings of the 14th International Conference on Artificial Intelligence and Statistics. 315--323.Google Scholar
- Ruining He and Julian McAuley. 2016. Fusing similarity models with Markov chains for sparse sequential recommendation. In Proceedings of the IEEE 16th International Conference on Data Mining. 191--200. DOI:https://doi.org/10.1109/ICDM.2016.0030Google ScholarCross Ref
- Xiangnan He, Tao Chen, Min-Yen Kan, and Xiao Chen. 2015. TriRank: Review-aware explainable recommendation by modeling aspects. In Proceedings of the 24th ACM International Conference on Information and Knowledge Management. 1661--1670. DOI:https://doi.org/10.1145/2806416.2806504Google ScholarDigital Library
- Xiangnan He, Kuan Deng, Xiang Wang, Yan Li, Yong-Dong Zhang, and Meng Wang. 2020. LightGCN: Simplifying and powering graph convolution network for recommendation. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 639--648. DOI:https://doi.org/10.1145/3397271.3401063Google ScholarDigital Library
- Xiangnan He, Ming Gao, Min-Yen Kan, Yiqun Liu, and Kazunari Sugiyama. 2014. Predicting the popularity of web 2.0 items based on user comments. In Proceedings of the 37th International ACM SIGIR Conference on Research and Development in Information Retrieval. 233--242. DOI:https://doi.org/10.1145/2600428.2609558Google ScholarDigital Library
- Xiangnan He, Zhankui He, Jingkuan Song, Zhenguang Liu, Yu-Gang Jiang, and Tat-Seng Chua. 2018. NAIS: Neural attentive item similarity model for recommendation. IEEE Trans. Knowl. Data Eng. 30, 12 (2018), 2354--2366. DOI:https://doi.org/10.1109/TKDE.2018.2831682Google ScholarDigital Library
- Xiangnan He, Lizi Liao, Hanwang Zhang, Liqiang Nie, Xia Hu, and Tat-Seng Chua. 2017. Neural collaborative filtering. In Proceedings of the 26th International Conference on World Wide Web. 173--182. DOI:https://doi.org/10.1145/3038912.3052569Google ScholarDigital Library
- Xiangnan He, Hanwang Zhang, Min-Yen Kan, and Tat-Seng Chua. 2016. Fast matrix factorization for online recommendation with implicit feedback. In Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval. 549--558. DOI:https://doi.org/10.1145/2911451.2911489Google ScholarDigital Library
- Balázs Hidasi, Alexandros Karatzoglou, Linas Baltrunas, and Domonkos Tikk. 2015. Session-based recommendations with recurrent neural networks. In Proceedings of the 4th International Conference on Learning Representations (ICLR'16).Google Scholar
- Kurt Hornik, Maxwell B. Stinchcombe, and Halbert White. 1989. Multilayer feedforward networks are universal approximators. Neural Networks 2, 5 (1989), 359--366. DOI:https://doi.org/10.1016/0893-6080(89)90020-8Google ScholarCross Ref
- Yifan Hu, Yehuda Koren, and Chris Volinsky. 2008. Collaborative filtering for implicit feedback datasets. In Proceedings of the 8th IEEE International Conference on Data Mining (ICDM’08). 263--272. DOI:https://doi.org/10.1109/ICDM.2008.22Google ScholarDigital Library
- Dietmar Jannach and Malte Ludewig. 2017. When recurrent neural networks meet the neighborhood for session-based recommendation. In Proceedings of the 11th ACM Conference on Recommender Systems. 306--310. DOI:https://doi.org/10.1145/3109859.3109872Google ScholarDigital Library
- Santosh Kabbur, Xia Ning, and George Karypis. 2013. FISM: Factored item similarity models for top-N recommender systems. In Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 659--667. DOI:https://doi.org/10.1145/2487575.2487589Google ScholarDigital Library
- Wang-Cheng Kang and Julian J. McAuley. 2018. Self-attentive sequential recommendation. In Proceedings of the IEEE International Conference on Data Mining. IEEE Computer Society, 197--206. DOI:https://doi.org/10.1109/ICDM.2018.00035Google Scholar
- Eunhui Kim and Munchurl Kim. 2016. Topic-tracking-based dynamic user modeling with TV recommendation applications. Appl. Intell. 44, 4 (2016), 771--792. DOI:https://doi.org/10.1007/s10489-015-0720-8Google ScholarDigital Library
- Diederik P. Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. In Proceedings of the 3rd International Conference on Learning Representations (ICLR'15).Google Scholar
- Yehuda Koren. 2008. Factorization meets the neighborhood: A multifaceted collaborative filtering model. In Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 426--434. DOI:https://doi.org/10.1145/1401890.1401944Google ScholarDigital Library
- Yehuda Koren. 2009. Collaborative filtering with temporal dynamics. In Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 447--456. DOI:https://doi.org/10.1145/1557019.1557072Google ScholarDigital Library
- Walid Krichene and Steffen Rendle. 2020. On sampled metrics for item recommendation. In Proceedings of the 26th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 1748--1757.Google ScholarDigital Library
- Ranzhen Li, Yanyan Shen, and Yanmin Zhu. 2018. Next point-of-interest recommendation with temporal and multi-level context attention. In Proceedings of the IEEE International Conference on Data Mining. 1110--1115. DOI:https://doi.org/10.1109/ICDM.2018.00144Google ScholarCross Ref
- Sheng Li, Jaya Kawale, and Yun Fu. 2015. Deep collaborative filtering via marginalized denoising auto-encoder. In Proceedings of the 24th ACM International Conference on Information and Knowledge Management. 811--820. DOI:https://doi.org/10.1145/2806416.2806527Google ScholarDigital Library
- Roi Livni, Shai Shalev-Shwartz, and Ohad Shamir. 2014. On the computational efficiency of training neural networks. In Proceedings of the Annual Conference on Neural Information Processing Systems. 855--863.Google Scholar
- Thomas Nedelec, Elena Smirnova, and Flavian Vasile. 2016. Content2vec: Specializing joint representations of product images and text for the task of product recommendation. (2016).Google Scholar
- Makbule Gulcin Ozsoy. 2016. From word embeddings to item recommendation. arXiv preprint arXiv:1601.01356 (2016).Google Scholar
- Makbule Gulcin Ozsoy. 2020. Utilizing fasttext for venue recommendation. arXiv preprint arXiv:2005.12982 (2020).Google Scholar
- Rong Pan and Martin Scholz. 2009. Mind the gaps: Weighting the unknown in large-scale one-class collaborative filtering. In Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 667--676. DOI:https://doi.org/10.1145/1557019.1557094Google ScholarDigital Library
- Rong Pan, Yunhong Zhou, Bin Cao, Nathan Nan Liu, Rajan M. Lukose, Martin Scholz, and Qiang Yang. 2008. One-class collaborative filtering. In Proceedings of the 8th IEEE International Conference on Data Mining (ICDM’08). 502--511. DOI:https://doi.org/10.1109/ICDM.2008.16Google ScholarDigital Library
- Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, Alban Desmaison, Andreas Kopf, Edward Yang, Zachary DeVito, Martin Raison, Alykhan Tejani, Sasank Chilamkurthy, Benoit Steiner, Lu Fang, Junjie Bai, and Soumith Chintala. 2019. PyTorch: An imperative style, high-performance deep learning library. In Proceedings of the Advances in Neural Information Processing Systems. H. Wallach, H. Larochelle, A. Beygelzimer, F. d'Alché-Buc, E. Fox, and R. Garnett (Eds.). Curran Associates, Inc., 8024--8035.Google Scholar
- Arkadiusz Paterek. 2007. Improving regularized singular value decomposition for collaborative filtering. In Proceedings of KDD Cup and Workshop. Vol. 2007. 5--8.Google Scholar
- Lutz Prechelt. 1998. Early stopping-but when? In Neural Networks: Tricks of the Trade. Springer, 55--69.Google ScholarDigital Library
- Steffen Rendle, Christoph Freudenthaler, Zeno Gantner, and Lars Schmidt-Thieme. 2009. BPR: Bayesian personalized ranking from implicit feedback. In Proceedings of the 25th Conference on Uncertainty in Artificial Intelligence. 452--461.Google ScholarDigital Library
- Steffen Rendle, Christoph Freudenthaler, and Lars Schmidt-Thieme. 2010. Factorizing personalized Markov chains for next-basket recommendation. In Proceedings of the 19th International Conference on World Wide Web. 811--820. DOI:https://doi.org/10.1145/1772690.1772773Google ScholarDigital Library
- Steffen Rendle and Lars Schmidt-Thieme. 2008. Online-updating regularized kernel matrix factorization models for large-scale recommender systems. In Proceedings of the 2008 ACM Conference on Recommender Systems. 251--258. DOI:https://doi.org/10.1145/1454008.1454047Google ScholarDigital Library
- Badrul Munir Sarwar, George Karypis, Joseph A. Konstan, and John Riedl. 2001. Item-based collaborative filtering recommendation algorithms. In Proceedings of the 10th International World Wide Web Conference. 285--295. DOI:https://doi.org/10.1145/371920.372071Google ScholarDigital Library
- Badrul Munir Sarwar, George Karypis, Joseph A. Konstan, and John Riedl. 2001. Item-based collaborative filtering recommendation algorithms. In Proceedings of the 10th International World Wide Web Conference. 285--295. DOI:https://doi.org/10.1145/371920.372071Google ScholarDigital Library
- Jiaxi Tang and Ke Wang. 2018. Personalized Top-N sequential recommendation via convolutional sequence embedding. In Proceedings of the 11th ACM International Conference on Web Search and Data Mining. 565--573. DOI:https://doi.org/10.1145/3159652.3159656Google ScholarDigital Library
- Flavian Vasile, Elena Smirnova, and Alexis Conneau. 2016. Meta-Prod2Vec: Product embeddings using side-information for recommendation. In Proceedings of the 10th ACM Conference on Recommender Systems. 225--232. DOI:https://doi.org/10.1145/2959100.2959160Google ScholarDigital Library
- Maksims Volkovs and Guang Wei Yu. 2015. Effective latent models for binary feedback in recommender systems. In Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval. 313--322. DOI:https://doi.org/10.1145/2766462.2767716Google ScholarDigital Library
- Hao Wang, Naiyan Wang, and Dit-Yan Yeung. 2015. Collaborative deep learning for recommender systems. In Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 1235--1244. DOI:https://doi.org/10.1145/2783258.2783273Google ScholarDigital Library
- Pengfei Wang, Jiafeng Guo, Yanyan Lan, Jun Xu, Shengxian Wan, and Xueqi Cheng. 2015. Learning hierarchical representation model for nextbasket recommendation. In Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval. 403--412. DOI:https://doi.org/10.1145/2766462.2767694Google ScholarDigital Library
- Suhang Wang, Yilin Wang, Jiliang Tang, Kai Shu, Suhas Ranganath, and Huan Liu. 2017. What your images reveal: Exploiting visual contents for point-of-interest recommendation. In Proceedings of the 26th International Conference on World Wide Web. 391--400. DOI:https://doi.org/10.1145/3038912.3052638Google ScholarDigital Library
- Xiang Wang, Xiangnan He, Yixin Cao, Meng Liu, and Tat-Seng Chua. 2019. KGAT: Knowledge graph attention network for recommendation. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 950--958. DOI:https://doi.org/10.1145/3292500.3330989Google ScholarDigital Library
- Xiang Wang, Xiangnan He, Meng Wang, Fuli Feng, and Tat-Seng Chua. 2019. Neural graph collaborative filtering. In Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval. 165--174. DOI:https://doi.org/10.1145/3331184.3331267Google ScholarDigital Library
- Yao Wu, Christopher DuBois, Alice X. Zheng, and Martin Ester. 2016. Collaborative denoising auto-encoders for Top-N recommender systems. In Proceedings of the 9th ACM International Conference on Web Search and Data Mining. 153--162. DOI:https://doi.org/10.1145/2835776.2835837Google ScholarDigital Library
- Hong-Jian Xue, Xinyu Dai, Jianbing Zhang, Shujian Huang, and Jiajun Chen. 2017. Deep matrix factorization models for recommender systems. In Proceedings of the 26th International Joint Conference on Artificial Intelligence. 3203--3209. DOI:https://doi.org/10.24963/ijcai.2017/447Google ScholarCross Ref
- Fuzheng Zhang, Nicholas Jing Yuan, Defu Lian, Xing Xie, and Wei-Ying Ma. 2016. Collaborative knowledge base embedding for recommender systems. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 353--362. DOI:https://doi.org/10.1145/2939672.2939673Google ScholarDigital Library
Index Terms
- Dual-Embedding based Deep Latent Factor Models for Recommendation
Recommendations
Personalised rating prediction for new users using latent factor models
HT '11: Proceedings of the 22nd ACM conference on Hypertext and hypermediaIn recent years, personalised recommendations have gained importance in helping users deal with the abundance of information available online. Personalised recommendations are often based on rating predictions, and thus accurate rating prediction is ...
Exploiting user and item embedding in latent factor models for recommendations
WI '17: Proceedings of the International Conference on Web IntelligenceMatrix factorization (MF) models and their extensions are widely used in modern recommender systems. MF models decompose the observed user-item interaction matrix into user and item latent factors. In this paper, we propose mixture models which combine ...
Improving Latent Factor Models via Personalized Feature Projection for One Class Recommendation
CIKM '15: Proceedings of the 24th ACM International on Conference on Information and Knowledge ManagementLatent Factor models, which transform both users and items into the same latent feature space, are one of the most successful and ubiquitous models in recommender systems. Most existing models in this paradigm define both users' and items' latent ...
Comments