Skip to main content
Log in

Design of electronic-commerce recommendation systems based on outlier mining

  • Research Paper
  • Published:
Electronic Markets Aims and scope Submit manuscript

Abstract

Prior studies mostly consider outliers as noise data and eliminate them, resulting in the loss of outlier knowledge. Based on the existing technology of recommendation systems and outlier detection, this research develops a new e-commerce recommended model from the perspective of outlier knowledge management. Specifically, we apply outlier data mining and integrate local outlier coefficients into the recommendation algorithm. The experimental results show that the proposed outlier extent recommendation model performs better than the traditional recommendation systems based on the collaborative filtering algorithm, which can effectively improve the quality of recommendation, enhance customer satisfaction and loyalty, and create potential benefits for the business. Our study contributes to the design of e-commerce recommending systems with some novel ideas and provides useful guidelines for developing the outlier extent.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  • Adomavicius, G., & Tuzhilin, A. (2005). Toward the next generation of recommender systems: A survey of the state-of-the-art and possible extensions. IEEE Transactions on Knowledge & Data Engineering, 17(6), 734–749. https://doi.org/10.1109/TKDE.2005.99 .

  • Ahn, H. J. (2008). A new similarity measure for collaborative filtering to alleviate the new user cold-starting problem. Information Sciences, 178(1), 37–51. https://doi.org/10.1016/j.ins.2007.07.024 .

  • Ahn, J., Lee, M. H., & Lee, J. A. (2019). Distance-based outlier detection for high dimension, low sample size data. Journal of Applied Statistics, 46(1), 13–29. https://doi.org/10.1080/02664763.2018.1452901 .

  • Ai, D. X., Zuo, H., & Yang, J. (2013). C2C e-commerce recommender system based on three-dimensional collaborative filtering. Applied Mechanics and Materials, 336–338, 2563–2566. https://doi.org/10.4028/www.scientific.net/amm.336-338.2563

  • Akter, S., & Wamba, S. F. (2016). Big data analytics in E-commerce: A systematic review and agenda for future research. Electronic Markets, 26(2), 173–194. https://doi.org/10.1007/s12525-016-0219-0 .

  • Backhaus, K., Becker, J., Beverungen, D., Frohs, M., Müller, O., Weddeling, M., Knackstedt, R., & Steiner, M. (2010). Enabling individualized recommendations and dynamic pricing of value-added services through willingness-to-pay data. Electronic Markets, 20(2), 131–146. https://doi.org/10.1007/s12525-010-0032-0 .

  • Bipul, K., & Pradip, K. B. (2017). Fattening the Long tail items in E-commerce. Journal of Theoretical and Applied Electronic Commerce Research, 12(3), 27–49. https://doi.org/10.4067/S0718-18762017000300004.

  • Buchel, B., Enders., A., Fisher, W. A., Yu, H. H., Mahmood, I. P., Valikangas, L., & Liu, F. (2013). Strategizing practices from the outliers. International Institute for Management Development. Available at https://www.imd.org/research-knowledge/articles/strategizing-practices-from-the-outliers/

  • Buettner, R. (2017). Predicting user behavior in electronic markets based on personality-mining in large online social networks. Electronic Markets, 27(3), 247–265. https://doi.org/10.1007/s12525-016-0228-z .

  • Cao, G. F., Zhang, H., & Zheng, J., Kuang, L. & Duan, Y. (2019). An outlier degree shilling attack detection algorithm based on dynamic feature selection. International Journal of Software Engineering and Knowledge Engineering, 29(8), 1159–1178. https://doi.org/10.1142/S0218194019500360 .

  • Chen, H. H. (2018). Behavior2Vec: Generating distributed representations of users’ behaviors on products for recommender systems. ACM Transactions on Knowledge Discovery from Data (TKDD), 12(4), 43. https://doi.org/10.1145/3184454 .

  • Choudhury, M. M., & Harrigan, P. (2014). CRM to social CRM: The integration of new technologies into customer relationship management. Journal of Strategic Marketing, 22(2), 149–176. https://doi.org/10.1080/0965254X.2013.876069

  • Das, J., Majumder, S., & Gupta, P. (2019). Collaborative recommendations using hierarchical clustering based on K-d trees and Quadtrees. International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems, 27(4), 637–668. https://doi.org/10.1142/S0218488519500284.

  • Dede, K., Dade, N., & Rita, R. (2018). Fairness aware regularization on a learning-to-rank recommender system for controlling popularity Bias in E-commerce domain. International Conference on Information Technology Systems and Innovation (ICITSI), 16–21. https://doi.org/10.1109/ICITSI.2018.8696023.

  • Deng, J. Z., Wang, Y., & Guo, J. P. (2019). A similarity measure based on Kullback-Leibler divergence for collaborative filtering in sparse data. Journal of Information Science, 45(5), 656–675. https://doi.org/10.1177/0165551518808188.

  • Dong, B., Wang, H. W., Monreale, A., Pedreschi, D., Giannotti, F., & Guo, W. (2017). Authenticated outlier Mining for Outsourced Databases. IEEE Transactions on Dependable and Secure Computing, 17(2), 222-235. Authenticated outlier Mining for Outsourced Databases.

  • Duma, M., & Twala, B. (2019). Sparseness reduction in collaborative filtering using a nearest neighbor artificial immune system with genetic algorithms. Expert Systems with Applications, 132, 110–125. https://doi.org/10.1016/j.eswa.2019.04.034.

  • Gendai, T. (2011). Detection of outliers in meteorological observation data. Journal of Quality, 18(5), 393–405.

    Google Scholar 

  • Geuens, S., Coussement, K., & De Bock, K. W. (2018). A framework for configuring collaborative filtering-based recommendations derived from purchase data. European Journal of Operational Research, 265(1), 208–218. https://doi.org/10.1016/j.ejor.2017.07.005.

  • Gopalswamy, S., & Mohamed, S. I. P. (2019). Time adaptive collaborative filtering for movie recommendation. Pertanika Journal of Science and Technology, 27(4), 1783–1802.

    Google Scholar 

  • Gronlund, J. (2019). The Rise of a New Type of Brand: The Outlier. Available at https://biznology.com/2019/04/the-rise-of-a-new-type-of-brand-the-outlier/

  • Guo, Y., Yin, C., Li, M., Ren, X., & Liu, P. (2018). Mobile e-commerce recommendation system based on multi-source information fusion for sustainable e-business. Sustainability, 10(1), 147. https://doi.org/10.3390/su10010147.

  • Hammou, B. A., Lahcen, A. A., & Mouline, S. (2019). FRAIPA version 2: A fast recommendation approach based on self-adaptation and multi-thresholding. Expert Systems with Applications, 118, 209–216. https://doi.org/10.1016/j.eswa.2018.09.055.

  • Hanauer, D. A., Saeed, M., Zheng, K., Mei, Q., Shedden, K., Aronson, A. R., & Ramakrishnan, N. (2014). Applying MetaMap to Medline for identifying novel associations in a large clinical dataset: A feasibility analysis. Journal of the American Medical Informatics Association, 21(5), 925–937. .

  • Harper, F. M., & Konstan, J. A. (2015). The movielens datasets: History and context. ACM Transactions on Interactive Intelligent Systems (tiis), 5(4), 1–19. https://doi.org/10.1145/2827872.

  • Huang, H. Y., Lin, J. X., Chen, C. C., & Fan, M. H. (2006). Review of outlier detection. Application Research of Computers, 8, 2006–2008.

    Google Scholar 

  • Hwangbo, H., Kim, Y. S., & Cha, K. J. (2018). Recommendation system development for fashion retail e-commerce. Electronic Commerce Research and Applications, 28, 94–101. https://doi.org/10.1016/j.elerap.2018.01.012.

  • Karabadji, N. E. L., Beldjoudi, S., & Seridi, H. (2018). Improving memory-based user collaborative filtering with evolutionary multi-objective optimization. Expert Systems with Application, 98, 53–165. https://doi.org/10.1016/j.eswa.2018.01.015.

  • Katarya, R., & Verma, O. P. (2018). Recommender system with grey wolf optimizer and FCM. Neural Computing and Applications, 30(5), 1679–1687. https://doi.org/10.1007/s00521-016-2817-3.

  • Köhler, S., Wöhner, T., & Peters, R. (2016). The impact of consumer preferences on the accuracy of collaborative filtering recommender systems. Electronic Markets, 26(4), 369–379. https://doi.org/10.1007/s12525-016-0232-3.

  • Lee, S. C., Kim, S. W., Park, S., & Chae, D. K. (2018). An approach to effective recommendation considering user preference and diversity simultaneously. IEICE Transactions on Information and Systems, 101(1), 244–248. https://doi.org/10.1587/transinf.2017EDL8039.

  • Li, S. S., & Karahanna, E. (2015). Online recommendation systems in a B2C E-commerce context: A review and future directions. Journal of the Association for Information Systems, 16(2), 72–107. https://doi.org/10.17705/1jais.00389.

  • Liang, X., Liu, H., & Dai, X. (2015). Application of clustering outlier mining technology in internal audit informatization -- an example from credit card audit of commercial banks [in Chinese]. China Internal Audit, 2015(8), 56–62.

    Google Scholar 

  • Liu, C., Chan, Y., Alam Kazmi, S. H., & Fu, H. (2015). Financial fraud detection model: Based on random forest. International Journal of Economics and Finance, 7(7), 178–188. https://doi.org/10.5539/ijef.v7n7p178.

  • Liu, D. R., Chen, K. Y., Chou, Y. C., & Lee, J. H. (2018). Online recommendations based on dynamic adjustment of recommendation lists. Knowledge-Based Systems, 161, 375–389. https://doi.org/10.1016/j.knosys.2018.07.038.

  • Liu, H. F., Hu, Z., & Mian, A. (2014). A new user similarity model to improve the accuracy of collaborative filtering. Knowledge-Based Systems, 56, 156–166. https://doi.org/10.1016/j.knosys.2013.11.006.

  • Liu, J. W., & Huang, L. C. (2008). Detecting and visualizing emerging trends and transient patterns in fuel cell scientific literature. 2008 4th international conference on wireless communications, networking and mobile computing, 1–4. https://doi.org/10.1109/WiCom.2008.2660.

  • Liu, Y., Xiong, Q., Sun, J., Jiang, Y., Silva, T., & Ling, H. (2019). Topic-based hierarchical Bayesian linear regression models for niche items recommendation. Journal of Information Science, 45(1), 92–104. https://doi.org/10.1177/0165551518782831.

  • Lu, J., Wu, D., Mao, M., Wang, W., & Zhang, G. (2015). Recommender system application developments: A survey. Decision Support Systems, 74, 12–32. https://doi.org/10.1016/j.dss.2015.03.008.

  • Murthi, B. P. S., & Sarkar, S. (2003). The role of the management sciences in research on personalization. Management Science, 49(10), 1344–1362. https://doi.org/10.1287/mnsc.49.10.1344.17313.

  • Park, D. H., Kim, H. K., Choi, I. Y., & Kim, J. K. (2012). A literature review and classification of recommender systems research. Expert Systems with Applications, 39(11), 10059–10072. https://doi.org/10.1016/j.eswa.2012.02.038.

  • Shi, Y., Larson, M., & Hanjalic, A. (2014). Collaborative filtering beyond the user-item matrix: A survey of the state of the art and future challenges. ACM Computing Surveys, 47(1), 1-45. https://doi.org/10.1145/2556270.

  • Symeonidis, P., Coba, L., & Zanker, M. (2019). Counteracting the filter bubble in recommender systems: Novelty-aware matrix factorization. Intelligenza Artificiale, 13(1), 37–47. https://doi.org/10.3233/IA-190017.

  • Thitimajshima, W., Esichaikul, V., & Krairit, D. (2018). A framework to identify factors affecting the performance of third-party B2B e-marketplaces: A seller’s perspective. Electronic Markets, 28(2), 129–147. https://doi.org/10.1007/s12525-017-0256-3.

  • Thomas, K. A., DeScioli, P., & Haque, O. S. (2014). The psychology of coordination and common knowledge. Journal of Personality and Social Psychology, 107(4), 657–667. https://doi.org/10.1037/a0037037.

  • Xia, H. S., Wang, Q. D., & Zhang, Z. P. (2019). Knowledge heterogeneity in university-industry knowledge transfer: A case analysis of Xu’s Ruyi textile. Knowledge Management Research & Practice, 17(4), 486–498. https://doi.org/10.1080/14778238.2019.1569489.

  • Xia, H. S., Long, J., Li, F., & He, T. T. (2017). Outlier detection and outlier knowledge based on high frequency keywords: A study from the literature analysis perspective. Journal of Intelligence, 36(5), 181–186.

    Google Scholar 

  • Xia, H., & Zhen, H. (2015). Public opinion analysis and decision support study under big data surroundings. Journal of Intelligence, 34(2), 1–6.

    Google Scholar 

  • Xu, J., Liu, A., Xiong, N., Wang, T., & Zuo, Z. (2017). Integrated collaborative filtering recommendation in social cyber-physical systems. International Journal of Distributed Sensor Networks, 13(12). https://doi.org/10.1177/1550147717749745.

  • Yin, C., Guo, Y., Yang, J., & Ren, X. (2018). A new recommendation system on the basis of consumer initiative decision based on an associative classification approach. Industrial Management & Data Systems, 118(1), 188–203. https://doi.org/10.1108/IMDS-02-2017-0057.

  • Yu, J. W., Xuan, Z. W., & Feng, X. (2019). A novel collaborative filtering model for LncRNA-disease association prediction based on the naive Bayesian classifier. Bioinformatics, 20, 396. https://doi.org/10.1186/s12859-019-2985-0.

  • Yu, W. F., & Wang, N. (2009). Research on credit card fraud detection model based on distance sum. 2009 International Joint Conference on Artificial Intelligence, 353-356. https://doi.org/10.1109/JCAI.2009.146.

  • Zeng, W., Zeng, A., Liu, H., Shang, M. S., & Zhang, Y. C. (2014). Similarity from multi-dimensional scaling: Solving the accuracy and diversity dilemma in information filtering. PLoS One, 9(10), e111005. https://doi.org/10.1371/journal.pone.0111005 .

    Article  Google Scholar 

  • Zhai, D., Guo, C., & Zhang, J. (2016). Research on technique opportunity recognition method using anomaly detection. Modern library and information technology, 32(10), 81–90.

    Google Scholar 

  • Zhang, J., & Curley, S. P. (2018). Exploring explanation effects on consumers’ trust in online recommender agents. International Journal of Human–Computer Interaction, 34(5), 421–432. https://doi.org/10.1080/10447318.2017.1357904.

  • Zhang, J., Yu, X., Li, Y., Zhang, S., Xun, Y., & Qin, X. (2016). A relevant subspace based contextual outlier mining algorithm. Knowledge-Based Systems, 99, 1–9. https://doi.org/10.1016/j.knosys.2016.01.013.

Download references

Acknowledgement

This research has been supported by the National Natural Science Foundation of China: NSFC,71871172, Model of Risk knowledge acquisition and Platform governance in FinTech based on deep learning; NSFC,71571139, Outlier Analytics and Model of Outlier Knowledge Management in the context of Big Data. We deeply appreciate the suggestions from fellow members of Xia's project team and Research Center of Enterprise Decision Support, Key Research Institute of Humanities and Social Sciences in Universities of Hubei Province (DSS20200700).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Zuopeng Justin Zhang.

Additional information

Responsible Editor: Ravi S. Sharma

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

This article is part of the Topical Collection on Recommentation Systems (RS) in Electronic Markets

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Xia, H., Wei, X., An, W. et al. Design of electronic-commerce recommendation systems based on outlier mining. Electron Markets 31, 295–311 (2021). https://doi.org/10.1007/s12525-020-00435-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12525-020-00435-2

Keywords

JEL classification

Navigation