Skip to main content
SpringerLink
Log in

A novel classification algorithm based on kernelized fuzzy rough sets

  • Original Article
  • Published:
International Journal of Machine Learning and Cybernetics Aims and scope Submit manuscript

Abstract

Fuzzy kernels are a special kind of kernels which are usually employed to calculate the upper and lower approximations, as well as the positive region in kernelized fuzzy rough sets, and the positive region characterizes the degree of consistency between conditional attributes and decision attributes. When the classification hyperplane exists between two classes of samples, the positive region is transformed into the sum of the distances from the samples to classification hyperplane. The larger the positive region, the higher the degree of consistency. In this paper, we construct a novel model to solve the classification hyperplane from the geometric meaning of the positive region in kernelized fuzzy rough sets. Then, a classification model is developed through maximizing the sum of the distances from the samples to classification hyperplane, and this optimization problem that addresses this objective function is transformed to its dual problem. Experimental results show that the proposed classification algorithm is effective.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

Similar content being viewed by others

References

  1. Pawlak Z (1991) Rough sets: theoretical aspects of reasoning about data. Kluwer, Dordrecht

    MATH  Google Scholar 

  2. Kong QZ, Zhang XW, Xu WH, Xie ST (2020) Attribute reducts of multi-granulation information system. Artif Intell Rev 53(2):1353–1371

    Google Scholar 

  3. Xu WH, Yu JH (2017) A novel approach to information fusion in multi-source datasets: a granular computing viewpoint. Inf Sci 378:410–423

    MATH  Google Scholar 

  4. Xu WH, Li WT (2016) Granular computing approach to two-way learning based on formal concept analysis in fuzzy datasets. IEEE Trans Cybern 46(2):366–379

    MathSciNet  Google Scholar 

  5. Xu WH, Guo YT (2016) Generalized multigranulation double-quantitative decision-theoretic rough set. Knowl-Based Syst 105(1):190–205

    Google Scholar 

  6. Chen DG (2013) Fuzzy rough set theory and method. Science Press, Beijing

    Google Scholar 

  7. Dubois D, Prade H (1990) Rough fuzzy sets and fuzzy rough sets. Int J Gener Syst 17(2):191–209

    MATH  Google Scholar 

  8. Dubois D, Prade H (1992) Putting rough sets and fuzzy sets together. In: Slowinski R (ed) Intelligent decision support, handbook of applications and advances of the rough sets theory. Kluwer, Norwell, pp 203–232

    Google Scholar 

  9. Mi JS, Zhang XZ (2004) An axiomatic characterization of a fuzzy generalization of rough sets. Inf Sci 160(1–4):235–249

    MathSciNet  MATH  Google Scholar 

  10. Morsi NN, Yakout MM (1998) Axiomatics for fuzzy rough sets. Fuzzy Sets Syst 100(1–3):327–342

    MathSciNet  MATH  Google Scholar 

  11. Radzikowska AM, Kerre EE (2002) A comparative study of fuzzy rough sets. Fuzzy Sets Syst 126(2):137–155

    MathSciNet  MATH  Google Scholar 

  12. Wang R, Chen DG, Kwong S (2014) Fuzzy-rough-set-based active learning. IEEE Trans Fuzzy Syst 22(6):1699–1704

    Google Scholar 

  13. Yeung DS, Chen DG, Tsang ECC, John WTL, Wang XZ (2005) On the generalization of fuzzy rough sets. IEEE Trans Fuzzy Syst 13(3):343–361

    Google Scholar 

  14. Wu WZ, Zhang WX (2004) Constructive and axiomatic approaches of fuzzy approximation operators. Inf Sci 159(3–4):233–254

    MathSciNet  MATH  Google Scholar 

  15. Wu WZ, Mi JS, Zhang WX (2003) Generalized fuzzy rough sets. Inf Sci 151:263–282

    MathSciNet  MATH  Google Scholar 

  16. Moser B (2006) On the T-transitivity of kernels. Fuzzy Sets Syst 157(13):1787–1796

    MathSciNet  MATH  Google Scholar 

  17. Moser B (2006) On representing and generating kernels by fuzzy equivalence relations. J Mach Learn Res 7:2603–2620

    MathSciNet  MATH  Google Scholar 

  18. Hu QH, Yu DR, Pedrycz W, Chen DG (2011) Kernelized fuzzy rough sets and their applications. IEEE Trans Knowl Data Eng 23(11):1649–1667

    Google Scholar 

  19. Jensen R, Shen Q (2004) Fuzzy-rough attributes reduction with application to web categorization. Fuzzy Sets Syst 141(3):469–485

    MathSciNet  MATH  Google Scholar 

  20. Bhatt RB, Gopal M (2005) On fuzzy rough sets approach to feature selection. Pattern Recog Lett 26(7):965–975

    Google Scholar 

  21. Chen DG, Zhao SY (2010) Local reduction of decision system with fuzzy rough sets. Fuzzy Sets Syst 161(13):1871–1883

    MathSciNet  MATH  Google Scholar 

  22. Chen DG, Zhang L, Zhao SY, Hu QH, Zhu PF (2012) A novel algorithm for finding reducts with fuzzy rough sets. IEEE Trans Fuzzy Syst 20(2):385–389

    Google Scholar 

  23. Chen DG, Yang YY (2014) Attribute reduction for heterogeneous data based on the combination of classical and fuzzy rough set models. IEEE Trans Fuzzy Syst 22(5):1325–1334

    Google Scholar 

  24. Chen LL, Chen DG, Wang H (2019) Fuzzy kernel alignment with application to attribute reduction of heterogeneous data. IEEE Trans Fuzzy Syst 27(7):1469–1478

    Google Scholar 

  25. Wang CZ, Wang Y, Shao MW, Qian YH, Chen DG (2019) Fuzzy rough attribute reduction for categorical data. IEEE Trans Fuzzy Syst. https://doi.org/10.1109/TFUZZ.2019.2949765

    Article  Google Scholar 

  26. Wang CZ, Huang Y, Shao MW, Hu QH, Chen DG (2019) Feature selection based on neighborhood self-information. IEEE Trans Cybern. https://doi.org/10.1109/TCYB.2019.2923430

    Article  Google Scholar 

  27. Wang CZ, Huang Y, Shao MW, Fan XD (2019) Fuzzy rough set-based attribute reduction using distance measures. Knowl-Based Syst 164:205–212

    Google Scholar 

  28. John ST, Nello C (2006) Kernel methods for pattern analysis. China Machine Press, Beijing

    Google Scholar 

  29. Wu Q, Ying Y, Zhou DX (2007) Multi-kernel regularized classifiers. J. Complex 23(1):108–134

    MathSciNet  MATH  Google Scholar 

  30. Scholkopf B, Smola A, Muller KR (1998) Nonlinear component analysis as a kernel eigenvalue problem. Neural Comput 10(5):1299–1319

    Google Scholar 

  31. Gretton A, Herbrich R, Smola A, Bousquet O, Schölkopf B (2005) Kernel methods for measuring independence. J Mach Learn Res 6:2075–2129

    MathSciNet  MATH  Google Scholar 

  32. Vapnik VN (1995) The nature of statistical learning theory. Springer, New York

    MATH  Google Scholar 

  33. Steinwart I, Christmann A (2008) Support vector machines. Springer, Berlin

    MATH  Google Scholar 

  34. Deng NY, Tian YJ (2009) Support vector machines: theory, algorithms, and extensions. Science Press, Beijing

    Google Scholar 

  35. Lin CF, Wang SD (2002) Fuzzy support vector machine. IEEE Trans Neural Netw 13(2):464–471

    Google Scholar 

  36. Chen DG, He Q, Wang XZ (2010) FRSVMs: fuzzy rough set based support vector machines. Fuzzy Sets Syst 161(4):596–607

    MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Science, Beijing University of Civil Engineering and Architecture, Beijing, 100044, China

    Linlin Chen

  2. Hermes Microvision, Inc. An ASML Company, Beijing, China

    Qingjiu Chen

Authors
  1. Linlin Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Qingjiu Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Qingjiu Chen.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chen, L., Chen, Q. A novel classification algorithm based on kernelized fuzzy rough sets. Int. J. Mach. Learn. & Cyber. 11, 2565–2572 (2020). https://doi.org/10.1007/s13042-020-01142-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13042-020-01142-2

Keywords

Search

Navigation