Skip to main content
SpringerLink
Log in

Jensen–Renyi’s–Tsallis Fuzzy Divergence Information Measure with its Applications

  • Published:
Communications in Mathematics and Statistics Aims and scope Submit manuscript

Abstract

In this paper, we have characterized the sum of two general measures associated with two distributions with discrete random variables. One of these measures is logarithmic, while others contains the power of variables, named as joint representation of Renyi’s–Tsallis divergence measure. Then, we propose a divergence measure based on Jensen–Renyi’s–Tsallis entropy which is known as a Jensen–Renyi’s–Tsallis divergence measure. It is a generalization of J-divergence information measure. One of the silent features of this measure is that we can allot the equal weight to each probability distribution. This makes it specifically reasonable for the study of decision problems, where the weights could be the prior probabilities. Further, the idea has been generalized from probabilistic to fuzzy similarity/dissimilarity measure. Besides the validation of the proposed measure, some of its key properties are also studied. Further, the performance of the proposed measure is contrasted with some existing measures. At last, some illustrative examples are solved in the context of clustering analysis, financial diagnosis and pattern recognition which demonstrate the practicality and adequacy of the proposed measure between two fuzzy sets (FSs).

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Arqub, O.A.: Adaptation of reproducing kernel algorithm for solving fuzzy Fredholm–Voltera integrodifferential equations. Neural Comput. Appl. 28, 1591–1610 (2017)

    Google Scholar 

  2. Arqub, O.A., Al-Smadi, M.H., Momani, S.M., Hayat, T.: Numerical solutions of fuzzy differential equations using reproducing kernel Hilbert space method. Soft Comput. 20, 3283–3302 (2016)

    MATH  Google Scholar 

  3. Arqub, O.A., Al-Smadi, M.H., Momani, S.M., Hayat, T.: Application of reproducing kernel algorithm for solving second-order, two point fuzzy boundary value problems. Soft Comput. 21, 7191–7206 (2017)

    MATH  Google Scholar 

  4. Bhatia, P.K., Singh, S.: Three families of generalized fuzzy directed divergence. AMO Adv. Model Optim. 14(3), 599–614 (2012)

    MathSciNet  MATH  Google Scholar 

  5. Bhatia, P.K., Singh, S.: A new measure of fuzzy directed divergence and its applications in image segmentation. Int. J. Intell. Syst. Appl. 4, 81–89 (2013)

    Google Scholar 

  6. Boekee, D.E., Vander Lubbe, J.C.A.: The R-norm information measure. Inf. Control 45, 136–155 (1980)

    MathSciNet  MATH  Google Scholar 

  7. Burbea, J., Rao, C.R.: On the convexity of some divergence measures based on entropy functions. IEEE Trans. Infor. Theory 28, 489–495 (1982)

    MathSciNet  MATH  Google Scholar 

  8. Bouchet, A., Montes, S., Ballarin, V., Diaz, I.: Intuitionistic fuzzy set and fuzzy mathematical morphology applied to color leukocytes segmentation, Signal. Image Video Process. (2019). https://doi.org/10.1007/s11760-019-01586-2

    Article  Google Scholar 

  9. Cover, T.M., Thomas, J.A.: Elements of Information Theory. Wiley-Interscience, New York (1991)

    MATH  Google Scholar 

  10. Chou, C.C.: A generalized similarity measure for fuzzy numbers. J. Intell. Fuzzy Syst. 30(2), 1147–1155 (2016)

    MATH  Google Scholar 

  11. Cross, V.V., Sudkampm, T.: A Similarity and Compatibility in Fuzzy Set Theory. Physica-Verlag, Heidelberg (2002)

    Google Scholar 

  12. Deselaers, T., Keysers, D., Ney, H.: Features for image retrieval:an experimental comparison. Inf. Retr. 11(2), 77–107 (2008)

    Google Scholar 

  13. De Luca, A., Termini, S.: A definition of a non- probabilistic entropy in the setting of fuzzy sets theory. Inf. Control 20, 301–312 (1972)

    MATH  Google Scholar 

  14. Fan, J., Xie, W.: Distance measures and induced fuzzy entropy. Fuzzy Sets Syst. 104(2), 305–314 (1999)

    MathSciNet  MATH  Google Scholar 

  15. Fan, S., He, P., Nie, H.: Infrared electric image thresholding using two dimensional fuzzy entropy. Energy Proc. 12, 411–419 (2011)

    Google Scholar 

  16. Ferreri, C.: Hyper entropy and related hetrogeneity divergence and information measure. Statistical 40(2), 155–168 (1980)

    MathSciNet  MATH  Google Scholar 

  17. Garg, D., Kumar, S.: Parametric R-norm directed divergence convex function. Infinite dimensional analysis, quantum probability and related topics 19(2), 1–12 (2016)

    MathSciNet  MATH  Google Scholar 

  18. Garg, H.: An improved cosine similarity measure for intuitionistic fuzzy sets and their applications to decision-making process. Hacet. J. Math. Stat. 47(6), 1578–1594 (2018)

    MathSciNet  MATH  Google Scholar 

  19. Ghosh, M., Das, D., Ray, C., Chadraborty, A.K.: Autumated lerkocyte recoginition using fuzzy divergence. Micron 41, 840–846 (2010)

    Google Scholar 

  20. Hung, W.L., Yang, M.S.: Similarity measures of intuitionistic fuzzy sets based on \(L_p\) metric. Int. J. Approx. Reason. 46, 120–136 (2007)

    MATH  Google Scholar 

  21. Hwang, C.H., Yang, M.S.: On entropy of fuzzy sets. Int. J. Uncertain Fuzzy Knowel. Based Syst. 16(4), 519–527 (2008)

    MathSciNet  MATH  Google Scholar 

  22. Jeffreys, H.: Scientific Interface. Cambridge University Press, Cambridge (1973)

    Google Scholar 

  23. Joshi, R., Kumar, S.: An (R’, S’)-norm fuzzy relative measure with its applications strategic decision making. Comp. Appl. Math. 37(4), 4518–4543 (2018)

    MathSciNet  MATH  Google Scholar 

  24. Kabir, S., Wanger, C., Havens, T.C., Anderson, D.T.: A bidirectional subsethood based similarity measure for fuzzy sets. In 2018 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE), pp. 1–7, (2018)

  25. Kullback, S., Leibler, R.A.: On information and sufficiency. Ann. Math. Stat. 22, 79–86 (1951)

    MathSciNet  MATH  Google Scholar 

  26. Kullback, S.: Information Theory and Statistics. Wiley, New York (1959)

    MATH  Google Scholar 

  27. Lin, J.: Divergence measure based on Shannon entropy. IEEE Trans. Inform. Theory 37(1), 145–151 (1991)

    MathSciNet  MATH  Google Scholar 

  28. Mahalanobis, P.C.: On the generalized distance in statistics. Proc. Natl. Inst. Sci. 2, 49–55 (1936)

    MATH  Google Scholar 

  29. Mitchell, H.B.: On the Dengfeng–Chuntain similarity measure and its application to pattern recognition. Pattern Recognit. Lett. 24, 3101–3104 (2003)

    Google Scholar 

  30. Montes, S., Couso, I., Gil, P., Bertoluzza, C.: Divergence mesure between fuzzy sets. Int. J. Approx. Reason 30(2), 91–105 (2002)

    MATH  Google Scholar 

  31. Rao, C.R.: Diversity and dissimilarity coefficients: a unified approach. Theor. Popul. Biol. 21, 24–43 (1982)

    MathSciNet  MATH  Google Scholar 

  32. Renyi, A.: On measures of entropy and information. In: Proceedings of 4th Bakley Symposium on Mathematics and Statistics and Probability, University of California Press, vol. 1, p. 547 (1961)

  33. Rubner, Y., Puzicha, J., Tomasi, C., Buhmann, M.: Empirical evaluation of dissimilarity measures for color and texture. Comput. Vis. Image Underst. 84(1), 25–43 (2001)

    MATH  Google Scholar 

  34. Santini, S., Jain, R.: Similarity measures. IEEE Trans. Pattern Anal. Mach. Intell. 21(9), 871–883 (1999)

    Google Scholar 

  35. Santos-Rodriguez, R., Garcia-Garcia, D., Cid-Sueiro, J.: Cost-sensitive classification based on Bregman divergences for medical diagnosis, In M.A. Wani, editor, Proceedings of the 8th International Conference on Machine Learning and Applications (ICMLA’09), Miami beach, Fl., USA, December 13–15, pp. 551–556 (2009)

  36. Shannon, C.E.: A mathematical theory of communication. Bell. Syst. Technol. J. 27(378–423), 623–656 (1948)

    MathSciNet  MATH  Google Scholar 

  37. Szmidt, E., kacprzyk, J.: A similarity measure for intuitionistic fuzzy sets and its application in supporting medical diagnostic reasoning. In Proceedings of the 7th International Conference on Artificial Intelligence and Soft Computing (ICAISC’04), pp. 388–393 (2004)

  38. Tsallis, C.: Possible generalization of Boltzman–Gibbs statistics. J. Stat. Phys. 52, 480–487 (1988)

    Google Scholar 

  39. Wondie, L., Kumar, S.: A joint representation of Renyi’s–Tsallis entropy with application in coding theory. Int J. Math. Math. Sci. 2017, Article ID 2683293 (2017). https://doi.org/10.1155/2017/2683293

  40. Williams, J., Steele, N.: Difference, distance and similarity as a basis for fuzzy decision support based on prototypical decision classes. Fuzzy Sets Syst. 131, 35–46 (2002)

    MathSciNet  MATH  Google Scholar 

  41. Xu, Z.S., Wu, J.J.: Clustering algorithm for intuitionistic fuzzy sets. Inf. Sci. 178, 3775–3790 (2008)

    MathSciNet  MATH  Google Scholar 

  42. Yager, R.R.: On the measure of fuzziness and negation. Part 1: membership in the unit interval. Int. J. Gen. Syst. 5, 221–229 (1979)

    MATH  Google Scholar 

  43. Yang, M.S., Wu, K.L.: A similarity-based robust clustering method. IEEE Trans. Pattern Anal. Mach. Intell. 26, 434–448 (2004)

    Google Scholar 

  44. Zadeh, L.A.: Fuzzy sets. Inf. Control 8, 221–229 (1965)

    Google Scholar 

  45. Zadeh, L.A.: Probability measures of fuzzy events. J. Math. Anal. Appl. 23, 421–427 (1968)

    MathSciNet  MATH  Google Scholar 

  46. Zadeh, L.A.: Similarity relations and fuzzy orderings. Inf. Sci. 3, 177–200 (1971)

    MathSciNet  MATH  Google Scholar 

  47. Zhang, H.M., Xu, Z.S., Chen, Q.: On clustering approach to intuitionistic fuzzy sets. Control Decis. 22, 882–888 (2007)

    MathSciNet  MATH  Google Scholar 

  48. Zwick, R., Carlstein, E., Budesco, D.V.: Measures of similarity amongst fuzzy concepts: a comparative analysis. Int. J. Approx. Reason. 1, 221–242 (1987)

    Google Scholar 

Download references

Acknowledgements

The authors are thankful to the editor and anonymous reviewers for their valuable comments and suggestions.

Author information

Authors and Affiliations

  1. Department of Mathematics, Maharishi Markandeshwar (Deemed to be) University, Mullana-Ambala, 133207, India

    Ratika Kadian & Satish Kumar

Authors
  1. Ratika Kadian
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Satish Kumar
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ratika Kadian.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kadian, R., Kumar, S. Jensen–Renyi’s–Tsallis Fuzzy Divergence Information Measure with its Applications. Commun. Math. Stat. 10, 451–482 (2022). https://doi.org/10.1007/s40304-020-00228-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s40304-020-00228-1

Keywords

Mathematics Subject Classification

Search

Navigation