Skip to main content
Log in

Uncertainty measure in evidence theory

  • Review
  • Special Focus on Multi-source Information Fusion
  • Published:
Science China Information Sciences Aims and scope Submit manuscript

Abstract

As an extension of probability theory, evidence theory is able to better handle unknown and imprecise information. Owing to its advantages, evidence theory has more flexibility and effectiveness for modeling and processing uncertain information. Uncertainty measure plays an essential role both in evidence theory and probability theory. In probability theory, Shannon entropy provides a novel perspective for measuring uncertainty. Various entropies exist for measuring the uncertainty of basic probability assignment (BPA) in evidence theory. However, from the standpoint of the requirements of uncertainty measurement and physics, these entropies are controversial. Therefore, the process for measuring BPA uncertainty currently remains an open issue in the literature. Firstly, this paper reviews the measures of uncertainty in evidence theory followed by an analysis of some related controversies. Secondly, we discuss the development of Deng entropy as an effective way to measure uncertainty, including introducing its definition, analyzing its properties, and comparing it to other measures. We also examine the concept of maximum Deng entropy, the pseudo-Pascal triangle of maximum Deng entropy, generalized belief entropy, and measures of divergence. In addition, we conduct an analysis of the application of Deng entropy and further examine the challenges for future studies on uncertainty measurement in evidence theory. Finally, a conclusion is provided to summarize this study.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Fu C, Chang W, Yang S. Multiple criteria group decision making based on group satisfaction. Inf Sci, 2020, 518: 309–329

    MathSciNet  MATH  Google Scholar 

  2. Fu C, Chang W, Xue M, et al. Multiple criteria group decision making with belief distributions and distributed preference relations. Eur J Operational Res, 2019, 273: 623–633

    MathSciNet  Google Scholar 

  3. He Y, Hu L F, Guan X, et al. New method for measuring the degree of conflict among general basic probability assignments. Sci China Inf Sci, 2012, 55: 312–321

    MathSciNet  Google Scholar 

  4. Fei L, Feng Y, Liu L. Evidence combination using OWA-based soft likelihood functions. Int J Intell Syst, 2019, 34: 2269–2290

    Google Scholar 

  5. Liu Z, Pan Q, Dezert J, et al. Classifier fusion with contextual reliability evaluation. IEEE Trans Cybern, 2018, 48: 1605–1618

    Google Scholar 

  6. Wu B, Yan X, Wang Y, et al. An evidential reasoning-based CREAM to human reliability analysis in maritime accident process. Risk Anal, 2017, 37: 1936–1957

    Google Scholar 

  7. Wang Z, Gao J M, Wang R X, et al. Failure mode and effects analysis using Dempster-Shafer theory and TOPSIS method: application to the gas insulated metal enclosed transmission line (GIL). Appl Soft Comput, 2018, 70: 633–647

    Google Scholar 

  8. Liu Z G, Liu Y, Dezert J, et al. Evidence combination based on credal belief redistribution for pattern classification. IEEE Trans Fuzzy Syst, 2020, 28: 618–631

    Google Scholar 

  9. Pan Y, Zhang L, Wu X, et al. Multi-classifier information fusion in risk analysis. Inf Fusion, 2020, 60: 121–136

    Google Scholar 

  10. He Y, Jian T, Su F, et al. Two adaptive detectors for range-spread targets in non-Gaussian clutter. Sci China Inf Sci, 2011, 54: 386–395

    MATH  Google Scholar 

  11. Zadeh L A. Fuzzy sets. Inf Control, 1965, 8: 338–353

    MATH  Google Scholar 

  12. Pawlak Z. Rough sets. Int J Comput Inf Sci, 1982, 11: 341–356

    MATH  Google Scholar 

  13. Dempster A P. Upper and lower probabilities generated by a random closed interval. Ann Math Statist, 1968, 39: 957–966

    MathSciNet  MATH  Google Scholar 

  14. Shafer G. A Mathematical Theory of Evidence. Princeton: Princeton University Press, 1976

    MATH  Google Scholar 

  15. Atanassov K T. Intuitionistic fuzzy sets. Fuzzy Sets Syst, 1986, 20: 87–96

    MATH  Google Scholar 

  16. Zadeh L A. A note on Z-numbers. Inf Sci, 2011, 181: 2923–2932

    MATH  Google Scholar 

  17. Yager R R. Pythagorean fuzzy subsets. In: Proceedings of 2013 Joint IFSA World Congress and NAFIPS Annual Meeting (IFSA/NAFIPS), 2013. 57–61

  18. Fu C, Chang W, Xu D, et al. An evidential reasoning approach based on criterion reliability and solution reliability. Comput Industrial Eng, 2019, 128: 401–417

    Google Scholar 

  19. Xiao F. Generalization of Dempster-Shafer theory: a complex mass function. Appl Intell, 2020, 50: 3266–3275

    Google Scholar 

  20. Xiao F. Generalized belief function in complex evidence theory. J Intell Fuzzy Syst, 2020, 38: 3665–3673

    Google Scholar 

  21. Yang J B. Rule and utility based evidential reasoning approach for multiattribute decision analysis under uncertainties. Eur J Operational Res, 2001, 131: 31–61

    MathSciNet  MATH  Google Scholar 

  22. Yang J B, Xu D L. On the evidential reasoning algorithm for multiple attribute decision analysis under uncertainty. IEEE Trans Syst Man Cybern A, 2002, 32: 289–304

    Google Scholar 

  23. Yang J B, Xu D L. Evidential reasoning rule for evidence combination. Artif Intell, 2013, 205: 1–29

    MathSciNet  MATH  Google Scholar 

  24. Shannon C E. A mathematical theory of communication. Bell Syst Technical J, 1948, 27: 379–423

    MathSciNet  MATH  Google Scholar 

  25. Deng Y. Deng entropy. Chaos Solitons Fractals, 2016, 91: 549–553

    MATH  Google Scholar 

  26. Xiao F. EFMCDM: evidential fuzzy multicriteria decision making based on belief entropy. IEEE Trans Fuzzy Syst, 2020, 28: 1477–1491

    Google Scholar 

  27. Xiao F. GIQ: a generalized intelligent quality-based approach for fusing multi-source information. IEEE Trans Fuzzy Syst, 2020. doi: https://doi.org/10.1109/TFUZZ.2020.2991296

  28. Xiao F. Multi-sensor data fusion based on the belief divergence measure of evidences and the belief entropy. Inf Fusion, 2019, 46: 23–32

    Google Scholar 

  29. Xiao F. A distance measure for intuitionistic fuzzy sets and its application to pattern classification problems. IEEE Trans Syst Man Cybern Syst, 2020. doi: https://doi.org/10.1109/TSMC.2019.2958635

  30. Xiao F. A new divergence measure for belief functions in D-S evidence theory for multisensor data fusion. Inf Sci, 2020, 514: 462–483

    MathSciNet  MATH  Google Scholar 

  31. Xiao F. CED: a distance for complex mass functions. IEEE Trans Neural Netw Learning Syst, 2020. doi: https://doi.org/10.1109/TNNLS.2020.2984918

  32. Höhle U. Entropy with respect to plausibility measures. In: Proceedings of the 12th IEEE International Symposium on Multiple Valued Logic, Paris, 1982

  33. Smets P. Information content of an evidence. Int J Man-Machine Studies, 1983, 19: 33–43

    Google Scholar 

  34. Yager R R. Entropy and specificity in a mathematical theory of evidence. Int J General Syst, 1983, 9: 249–260

    MathSciNet  MATH  Google Scholar 

  35. Dubois D, Prade H. Properties of measures of information in evidence and possibility theories. Fuzzy Sets Syst, 1987, 24: 161–182

    MathSciNet  MATH  Google Scholar 

  36. Lamata M T, Moral S. Measures of entropy in the theory of evidence. Int J General Syst, 1988, 14: 297–305

    MathSciNet  MATH  Google Scholar 

  37. Klir G J, Ramer A. Uncertainty in the Dempster-Shafer theory: a critical re-examination. Int J General Syst, 1990, 18: 155–166

    MATH  Google Scholar 

  38. Klir G J, Parviz B. A note on the measure of discord. In: Proceedings of the 8th Conference on Uncertainty in Artificial Intelligence, 1992. 138–141

  39. Pal N R, Bezdek J C, Hemasinha R. Uncertainty measures for evidential reasoning I: a review. Int J Approximate Reasoning, 1992, 7: 165–183

    MathSciNet  MATH  Google Scholar 

  40. Pal N R, Bezdek J C, Hemasinha R. Uncertainty measures for evidential reasoning II: a new measure of total uncertainty. Int J Approximate Reasoning, 1993, 8: 1–16

    MathSciNet  MATH  Google Scholar 

  41. George T, Pal N R. Quantification of conflict in Dempster-Shafer framework: a new approach. Int J General Syst, 1996, 24: 407–423

    MATH  Google Scholar 

  42. Jousselme A L, Liu C S, Grenier D, et al. Measuring ambiguity in the evidence theory. IEEE Trans Syst Man Cybern A, 2006, 36: 890–903

    Google Scholar 

  43. Jiroušek R, Shenoy P P. A new definition of entropy of belief functions in the Dempster-Shafer theory. Int J Approximate Reasoning, 2018, 92: 49–65

    MathSciNet  MATH  Google Scholar 

  44. Pan Q, Zhou D, Tang Y, et al. A novel belief entropy for measuring uncertainty in Dempster-Shafer evidence theory framework based on plausibility transformation and weighted hartley entropy. Entropy, 2019, 21: 163

    MathSciNet  Google Scholar 

  45. Wen K, Song Y, Wu C, et al. A novel measure of uncertainty in the Dempster-Shafer theory. IEEE Access, 2020, 8: 51550–51559

    Google Scholar 

  46. Wang X, Song Y. Uncertainty measure in evidence theory with its applications. Appl Intell, 2018, 48: 1672–1688

    Google Scholar 

  47. Yang Y, Han D. A new distance-based total uncertainty measure in the theory of belief functions. Knowledge-Based Syst, 2016, 94: 114–123

    Google Scholar 

  48. Deng X, Xiao F, Deng Y. An improved distance-based total uncertainty measure in belief function theory. Appl Intell, 2017, 46: 898–915

    Google Scholar 

  49. Deng X. Analyzing the monotonicity of belief interval based uncertainty measures in belief function theory. Int J Intell Syst, 2018, 33: 1869–1879

    Google Scholar 

  50. Deng X, Jiang W. A total uncertainty measure for D numbers based on belief intervals. Int J Intell Syst, 2019, 34: 3302–3316

    Google Scholar 

  51. Xia J, Feng Y, Liu L, et al. On entropy function and reliability indicator for D numbers. Appl Intell, 2019, 49: 3248–3266

    Google Scholar 

  52. Yager R R. Interval valued entropies for Dempster-Shafer structures. Knowledge-Based Syst, 2018, 161: 390–397

    Google Scholar 

  53. Klir G J, Wierman M J. Uncertainty-based Information: Elements of Generalized Information Theory. Berlin: Springer, 1999

    MATH  Google Scholar 

  54. Klir G J. Uncertainty and Information: Foundations of Generalized Information Theory. Piscataway: Wiley-IEEE Press, 2006

    MATH  Google Scholar 

  55. Abe S, Okamoto Y. Nonextensive Statistical Mechanics and Its Applications. Berlin: Springer, 2001

    MATH  Google Scholar 

  56. Tsallis C. Possible generalization of Boltzmann-Gibbs statistics. J Stat Phys, 1988, 52: 479–487

    MathSciNet  MATH  Google Scholar 

  57. Wang D, Gao J, Wei D. A new belief entropy based on Deng entropy. Entropy, 2019, 21: 987

    MathSciNet  Google Scholar 

  58. Ozkan K. Comparing Shannon entropy with Deng entropy and improved Deng entropy for measuring biodiversity when a priori data is not clear. J Faculty Forestry-Istanbul Univ, 2018, 68: 136–140

    Google Scholar 

  59. Li J, Pan Q. A new belief entropy in Dempster-Shafer theory based on basic probability assignment and the frame of discernment. Entropy, 2020, 22: 691

    MathSciNet  Google Scholar 

  60. Zhou Q, Mo H, Deng Y. A new divergence measure of pythagorean fuzzy sets based on belief function and its application in medical diagnosis. Mathematics, 2020, 8: 142

    Google Scholar 

  61. Kuzemsky A. Temporal evolution, directionality of time and irreversibility. La Rivista del Nuovo Cimento, 2018, 41: 513–574

    Google Scholar 

  62. Jiang W, Wang S. An uncertainty measure for interval-valued evidences. Int J Comput Commun, 2017, 12: 631–644

    Google Scholar 

  63. Mambe M D, N’Takp’e T, Georges N, et al. A new uncertainty measure in belief entropy framework. Int J Adv Comput Sci Appl, 2018, 9: 600–606

    Google Scholar 

  64. Xie K, Xiao F. Negation of belief function based on the total uncertainty measure. Entropy, 2019, 21: 73

    Google Scholar 

  65. Zhao Y, Ji D, Yang X, et al. An improved belief entropy to measure uncertainty of basic probability assignments based on Deng entropy and belief interval. Entropy, 2019, 21: 1122

    MathSciNet  Google Scholar 

  66. Luo C K, Chen Y X, Xiang H C, et al. Evidence combination method in time domain based on reliability and importance. J Syst Eng Electron, 2018, 29: 1308–1316

    Google Scholar 

  67. Vandoni J, Aldea E, Le Hégarat-Mascle S. Evidential query-by-committee active learning for pedestrian detection in high-density crowds. Int J Approx Reason, 2019, 104: 166–184

    MathSciNet  Google Scholar 

  68. Khan M N, Anwar S. Time-domain data fusion using weighted evidence and Dempster-Shafer combination rule: application in object classification. Sensors, 2019, 19: 5187

    Google Scholar 

  69. Pan L, Deng Y. Probability transform based on the ordered weighted averaging and entropy difference. Int J Comput Commun, 2020, 15: 4

    Google Scholar 

  70. Wang Y, Liu F, Zhu A. Bearing fault diagnosis based on a hybrid classifier ensemble approach and the improved Dempster-Shafer theory. Sensors, 2019, 19: 2097

    Google Scholar 

  71. Zhang Y, Liu Y, Zhang Z, et al. A weighted evidence combination approach for target identification in wireless sensor networks. IEEE Access, 2017, 5: 21585–21596

    Google Scholar 

  72. Abellan J. Analyzing properties of Deng entropy in the theory of evidence. Chaos Solitons Fractals, 2017, 95: 195–199

    MATH  Google Scholar 

  73. Kang B, Deng Y. The maximum Deng entropy. IEEE Access, 2019, 7: 120758–120765

    Google Scholar 

  74. Deng Y. The information volume of uncertain informaion: (1) mass function. 2020. viXra:2006.0028

  75. Tsallis C, Gell-Mann M, Sato Y. Asymptotically scale-invariant occupancy of phase space makes the entropy Sq extensive. Proc Natl Acad Sci USA, 2005, 102: 15377–15382

    MathSciNet  MATH  Google Scholar 

  76. Gao X, Deng Y. The Pseudo-Pascal triangle of maximum Deng entropy. Int J Comput Commun, 2020, 15: 1–10

    Google Scholar 

  77. Liu F, Gao X, Zhao J, et al. Generalized belief entropy and its application in identifying conflict evidence. IEEE Access, 2019, 7: 126625–126633

    Google Scholar 

  78. Song Y, Deng Y. Divergence measure of belief function and its application in data fusion. IEEE Access, 2019, 7: 107465–107472

    Google Scholar 

  79. Gao X, Liu F, Pan L, et al. Uncertainty measure based on Tsallis entropy in evidence theory. Int J Intell Syst, 2019, 34: 3105–3120

    Google Scholar 

  80. Pan L, Deng Y. A new belief entropy to measure uncertainty of basic probability assignments based on belief function and plausibility function. Entropy, 2018, 20: 842

    Google Scholar 

  81. Li Y, Deng Y. Generalized ordered propositions fusion based on belief entropy. Int J Comput Commun, 2018, 13: 792–807

    Google Scholar 

  82. Song Y, Deng Y. A new method to measure the divergence in evidential sensor data fusion. Int J Distributed Sens Networks, 2019, 15: 1–8

    Google Scholar 

  83. Xiao F. An improved method for combining conflicting evidences based on the similarity measure and belief function entropy. Int J Fuzzy Syst, 2018, 20: 1256–1266

    MathSciNet  Google Scholar 

  84. Boulkaboul S, Djenouri D. DFIOT: data fusion for Internet of Things. J Netw Syst Manage, 2020, 54: 1–25

    Google Scholar 

  85. Xiao F, Qin B. A weighted combination method for conflicting evidence in multi-sensor data fusion. Sensors, 2018, 18: 1487

    Google Scholar 

  86. An J, Hu M, Fu L, et al. A novel fuzzy approach for combining uncertain conflict evidences in the Dempster-Shafer theory. IEEE Access, 2019, 7: 7481–7501

    Google Scholar 

  87. Wang J, Qiao K, Zhang Z. An improvement for combination rule in evidence theory. Future Generation Comput Syst, 2019, 91: 1–9

    Google Scholar 

  88. Tang Y, Zhou D, Chan F. An extension to Deng’s entropy in the open world assumption with an application in sensor data fusion. Sensors, 2018, 18: 1902

    Google Scholar 

  89. Hurley J, Johnson C, Dunham J, et al. Nonlinear algorithms for combining conflicting identification information in multisensor fusion. In: Proceedings of 2019 IEEE Aerospace Conference, 2019. 1–7

  90. Liu Z, Xiao F. An evidential aggregation method of intuitionistic fuzzy sets based on belief entropy. IEEE Access, 2019, 7: 68905–68916

    Google Scholar 

  91. Wang Z, Xiao F. An improved multi-source data fusion method based on the belief entropy and divergence measure. Entropy, 2019, 21: 611

    MathSciNet  Google Scholar 

  92. Fan X, Guo Y, Ju Y, et al. Multisensor fusion method based on the belief entropy and DS evidence theory. J Sens, 2020, 2020: 1–16

    Google Scholar 

  93. Tao R, Xiao F. Combine conflicting evidence based on the belief entropy and IOWA operator. IEEE Access, 2019, 7: 120724

    Google Scholar 

  94. Moral-Garcia S, Abellan J. Maximum of entropy for belief intervals under evidence theory. IEEE Access, 2020, 8: 118017

    Google Scholar 

  95. Dong Y, Zhang J, Li Z, et al. Combination of evidential sensor reports with distance function and belief entropy in fault diagnosis. Int J Comput Commun, 2019, 14: 329–343

    Google Scholar 

  96. Xiao F. A novel evidence theory and fuzzy preference approach-based multi-sensor data fusion technique for fault diagnosis. Sensors, 2017, 17: 2504

    Google Scholar 

  97. Wang Z, Xiao F. An improved multisensor data fusion method and its application in fault diagnosis. IEEE Access, 2019, 7: 3928–3937

    Google Scholar 

  98. Chen L, Diao L, Sang J. A novel weighted evidence combination rule based on improved entropy function with a diagnosis application. Int J Distributed Sens Netw, 2019, 15: 1–13

    Google Scholar 

  99. Liu F, Wang Y. A novel method of ds evidence theory for multi-sensor conflicting information. In: Proceedings of the 4th International Conference on Machinery, Materials and Computer (MACMC 2017). Paris: Atlantis Press, 2018. 343–349

    Google Scholar 

  100. Cui H, Liu Q, Zhang J, et al. An improved deng entropy and its application in pattern recognition. IEEE Access, 2019, 7: 18284–18292

    Google Scholar 

  101. Xia J, Feng Y, Liu L, et al. An evidential reliability indicator-based fusion rule for Dempster-Shafer theory and its applications in classification. IEEE Access, 2018, 6: 24912–24924

    Google Scholar 

  102. Zhang Y, Liu Y, Zhang Z, et al. Collaborative fusion for distributed target classification using evidence theory in IOT environment. IEEE Access, 2018, 6: 62314–62323

    Google Scholar 

  103. Buono F, Longobardi M. A dual measure of uncertainty: the Deng extropy. Entropy, 2020, 22: 1–10

    MathSciNet  Google Scholar 

  104. Pan L, Deng Y. An association coefficient of a belief function and its application in a target recognition system. Int J Intell Syst, 2020, 35: 85–104

    Google Scholar 

  105. Huang Z, Jiang W, Tang Y. A new method to evaluate risk in failure mode and effects analysis under fuzzy information. 2018, 22: 4779–4787

    Google Scholar 

  106. Wang H, Deng X, Zhang Z, et al. A new failure mode and effects analysis method based on Dempster-Shafer theory by integrating evidential network. IEEE Access, 2019, 7: 79579–79591

    Google Scholar 

  107. Liu Z, Xiao F. An intuitionistic evidential method for weight determination in FMEA based on belief entropy. Entropy, 2019, 21: 211

    MathSciNet  Google Scholar 

  108. Zheng H, Tang Y. Deng entropy weighted risk priority number model for failure mode and effects analysis. Entropy, 2020, 22: 280

    Google Scholar 

  109. Pan Q, Zhou D, Tang Y, et al. A novel antagonistic Weapon-Target assignment model considering uncertainty and its solution using decomposition co-evolution algorithm. IEEE Access, 2019, 7: 37498–37517

    Google Scholar 

  110. Li Y, Wang A, Yi X. Fire control system operation status assessment based on information fusion: case study. Sensors, 2019, 19: 2222

    Google Scholar 

  111. Liu H, Ma Z, Deng X, et al. A new method to air target threat evaluation based on Dempster-Shafer evidence theory. In: Proceedings of 2018 Chinese Control and Decision Conference (CCDC), 2018. 2504–2508

  112. Fei L, Deng Y, Hu Y. DS-VIKOR: a new multi-criteria decision-making method for supplier selection. Int J Fuzzy Syst, 2019, 21: 157–175

    MathSciNet  Google Scholar 

  113. Xiao F. A multiple-criteria decision-making method based on D numbers and belief entropy. Int J Fuzzy Syst, 2019, 21: 1144–1153

    MathSciNet  Google Scholar 

  114. Li M, Xu H, Deng Y. Evidential decision tree based on belief entropy. Entropy, 2019, 21: 897

    Google Scholar 

  115. Yan H, Deng Y. An improved belief entropy in evidence theory. IEEE Access, 2020, 8: 57505–57516

    Google Scholar 

  116. Chen L, Li Z, Deng X. Emergency alternative evaluation under group decision makers: a new method based on entropy weight and DEMATEL. Int J Syst Sci, 2020, 51: 570–583

    Google Scholar 

  117. Shang X, Song M, Huang K, et al. An improved evidential DEMATEL identify critical success factors under uncertain environment. J Ambient Intell Humanized Comput, 2019

  118. Huang Z, Yang L, Jiang W. Uncertainty measurement with belief entropy on the interference effect in the quantum-like Bayesian networks. Appl Math Comput, 2019, 347: 417–428

    MathSciNet  MATH  Google Scholar 

  119. He Z, Jiang W. An evidential Markov decision making model. Inf Sci, 2018, 467: 357–372

    MathSciNet  MATH  Google Scholar 

  120. Kang B. Construction of stable hierarchy organization from the perspective of the maximum deng entropy. In: Integrated Uncertainty in Knowledge Modelling and Decision Making. Berlin: Springer, 2019. 421–431

    Google Scholar 

  121. Mambe M D, Oumtanaga S, Anoh G N. A belief entropy-based approach for conflict resolution in IOT applications. In: Proceedings of 2018 1st International Conference on Smart Cities and Communities (SCCIC), 2018. 1–5

  122. Prajapati G L, Saha R. Reeds: relevance and enhanced entropy based Dempster Shafer approach for next word prediction using language model. J Comput Sci, 2019, 35: 1–11

    MathSciNet  Google Scholar 

Download references

Acknowledgements

This work was supported by National Natural Science Foundation of China (Grant No. 61973332).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yong Deng.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Deng, Y. Uncertainty measure in evidence theory. Sci. China Inf. Sci. 63, 210201 (2020). https://doi.org/10.1007/s11432-020-3006-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11432-020-3006-9

Keywords

Navigation