Abstract

In real life, multiple network public opinion emergencies may break out in a certain place at the same time. So, it is necessary to invite emergency decision experts in multiple fields for timely evaluating the comprehensive crisis of the online public opinion, and then limited emergency resources can be utilized to give priority to respond to the one with the highest crisis. Due to the complexity of network public opinion emergencies and the limited cognition of experts, most of the decision problems for evaluating the network public opinion emergencies are highly uncertain. Also, prior to the selection of the highest crisis, it is preferable that experts reach a high degree of consensus among their assessments or opinions. To address such problems, this paper presents a novel adaptive consensus reaching model for multiattribute group decision making (MAGDM) with probabilistic linguistic decision matrices (PLDMs). First, to quantify the difference between any two probabilistic linguistic term sets (PLTSs) accurately and efficiently, we define a novel distance measure between PLTSs based on the Wasserstein metric. Then, by integrating the defined PLTSs-based Wasserstein (PL-Wasserstein) distance measure into the classical CCSD method, we construct an optimization model for objectively determining attribute weights. Subsequently, we develop the individual cumulative consensus contribution (ICCC) measure and the group consensus measure, respectively, following which is to present an integrated consensus improving strategy that considers both weight-updating (i.e., dynamic weights of experts and attributes) and assessment-adjusting. Finally, the feasibility and the applicability of the proposed approach are illustrated via a real evaluation of network public opinion emergencies. Through comparing with existing probabilistic linguistic MAGDM approaches, the proposed approach offers the advantages in terms of the accurate measurement of information difference and the integrated improvement of consensus efficiency.

1. Introduction

According to China Internet Network Information Center (CNNIC) 43th statistical report on Internet development in Beijing (released on the 28th of February, 2019), it follows that as of the end of December, 2018, Chinese netizens reached 829 million, the Internet penetration rate reached 59.6%, and the usage rate of WeChat friends circle, QQ space, and Weibo as social media reached 83.4%, 58.8%, and 42.3%, respectively, among which Sina Weibo monthly active users have reached 462 million (https://www.cnnic.net.cn/hlwfzyj/hlwxzbg/hlwtjbg/201902/t20190228_70645.htm). Driven by social applications such as WeChat, QQ, and Weibo, after being reported, hyped, and transmitted on the Internet, emergencies in real life are rapidly spread in the society and eventually evolve into hot spots with social influence [1, 2]. Hot topics that are updated every several minutes have a profound impact on online public opinion hot spots. The huge number of Chinese netizens has also accelerated the fermentation and spread of hot spots, resulting in potentially greater harm [3]. For example, a medical-related incident “Wei Zexi Incident” that triggered netizens’ attention on the Internet became a focus event of public opinion from April to May 2016. The military dog public opinion monitoring system showed that from April 9 to May 3, 2016, there was 1398077 related public opinion information, of which Weibo accounted for 80.2% which is the most, followed by news information, 15.9%; forum information was the least, 3.9%. Considering the huge influence and potential hazard of similar network public opinion emergencies, the Chinese governments at all levels have taken the governance and control of them as one of the key emergency works. In real life, multiple network public opinion emergencies may break out in a certain place at the same time. So, emergency decision experts in multiple fields are necessarily invited for timely evaluating the comprehensive crisis of the online public opinion, and then limited emergency resources are used to give priority to respond to the one with the highest crisis [4]. Due to the complexity of network public opinion emergencies and the limited cognition of people, most of the decision problems for network public opinion emergencies are highly uncertain. It is hard for decision makers to provide precise assessments in the assessment process [57]. Also, prior to the selection of the highest crisis, it is preferable that experts reach a high degree of consensus among their assessments or opinions [8, 9]. Therefore, in essence, the selection of the network public opinion emergency with the highest crisis is a consensus-driven multiattribute group decision making (MAGDM) with highly uncertain information.

MAGDM can be defined as a decision situation where multiple decision makers or experts evaluate two or more possible alternatives according to multiple attributes. In real-world MAGDM, the increasing complexity and uncertainties of decision problems drive the experts to consider complex linguistic expressions instead of single linguistic terms [10]. In the last decade, some studies have successively attempted to model and compute with specific types of complex linguistic expressions. For example, by combining the merits of the hesitant fuzzy set (HFS) and linguistic terms, Rodriguez et al. introduced [11] hesitant fuzzy linguistic term set (HFLTS) that is characterized by a set of consecutive linguistic terms to increase the richness and flexibility of linguistic information elicitation using linguistic expressions. Considering that linguistic terms involved in an expression derived by the group may be not always consecutive, Wang [12] proposed extended HFLTS (EHFLTS). Inspired by the proportional 2-tuple linguistic representation model (provided by Wang and Hao [13]), Zhang et al. [14] initially developed linguistic distribution assessment (LDA). Compared with HFLTS, the characteristic of LDA is that symbolic proportions are assigned to all linguistic terms of a given linguistic term set. Following that initiative, the concept of possibility distribution for HFLTS (PDHFLTS) was developed by Wu and Xu [15] to model weight assignment for several discrete linguistic terms, where an HTLFS is ideally assumed to be uniformly distributed on its ordered linguistic terms [16, 17]. Further, under group decision-making (GDM) environments, the hesitant linguistic assessments of experts and the proportional information of each generalized linguistic term may need to be simultaneously considered [18, 19]. For instance, in terms of a questionnaire about the hazard degree of an emergency, 15 respondents (out of 100) stated it is “very high,” 70 respondents stated it is “high,” 10 respondents believed it is “slightly high,” and others did not say anything. The collective assessment information can be denoted as {(very high, 0.15), (high, 0.7), (slightly high, 0.1)}. For this purpose, Chen et al. [20] initially proposed proportional HFLTS (PHFLTS) to simulate this decision scenario. Almost at the same time, Pang et al. [21] introduced probabilistic linguistic term set (PLTS) with a different name for the similar idea. Here, it needs to be emphasized that PDHFLTS, PHFLTS, and PLTS as variants of LDA are designed for different purposes. However, they are essentially derived from the idea of LDA and are even mathematically consistent with LDA in some sense. The taxonomy of the existing distributed linguistic representations and their comparison results can be found in a recent overview provided by Wu et al. [22]. In the last few years, PLTS, as a type of distributed linguistic representations, has occupied a dominant place in recent development and advancement of the linguistic decision-making community due to the following two possible reasons: (a) one is a concise and clear mathematical form and (b) the other is the focus and citation from related well-known scholars. In particular, MAGDM problems with PLTSs have received considerable attention. Related studies mainly concentrate on aggregation operators, comparison rules, measures, and decision-making methods [23].

Traditionally, only a selection process on all possible alternatives, which is composed of two phases: aggregation and exploitation, is applied to solving GDM problems. However, for many real-world problems closely related to citizens such as raising taxes, infrastructure constructions, and emergency responses, the resolution scheme obtained only by the selection process may not be supported by all or most experts since differences of individual opinions have not been fully taken into account. To do so, consensus reaching process (CRP) was introduced as an additional phase in the resolution of GDM problems [24, 25]. In general, consensus is defined as a dynamic and interactive group decision process coordinated by a human figure that is known as moderator (either real or virtual). Most classical consensus building is based on the interactive CRPs with the two classic consensus rules: identification rule (IR) and direction rule (DR) [26, 27]. Until now, classical CRPs have been extended and improved in different complex structures and contexts (e.g., fuzzy context [28], heterogeneous and uncertain preferences [29, 30], large-scale group [31], social network [32], dynamic environments [33], and minimum cost consensus [34]). In particular, for consensus-driven MAGDM with PLDMs, Wu and Liao [35] developed a consensus-based PL-GLDS method. However, to the best of our knowledge, the CRPs for MAGDM with PLDMs are not rich enough because most of the relevant studies in the probabilistic linguistic environment are based on probabilistic linguistic preference relations (PLPRs). Fortunately, a wealth of existing CRPs in other different structures and contexts mentioned above can be utilized to obtain some inspiration in exploring the novel PLDMs-based CRPs.

Consensus measures can usually be required to conduct the consensus checking and guide consensus repairing in CRPs [36]. In consensus-driven probabilistic linguistic MAGDM, we need to accurately measure the consensus degree between the individuals and collective opinions. Distance measures are natural to depict the deviations or differences between experts’ opinions, which have been widely applied to the consensus measure in GDM. Recently, by turning to linguistic scale functions, the existing distances between PLTSs have been improved, which greatly promote the further development of consensus measures with PLTSs. For example, utilizing equivalent information of LTSs instead of their subscripts, Mao et al. [37] put forward a new Euclidean distance. Two novel distance measures (i.e., a generalized relative distance and an extended Hausdorff distance) for PLTSs were defined by Wang et al. [38]. Besides, considering that both Pang et al.’s distance measures [21] and Zhang et al.’s distance measures [39] fail to represent the differences between probabilities and the differences between linguistic terms, simultaneously, Wu et al. [40] established a new distance measure of PLTSs after introducing an adjustment method to derive the same probability set of pairwise PLTSs. Further, Wu and Liao’s distance measure of the PLTSs has been improved by incorporating the unbalanced scenario [35], which is employed to set up the correlation coefficient between two PLTSs and then to measure the consensus degree between the individuals and collective opinions.

To design a suitable consensus reaching mechanism for the specific problem is another focus of CRPs. Generally, according to the way to guide the discussion process, the CRPs can be divided into two categories: feedback versus no feedback [28]. The feedback mechanisms are usually supervised by a moderator. The moderator, who plays a central role in the decision making, provides the experts with feedback and advice so that they can move towards a predefined consensus level [41]. Whether or not to modify the individual preferences needs to be determined by the experts. On the contrary, the no-feedback mechanisms tend to automatically update the preferences and/or weights of those experts who contribute the least to the group consensus, thereby reducing the need for a moderator. The CRPs without feedback mechanisms, which can avoid rigid corrections for individual preferences and thus make the experts’ human intervention as minimal as possible, are very important and useful in certain special decision scenarios (such as emergency consensus decision making [42]). Some adaptive CRPs without feedback mechanism have been proposed and favored by scholars. Among them, the main adaptive consensus strategies include (a) generating recommendations by considering dynamic parameters such as minimum cost, consensus level, and adoption level [34, 43, 44] and (b) updating expert weights based on individual consensus contributions [45, 46], non-cooperative behavior [47, 48], and self-confidence [49].

Based on the review conducted above, it is clear that the consensus-driven MAGDM with PLTSs has recently become a popular topic and the exploration of this issue has just begun. Moreover, some potential challenges can be identified as follows.(1)Consensus measure in CRPs in different structures and contexts is often built based on different forms of distance. Nevertheless, the existing distance measures between pairwise PLTSs still have a few defects (see Section 4.1 for details). Although Wu and Liao [50] have already developed an effective distance measure of PLTSs from a new perspective, the computational complexity of the distance measure, originating from adjusting the probability set of any two PLTSs to be the same before calculating the distance, may have a major impact on its widespread application. For that reason, it is a leading challenge on how to balance between efficiency and accuracy in establishing a new distance measure of PLTSs, which will be utilized to construct a corresponding PLTSs-based consensus measure.(2)In consensus-driven probabilistic linguistic MAGDM, when some individual assessments with nonconsensus occur, sometimes the moderator may recommend the identified individuals or experts to accept hard adjustment advice so that individuals can adjust their assessments for quickly reaching a certain consensus level. However, due to the double pressure of timeliness and reliability especially when confronted with some special decision-making environments (e.g., emergency consensus decision), the identified individuals or experts may be reluctant to or difficult to correct their assessments, to a certain extent, which may result in the interruption of the traditional CRPs. Given this defect of the traditional feedback mechanisms in actual execution, we urgently need to design a novel adaptive consensus reaching mechanism for probabilistic linguistic MAGDM.(3)Until now, most of the CRPs under probabilistic linguistic environment are designed based on PLPRs rather than PLDMs. The possible cause is that a wealth of CPRs with crisp, fuzzy, or linguistic preference relations boosts the improvement of PLPRs-based CRPs. Note that multiple attributes with PLTSs are typically implied when experts evaluate alternatives under probabilistic linguistic environment. Therefore, it is theoretically and practically significant to explore a new MAGDM approach integrated with a PLDMs-based CRP. Besides, only one adaptive consensus improving technique (i.e., either generating recommendations or updating weights) is involved in the existing PLDMs-based adaptive CRPs, which may be not beneficial for quickly and comprehensively improving the consensus efficiency [51]. Accordingly, it is also necessary to integrate various adaptive consensus improving strategies into PLDMs-based CRPs.

Motivated by these challenges, this paper aims to propose a novel consensus reaching model for MAGDM problems with probabilistic linguistic assessment information. The main innovations and contributions of this paper are as follows:(1)We propose a PLTSs-based Wasserstein (called PL-Wasserstein) distance measure and show that the novel distance measure has been improved in both rationality and efficiency (see Section 4.2 for details).(2)We construct an optimization model for objectively determining attribute weights, where the new Wasserstein distance measure between PLTSs is combined with the classical CCSD idea.(3)We develop the individual cumulative consensus contribution (ICCC) measure and the group consensus measure, respectively. The former is used to punish the weights of experts that contribute the least to the group as well as to identify the individual assessment value with a maximum distance from the group opinion. The latter is utilized to guide the consensus process.(4)We put forward a novel adaptive CRP for probabilistic linguistic MAGDM, where two adaptive consensus improving strategies (i.e., weight-updating and assessment-adjusting) are integrated. Subsequently, to obtain a consensus ranking of alternatives, we present a probabilistic linguistic MAGDM approach with the novel CRP.(5)We make some comparative analyses with other MAGDM approaches to illustrate the effectiveness of the proposed approach by a case study concerning the evaluation of network public opinion emergencies.

The remainder of the paper is organized as follows. Section 2 reviews some related concepts and definitions. In Section 3, we describe consensus-driven MAGDM problems with probabilistic linguistic assessment information. A PL-Wasserstein distance measure is developed in Section 4. In Section 5, a novel adaptive consensus reaching model for probabilistic linguistic MAGDM is presented. The proposed approach is illustrated using a case of real network public opinion crisis rating evaluation, and we compare some similar methods in Section 6. Section 7 ends the paper with some concluding remarks.

2. Preliminaries

2.1. Probabilistic Linguistic Term Sets (PLTSs)

In this section, the concepts and operational laws about linguistic term sets (LTSs) and probabilistic linguistic term sets (PLTSs) are given.

Definition 1 (see [52]). Let be a subscript-symmetric ordinal LTS, where is a positive integer, represents the assessment of “indifference” or “medium,” and the remaining linguistic terms are distributed around in ascending order of intensity. satisfies the following conditions: (a) the set is ordered: iff ; (b) the negation operator is defined as .
For example, given an LTS with seven-point rating scales, then can be taken as

Remark 1. To preserve all the given information, Xu extends the discrete LTS to a continuous linguistic term set , where () is a sufficiently large positive integer. Moreover, different types of LTSs, including balanced and unbalanced semantics, act as the different evaluation scales. Thus, an appropriate LTS needs to be chosen to evaluate qualitative variables according to practical issues.

Definition 2 (see [53]). Let be an LTS; the linguistic scale function of LTS can be defined by using a monotonically increasing function asAdditionally, the equivalent linguistic term of the membership degree is obtained by the following inverse function :For different types of LTSs, different linguistic scale functions can be designed to calculate the semantics of linguistic terms according to practical problems [35].
Especially, if the semantics of LTS are evenly distributed, then the linguistic scale function and its inverse function can be formulated asIf the semantics are unevenly distributed and the semantic deviations between two adjacent linguistic terms on one side of the “medium” are increasing, thenwhere and are both indicative functions, and two parameters and satisfy , .

Definition 3 (see [21]). Let be a subscript-symmetric ordinal LTS. A PLTS on can be expressed aswhere denotes the k-th linguistic term with the probability (the meaning of probability can be the weight, the possibility degree, or the trust degree) and is the number of all different linguistic terms in . Moreover, the expression indicates that the DM, due to his/her lack of knowledge, cannot provide complete assessment information, resulting in the absence of partial probability information.
Some basic operations of PLTS have been reviewed in Ref. [23].

Definition 4 (see [21]). Given a PLTS with , the normalized PLTS is defined aswhere for all .

Definition 5 (see [21]). Given two PLTSs on , , where is the number of all different linguistic terms in , if , when , then we can add linguistic terms to so that the numbers of linguistic terms in and are identical. The added linguistic terms are supposed to be the smallest one in and their corresponding probabilities are zero.

Definition 6 (see [39]). Given a PLTS on , is the subscript of the linguistic term .(1)If all elements in the PLTSs are with different values of , then all the elements are arranged according to the values of directly.(2)If there are two or more elements with equal values of , then (a) when the subscripts () are unequal, () are arranged according to the values of () in ascending order; (b) when the subscripts () are equal or incomparable, () are arranged according to the values of () in ascending order.Similarly, we can obtain a descending-order PLTS.

Definition 7 (see [35, 40]). Let be two normalized PLTSs on with a linguistic scale function , where is the k-th LTS and is its corresponding probability in . Then, the general probabilistic linguistic expected value of PLTS () and the general variance value of PLTS () are defined as follows, respectively.For two PLTSs and , if , then . If , then , ; if , then , .

Definition 8. (see [35, 50])Let be a set of experts whose expert vector is such that and . Suppose thatare PLTSs on an LTS provided by experts while the remaining experts do not give any evaluation. Then, we can express the collective evaluation by using the following PLTS:where is the weight of in and .
If the weights of experts are the same or not given, we can suppose that .

2.2. Consensus-Driven MAGDM Framework

In a classical MAGDM, there is a discrete set of alternatives, a set of predefined attributes, and a group of two or more experts (characterized by their backgrounds and knowledge) who express their opinions or preferences about the set of alternatives under the set of predefined attributes. Clearly, in any consensus-driven MAGDM, the experts should reach an acceptable degree of group consensus on the solution set of alternatives [34]. To do so, a classical consensus MAGDM usually consists of two basic components: consensus process and selection process [25].

2.2.1. Consensus Process

This process refers to how to obtain the maximum degree of agreement among the experts on the solution alternatives. Usually, before the selection process, it is carried out to achieve a solution to the GDM problems which can be accepted by all experts in the group. Generally, to avoid absolute “winners” and “losers” in a group, a dynamic and iterative discussion procedure is indispensable so that experts can reach a certain degree of consensus in this process. Three main phases involved in this process include (a) measuring level of group consensus, (b) modifying evaluations or updating decision weight, and (c) generating feedback information, which can be required for conducting CRPs. An overall scheme of the different phases carried out in a consensus process is depicted in Figure 1.

2.2.2. Selection Process

This process represents how to obtain the solution set of alternatives from the opinions on the alternatives given by the experts. It is composed of two phases: aggregation and exploitation. A collective evaluation based on the opinions expressed by the experts is defined in the aggregation phase. The collective evaluation is transformed into a global ranking by the exploitation phase. A general scheme of the two phases performed in a selection process is shown in Figure 2.

2.3. Wasserstein Metric

The Wasserstein metric or distance is a distance function defined between probability distributions on a given metric space, also called (Monge-)Kantorovich(-Rubinstein) distance that can be traced back to the early research of Monge–Kantorovich optimal transport problem [54]. The terminology Wasserstein distance became popular, mainly in Western literature, following Dobrushin who studied some of its topological properties and referred to an earlier work by Wasserstein [55]. The long history of Wasserstein distance can be found in the literature [56] for more details.

There are a host of metrics available to quantify the distance between probability measures; some are not even metrics in the strict sense of the word but are simply notions of “distance” that have been proven useful to consider [57]. How does one choose among all these metrics? Issues that can affect a metric’s desirability include whether it has an interpretation applicable to the problem at hand, important theoretical properties, or useful bounding techniques [58]. Kantorovich and Rubinstein [59] first recognized Wasserstein metric as a reasonable distance on spaces of random variables or probability distributions. In Ref. [59], to measure the distance of probability distributions, an infinite-dimensional linear programming is taken into consideration, which is inspired by the problem of optimal mass transportation. Roughly speaking, the minimal effort required to reconfigure the probability mass of one distribution to recover the other distribution was measured by the Wasserstein metric.

We briefly review the definition and related properties of the Wasserstein metric in the following.

Definition 9 (see [56, 57]). Let be a Polish (i.e., complete, separable, and metric) space, and let . For any two Borel probability measures and on , the q-order Wasserstein distance between and is defined aswhere denotes the set of all couplings of and on , that is, the set of all joint probability measures over whose marginals are and , satisfying and for all measurable subsets . Here, the infimum is taken over all probability measures () with prescribed marginals and , that is, all pairs of random vectors and marginally distributed as and , respectively.

Remark 2 (see [60, 61]). The 1-order Wasserstein distance (in the case ) is also descriptively called the earth mover’s distance (EMD), which measures the least amount of work required to move a pile of soil from one shape to another. Here, a unit of work corresponds to transporting a unit of soil by a unit of ground distance.

Remark 3 (see [62]). Compared to the K-L divergence and the J-S divergence, the outstanding advantage of the Wasserstein distance is that the difference between the two probability distributions can still be reflected even if the support sets of the two distributions do not overlap or the overlap is very small. However, in this case, the J-S divergence is constant while the K-L divergence may be meaningless.

3. Consensus-Driven MAGDM Problems with Probabilistic Linguistic Assessment Information

This paper mainly investigates consensus-driven MAGDM problems with probabilistic linguistic assessment information. The characteristics of assessment information provided by experts are mainly reflected in the following two aspects. On the one hand, the experts are accustomed to expressing their assessments or preferences over the considered alternatives in the form of linguistic terms like “good,” “fair,” or “poor.” On the other hand, the experts may not only hesitate between more than one linguistic term but also prefer some of the possible linguistic terms so that the hesitant linguistic terms may have different importance degrees, such as “40% sure it is good and 60% sure it is fair.” This kind of problem usually occurs when evaluating hotels on TripAdvisor.com, emergency rescue plans, intelligent medical hospitals, and sustainable suppliers.

Let be a subscript-symmetric LTS, be a finite set of m alternatives, be a set of experts, and be a set of n attributes, where and represent the benefit attribute and cost attribute sets, respectively. The assessment value given by expert on alternative with respect to attribute is denoted as in the form of a PLTS (; ; ). is called a probabilistic linguistic decision matrix (PLDM) provided by expert on alternatives under attributes. Additionally, the weight vector over experts is denoted as such that and . belonging to is the attribute weight vector, satisfying and , where represents an incomplete attribute weight information set.

The main problem to be solved in this paper is to establish a consensus reaching model for probabilistic linguistic MAGDM problems with PLDMs. The following questions arise when investigating this research problem. (a) How do we quantify the difference between any two PLTSs accurately and efficiently after recognizing the shortcomings of existing measure methods? (b) How do we fully mine potential attribute weight information to serve the consensual sorting or selection of alternatives after collecting the PLDMs information? (c) How do we design a fast, valid, and adaptive CRP to reach a certain degree of consensus in the group with PLDMs?

4. PLTSs-Based Wasserstein Distance Measure

In this section, assume that all PLTSs have been normalized by Definition 4. That is, any PLTS satisfies . Firstly, the existing distances between PLTSs are reviewed and some of their defects one by one through some specific examples are pointed out. Then, a new Wasserstein distance measure between PLTSs is proposed, and its properties are given.

4.1. Existing Distance Measures between PLTSs

Recently, linguistic scale functions (see Definition 2) have been integrated into PLTSs-based distance measures. Related definitions of distance measures are as follows.

Definition 10 (see [37]). Let be an LTS with the linguistic scale function and be two ascending-ordered normalized PLTSs on with (see Definition 6). Then, the Euclidean distance between and is defined as follows.

Example 1. Consider two ascending-ordered normalized PLTSs and based on . For the sake of simplicity, suppose that the linguistic scale function is as shown in equation (4). By equation (13), it is easy to get . Obviously, the two PLTSs are not completely identical. Thus, the Euclidean distance obtained by using equation (13) is more or less irrational.

Definition 11 (see [38]). Let be an LTS with the linguistic scale function . Two normalized PLTSs and on are given, whose elements are arranged according to the value of () and () in descending order, respectively. The generalized relative distance between and and the extended Hausdorff distance between and are defined as follows:

Example 2. Consider two descending-ordered PLTSs and based on . For the sake of simplicity, suppose that the linguistic scale function is as shown in equation (4). In particular, if , it holds that by equation (14). So, does not satisfy the uniqueness axiom of distance. Additionally, through using equation (15), we can conclude that while . So, , namely, does not satisfy the symmetry axiom of distance.
Wu and Liao [50] realized the fact that multiplying the probability by the subscript of the corresponding linguistic term of a PLTS or multiplying the probabilities of two PLTSs is unreasonable. By adjusting the PLTSs with the same probability set, they proposed three kinds of distance measures reflecting on the difference of linguistic terms and probabilities simultaneously. Furthermore, considering the linguistic scale functions of different linguistic terms in the PLTSs, Wu and Liao [35] developed the generalized distance measures between two PLTSs, which is shown as follows.

Definition 12 (see [35]). Let be an LTS with the linguistic scale function . For two normalized PLTSs and on , suppose that the adjusted forms are and with the same possibility set as (for details about the adjusting process, refer to Ref. [40]). The generalized distance between and with the above adjustment strategy of PLTSs can be defined as

Example 3. (continued from Examples 1 and 2). In particular, take . First, adjust the three PLTSs (i.e., , and ) with the same probability set . Then, we can obtain three adjusted PLTSs: , , and . Finally, by equation (16), we can obtain , , .

Remark 4. The above generalized distance satisfies the basic principles of distance measure [35], even including the property of triangle inequality. In fact, for any three normalized PLTSs (, , and ), we can always adjust them with the same possibility set by using the adjustment strategy of PLTSs [40]. So, the triangle inequality (i.e., can also be proven to be true in spite of missing specific elaboration in Refs. [35, 40]. However, it takes too much time to implement the adjustment strategy for PLTSs, which is not conducive to fast and effective PLTSs-based decision making.

4.2. PLTSs-Based Wasserstein Distance Measure

Given the shortcomings of the above definitions on distances between PLTSs, a Wasserstein distance measure between PLTSs is defined.

First, let be a normalized PLTS by Definition 4, where is the k-th LTS and is its corresponding probability in the PLTS . Given the linguistic scale function of LTS (see Definition 2), any PLTS is considered as a discrete probability distribution. That is, the linguistic scale degree of linguistic terms in the PLTS can be assumed to be a random variable, which follows a discrete probability distribution (denoted by ), with the following probability mass function:

Then, we define the following q-order Wasserstein distance measure between PLTSs, by resorting to the idea of classical Wasserstein distance (see Definition 9).

Definition 13. Suppose that is both a distance function and a binary Borel measurable function. Let and be two normalized PLTSs by Definition 4, where is the k-th LTS and is its corresponding probability in . The q-order Wasserstein distance measure between PLTSs can be defined asHere, the meaning of formula (18) is that the infimum is applied to the set of all joint probability distributions with prescribed marginals and , where indicates that the linguistic scale degree of linguistic terms follows the discrete probability distribution with the probability mass function , , .
Some properties of Definition 13 are given in the following.

Proposition 1. Let be an LTS with the linguistic scale function . Suppose that , , and are three normalized PLTSs on . The q-order PL-Wasserstein distance measure satisfies the following basic principles of distance:(1)(2), if and only if (3)(4)

Proof. (1) Since is a distance function, then . So, one has . Thus, .
(2) On the one hand, if , then since has a null diagonal, with the optimal coupling of such that , where , . On the other hand, by the positivity of all off-diagonal elements of , whenever (because in this case, an admissible coupling necessarily has a nonzero element outside the diagonal).
(3) Since is a distance function, then the symmetry (i.e., ) remains true. So, it is clear that .
(4) Let () be three discrete probability distributions with the probability mass functions , , . Also, suppose that and are the optimal couplings of and , respectively. Based on the Gluing Lemma [56], one can obtain tripe of random variables , satisfying that has the same probability distribution as and has the same probability distribution as . So, one can haveHere, the first inequality follows from the fact that is a coupling of . The second employs the triangle inequality of the distance function . The third is an application of Minkowski inequality in (). The last equality implies that and are the optimal couplings of and , respectively.

Proposition 2. In particular, for , take and a Hamming distance function is given. The special 1-order PL-Wasserstein distance measure is denoted by . Besides the properties provided by Proposition 1, has the following properties:(1)(2), if and only if either and or and

Proof. (1) Since the linguistic scale function is ensured within the interval [0, 1], then, for any and , the value of must belong to the interval [0, 1]. According to the expectation of random variable function, one can conclude that the value of must belong to the interval [0, 1].
(2) On the one hand, it is easy to get if either and or and . On the other hand, if the conclusion that either and or and is not true, there is at least one and satisfying , and thus .
As far as the distance measure is concerned, if the joint probability distribution () of two discrete random vectors and is equipped with the joint probability mass function: , , , the issue of distance measure by equation (18) can be equivalently transformed into solving an optimization model (M-1) as follows.The objective function in (20) in model (M-1) represents the sum of the weighted distance between two linguistic terms in and in , whose weights are the joint probability . The first constraint in model (M-1) reflects the basic requirements of the probability mass function. The remaining constraints in Model (M-1) indicate the essential qualification for two marginal distributions ( and ) of . Therefore, the economic meaning of minimizing the objective function subject to those constraints is to achieve the minimum cost of the weighted distance as the distance measure between two PLTSs. Once model (M-1) is solved, we have found the optimal value, that is, the 1-order PL-Wasserstein distance between two given PLTSs ( and ).

Theorem 1. Model (M-1) must have an optimal solution.

Proof. First, the feasible region of model (M-1) is a nonempty set since one can always construct independent random variables with prescribed marginals. Second, the feasible region of model (M-1) is bounded under constraints (20). With consideration of the above two aspects, based on the fundamental theorem of linear programming, we can conclude that the optimal value of model (M-1) must be attained.
Computing model (M-1) is based on solving the well-known transportation problem that is a special type of linear programming, for which the traditional method includes the transportation simplex method and the interior-point method [61]. Therefore, by using Microsoft Excel solver, LINGO, or MATLAB software packages, the transportation problems such as model (M-1) can be solved quickly and effectively.

Example 4. (continued from Examples 1 and 2). In particular, given and . By model (M-1), , , and , which is consistent with the results of Example 3. Thus, the proposed PL-Wasserstein distance measure is reasonable and effective.

Remark 5. Compared with the existing PLTSs-based distance measures, the PL-Wasserstein distance measure has the following advantages.(a)It is not required to add some linguistic terms to PLTSs (such as the distance in Definition 10), which avoids information bias caused by the addition of artificial linguistic terms.(b)There is no need to rearrange elements of PLTSs by using some ranking rules (such as the distances in Definitions 10 and 11), which eliminates this possibility that different rearrangement rules result in different distance results.(c)Some basic axioms of a metric or distance (such as identity, symmetry, and triangle inequality) are satisfied, which ensures that the novel measure is a true metric in the mathematical sense.(d)To adjust the probability set of two PLTSs to be the same (such as the distance in Definitions 10 and 12) is not required, which can greatly improve computational efficiency.

5. A Novel Adaptive Consensus Reaching Model for Probabilistic Linguistic MAGDM

To solve the MAGDM problem presented in this paper, our method uses the following five steps: (a) construct an attribute weight determining model (see Section 5.1); (b) establish an expert weight-updating model (see Section 5.2); (c) set up an adaptive assessment-adjusting model (see Section 5.3); (d) develop an adaptive CRP with PLDMs (see Section 5.4); and (e) determine the consensus ranking order of the alternatives (see Section 5.5).

5.1. An Optimization Model for Determining Attribute Weights

In MAGDM, the attribute weights are crucial to the optimal ranking of the alternatives. The weight-determining methods mainly include subjective methods, objective methods, and integrated methods. Among them, the CCSD (correlation coefficient and standard deviation) method has several advantages over other objective methods of weight determination as follows [63]. (a) Compared with the traditional entropy method, it does not require specific normalization methods. (b) It determines more comprehensive and convincing attribute weights than the entropy method and the SD method. (c) It has a clearer modeling mechanism than the CRITIC method. Inspired by the classical CCSD method, we develop an attribute weight determining model, where the new PL-Wasserstein distance measure is combined with the classical CCSD idea.

Firstly, suppose that the assessment value given by expert for alternative with respect to attribute is denoted as in the form of PLTS. To unify the criteria to beneficial type, transform into by using the following equation:where the supplement operation of PLTS is expressed as [64]

Subsequently, utilize Definition 4 to transform the to the normalized individual PLDMs , .

Then, based on the above normalized individual PLDMs, an incomplete attribute weight information set , and an expert weight vector , the specific procedure of determining attribute weights is shown as follows.

On the one hand, by utilizing Definition 7, we can obtain the positive-ideal and negative-ideal solution of attributes associated with expert , which are expressed as and , respectively. Based on the proposed PL-Wasserstein distance measure, we construct a normalized numerical performance matrix , whose entries are represented by

Given the simple additive weighting (SAW) method, the numerical performance value of each alternative associated with expert can be calculated through the expression , . Generally, as far as the expert is concerned, the greater performance value for alternative , the better the alternative . The best alternative (option) is the option that has the highest performance value. Now, to take into account the impact of the attribute on decision making, we remove it from the set of attributes. When is eliminated, the overall performance value of alternative is determined by

Then, the correlation coefficient between the performance value of with respect to expert and the above overall performance value is defined as

If is large enough to be close to 1, then the rating value of attribute and the total performance value excluding attribute will have nearly the same numerical distributions and rankings. In this case, the removal of the attribute will have little impact on decision making. Therefore, the attribute should be assigned a low weight. If is small enough to be close to , then the assessment value of attribute and the total performance value without the inclusion of will have almost opposite numerical distributions and rankings. In this case, the removal of the attribute will have a great impact on decision making. So, the attribute should be assigned a high weight.

On the other hand, the larger the standard deviation of an attribute, the greater the variation degree of the value of the attribute, indicating that the attribute with larger standard deviation has a greater impact on the decision making. So, the attributes with the larger standard deviation should have greater weights than those with lower standard deviation. The standard deviation of attribute with regard to expert is formulated as

Based on the consideration of the above two aspects, when giving the expert weight vector in advance, we can construct the following nonlinear optimization model (M-2) for objectively determining attribute weights involved in MAGDM problems investigated in this paper.

In model (M-2), the objective function indicates the total error of estimating the attribute weights for all experts with the consideration of two factors involved the correlation coefficient and the standard deviation, where the root value of is used to reduce the difference between the largest and the smallest weights that are directly estimated through the correlation coefficient . The first constraint in model (M-2) reflects the set of incomplete weight information that is compatible with experts’ subjective preferences. The second constraint in model (M-2) embodies the non-negative and normalization requirements of attribute weights. Using MATLAB and LINGO software packages, we can solve this nonlinear model to obtain the weight of each attribute.

5.2. Expert Weight Updating Model That Considers the Dynamic Individual Cumulative Contribution

Consensus measure is an important step to measure the consensus level among experts in MAGDM problems. Taking into consideration the characteristics of the MAGDM problem in which experts’ assessments are characterized by PLTSs, we need to reconstruct an effective method for measuring the individual and group consensus. Inspired by the existing consensus improving strategies [45, 46], a new approach to measuring experts’ consensus contribution to the group and the group consensus level is given below.

First, using equation (11), the collective assessment of all experts for alternative with respect to attribute can be formulated as

So, we can obtain the collective PLDM .

Then, the following individual consensus degree of expert on alternative can be expressed bywhere means 1-Wasserstein distance that can be computed by model (M-1) and that can be calculated by model (M-2) represents the weight of attribute .

Subsequently, the consensus degree of all experts on alternative can be obtained by

Similar to equation (30), the consensus degree on alternative without expert can be obtained by the following equation:

In equation (31), , , , and indicates that where represents the subscript set of all elements belonging to the expert set .

Definition 14. Suppose () and (, ) have the meanings as shown in equations (30) and (31), respectively. Then, for the alternative set with respect to the attribute set , the ICCC degree of expert () can be defined asHere, reflects the individual contribution degree of expert who devotes oneself to the CRPs. If , it shows that the expert plays a positive role in CRPs. The larger value of indicates the higher consensus contribution that expert makes to the group decision. On the contrary, if , it indicates that the opinion of expert has a negative influence on the CRPs.

Definition 15. The group consensus degree on all the alternatives can be defined aswhere () reflects the consensus level of the expert group. The larger the value of , the higher the consensus level of the group.
In general, the group consensus threshold needs to be determined in advance, and its determination methods mainly include the subjective experience method and objective simulation analysis method [42, 65]. If the group consensus level does not meet the requirement of consensus threshold (that is, ), the system may reevaluate the individual cumulative consensus contribution , and then adaptively update the weight of expert according to the value of so as to improve the consensus level of the group in the next round of consensus iteration. The ICCC-based updating method of expert weights can be described as follows.
Suppose that the weight and the ICCC degree of expert are denoted as and in the t-th iteration, respectively. Then, the weight of expert in the (t + 1)-th iteration can be adaptively updated by applying equations (34) and (35).Here, the parameter represents the influence of the contribution of the expert on his/her weight. The higher the value of the parameter , the faster the process converges to the desired consensus level. A detailed discussion of the parameter can be found in the literature [66]. So, the meaning of integrating equations (34) and (35) is to directly give greater weights to the experts with more ICCC and to punish the weights of the experts with less ICCC. That is, experts who contribute more to the group decision improve their importance while experts who are contrary to the group lose some of their weights.

5.3. Adaptive Assessment-Adjusting Model Composed of Identification and Modification Process

The assessment-adjusting process consists of two parts: (a) identification and (b) modification. In the process of identification, the experts whose evaluations are not consistent with the decision group will be identified. The identification process consists of the following three steps.

First, the set of experts that should change their opinions, which is called , are those who have the least contributions to reaching consensus.

Then, for any expert , the alternatives related to this set have the least individual consensus degree, which is denoted as as follows.

Finally, for any expert and , the following rule is used to identify the individual assessment value with a maximum distance from the group opinion. These values to be modified are denoted as which is selected as

In the process of modification, the identified experts need to adaptively modify their assessment information. Suppose that the individual assessment of expert on alternative with respect to attribute and the collective assessment are denoted as and in the t-th iteration, respectively. After using equations (36)–(38), to identify the position of individual assessment value that needs to be modified, apply equation (39) to adaptively adjust the corresponding assessment value in the (t + 1)-th iteration.where by using equation (28), “” indicates the addition operation of PLTSs [64], and the parameter denotes the adjustment coefficient.

5.4. The Proposed Adaptive CRP

In what follows, to obtain the optimal alternative accepted by the group of DMs, we put forward a novel adaptive CRP for probabilistic linguistic MAGDM. In the consensus process, we propose to combine the weight-updating model and assessment-adjusting model (called an integrated consensus improving strategy) to improve a high consensus level that is measured by applying PL-Wasserstein distance measure. If the consensus degree satisfies the condition , the decision-making process ends and the best alternative is obtained. Otherwise, the experts’ weights and assessments need to be adjusted according to the integrated consensus improving technique. The flowchart of the adaptive CRP is shown in Figure 3.

The detailed algorithm of the adaptive CRP, called Algorithm 1, is described as follows.

Input: The normalized individual PLDMs and their associated initial weights (), the incomplete attribute weight information set , the maximum number of iterations , the group consensus threshold (), and the parameters and .
Output: The terminal iteration step , the adjusted individual PLDMs () and their adjusted expert weights (), the collective PLDM , the ICCC degree (), and the group consensus degree .
Step 1: Let and , , .
Step 2: Obtain the temporary collective PLDM using equation (28).
Step 3: Determine the attribute weights () using model (M-2).
Step 4: Calculate , , and by equations (29)–(31). Determine the temporary ICCC degree and the temporary group consensus degree using equations (32) and (33), respectively. Based on the given group consensus threshold , we judge whether the consensus degree of the group is acceptable or not. If and , then go to the next step; otherwise, go to Step 7.
Step 5: Identify the position of individual assessment contributing less to reaching consensus based on equations (36)–(38) and apply equation (39) to adjust the corresponding assessment values, and then go to Step 6.
Step 6: Update experts’ weights () using equations (34) and (35). Let and go to Step 2.
Step 7: Let (), , and . Also, let , , , . Output the terminal iteration step , the modified individual PLDMs () and their associated weights (), the final attribute weights (), the final group PLDM , the ICCC degree (), and the group consensus degree .
Step 8: End.
5.5. Probabilistic Linguistic MAGDM Approach with the Novel Proposed CRP

Following the above analysis, to ensure that the group can reach a consensus in terms of the ranking of alternatives and the choice of the best alternative(s), a probabilistic linguistic MAGDM approach with the aforementioned adaptive CRP, called Algorithm 2, is proposed. We can now describe the main steps of the proposed MAGDM approach.

Step 1: identify all the alternatives to be evaluated, the assessment attributes, and the invited experts. Determine the preestablished LTS and the corresponding linguistic scale functions . Collect the linguistic evaluations from experts and then construct the individual PLDMs (), where is in the form of a PLTS.
Step 2: utilize Definition 4 and equations (21) and (22) to obtain the normalized individual PLDMs ().
Step 3: use Algorithm 1 to implement the CRP. If the CRP ends, then go to Step 4.
Step 4: based on the final attribute weight and the final group PLDM , utilize equations (8) and (9) to calculate the general expected value and the general variance value of the collective assessment value . Then, the weighted arithmetic operator is employed to obtain the weighted general expected value and the weighted general variance value of alternative (), respectively. , .
Step 5: based on the idea of the coefficient of variation [67], construct the measure index to cope with the performance of alternative , where .
Generate the ranking order of alternatives according to the increasing values, , . Select the best alternative from the set .
Step 6: end.

In the proposed MAGDM approach (Algorithm 2), Steps 1 and 2 indicate the preparation phase of consensus-driven probabilistic linguistic MAGDM discussed in this paper. Step 3 describes a new CRP, which is called an adaptive CRP with PLTSs based on PL-Wasserstein distance and an integrated consensus improving technique. The selection process is reflected in Steps 4 and 5.

6. Case Study

In this section, the proposed consensus-driven MAGDM method is applied to the evaluation of real network public opinion emergencies.

6.1. Case Background

Recently, three Internet public opinion emergencies have recently broken out in a city. Under the condition of limited rescue resources, the relevant departments must determine the priority of dealing with Internet public opinion emergencies based on the comprehensive severity of each emergency. To do this, they firstly select three different types of decision experts representing different emergency interests to form an emergency decision-making committee (i.e., government departments (), online media (), and netizens ()). The crisis assessment of network public opinion emergencies involves emergency management and information dissemination. Information amount, diffusion degree, audience tendency, and response status of online public opinion mainly affect the judgment and decision of emergency experts on the degree of comprehensive severity of each network public opinion emergency [4]. For this reason, the emergency management experts select four significant assessment criteria of public opinion crisis (i.e., the content sensitivity and form richness of Internet public opinion ; the influence and transmission of media ; the participation, attitudes and the emotional tendency of netizens ; and the emergency capability of governments ). Each emergency expert separately evaluates the above three network public opinion emergencies under the above four criteria. The LTSs used on the first three criteria are  = { = very low,  = low, = slightly low,  = medium,  = slightly high,  = high,  = very high}, and LTS for the fourth criterion is  = { = very weak,  = weak,  = slightly weak,  = medium,  = slightly strong,  = strong,  = very strong}. The decision maker recorded the linguistic evaluation information of the experts on each emergency under each indicator. The collected linguistic assessment values that are provided by all the experts with the same interest group are, respectively, stored in the form of a data table expressed by a PLDM, where each data unit is a PLTS. Furthermore, the data unit can also imply the missing partial information of some experts, that is, the sum of probabilities of linguistic terms in each PLTS can be less than 1. The original PLDMs, provided by three different types of decision experts, are shown in Tables 13, respectively. The problem we need to solve is how to obtain the consensus ranking of the above Internet public opinion crisis rating and thus to select the most severe one that needs to be prioritized under the premise of ensuring the consensus reaching within the group of experts.

6.2. Decision-Making Process

The method proposed in this paper used the following steps.Step 1: as Step 1 is given above, we start our computation from Step 2.Step 2: by Definition 4 and equations (21) and (22), we obtain the following normalized individual PLDMs ().Step 3: we select the linguistic scale function shown as equation (4) for criteria and and the linguistic scale function shown as equation (5) for criteria and with the two parameters . Suppose that the initial weight of each expert is the same (i.e., ). The incomplete attribute weight information set , the maximum number of iterations , the group consensus threshold , and the two parameters , . Subsequently, we conduct the proposed adaptive CRP by Algorithm 1. The main procedure of the adaptive CRP is as follows.Substep 1: let ; we have , , .Substep 2: using equation (28), we obtain the temporary collective PLDM.Substep 3: solving model (M-2), we obtain the following attribute weights:Substep 4: by equations (29)–(31), we calculate , , and , , . Detailed results are shown in Tables 46.Using equation (32), we calculate the temporary ICCC degree: , , and . Using equation (33), we get the temporary group consensus degree . Since and , then go to Substep 5.Substep 5: based on equations (36)–(38), we have , , and . So, we identify the individual assessment that needs to be adjusted, namely, the assessment of expert on emergency with respect to attribute . Meanwhile, by equation (39) and the addition operation of PLTSs “” [64], we adjust the assessment value as follows:Substep 6: using equations (34) and (35), we update experts’ weights as follows:Let and go to Substep 2.After five rounds of consensus iterations (i.e., ), we have the group consensus level . It shows that the adaptive CRP procedure (Algorithm 1) ends. So, the terminal iteration step . Let (), , and . Also, let , , , .Then, the final expert weights are , , and . The final attribute weights are , , , and . The final ICCC degree is , , and . The final group consensus degree is . The final individual PLDMs () are , , andThe individual assessments that are adaptively corrected in sequence include , , , , and in the iterative process.The final group PLDM areSince the CRP ends, then go to the following selection process.Step 4: utilizing equations (8) and (9), we obtain the general expected value matrix:and the general variance value matrix:Then, using Algorithm 2, we get the weighted general expected value of emergency ():and the weighted general variance value of emergency ():Step 5: according to Algorithm 2, the performances of emergency () areAll the emergencies ( ()) are then ranked according to their performance values to get , where the symbol “” means “superior to.” Therefore, we conclude that the emergency decision-making committee , consisting of government departments (), online media (), and netizens (), reaches a consensus that the emergency was the most severe Internet public opinion crisis that needs to be prioritized.Step 6: end.

6.3. Comparative Analyses

To illustrate the effectiveness and advantages of the proposed approach, two other PLTSs-based MAGDM methods are applied to solving the case in Section 6.1.

6.3.1. Comparison with Aggregation-Based Probabilistic Linguistic MAGDM Method

The first MAGDM method without consideration of CRPs is denoted as Method 2. Specific steps are as follows.Steps 1 and 2: employ Steps 1-2 of the probabilistic linguistic MAGDM approach with the novel proposed CRP (i.e., Algorithm 2) to obtain the normalized individual PLDMs ().Step 3: supposing that the weight of each expert is the same, get the collective PLDM by equation (28).Step 4: solving model (M-2), obtain the attribute weights ().Step 5: based on , utilize Algorithm 2 to obtain the weighted general expected value () and the weighted general variance value () of alternative , respectively.Step 6: determine the performance values () of alternative by Algorithm 2 and then rank all the alternatives according to the values of ().

For the case in this paper, using Method 2, we obtain the collective PLDM as follows:

Solving model (M-2), we have the attribute weights: , , , and . Then, we get the weighted general expected value (), the weighted general variance value (), and the performance value () of emergency as follows:

Since , then . Thus, the most severe Internet public opinion crisis that needs to be prioritized is .

The ranking of Internet public opinion crisis rating obtained by the proposed consensus-driven MAGDM method is consistent with that by Method 2, which verifies the effectiveness of the proposed method in this paper. However, we obtain different performance values of emergencies by different methods. Additionally, we can find that the deviation of performance values between any two emergencies derived by the proposed method is smaller than the one derived by Method 2. The main reason for the difference lies in the fact that the selection process is performed directly in Method 2 without consideration of CRP. Therefore, the solution by the presented MAGDM method is more acceptable for each expert in the group than that by Method 2, illustrating that the presented GDM method is more scientific and democratic by forming the overall satisfaction of the group.

6.3.2. Comparison with the PLTSs-Based MAGDM Method Involving the Only Consensus Improving Technique of Weight-Updating

The second MAGDM method is expressed as Method 3 in which the weight-updating-based CRP (denoted as Algorithm 3) is only integrated into the consensus-driven MAGDM, and the only difference between Algorithms 1 and 3 is no consideration of Step 5 of Algorithm 1 in Algorithm 3. That is, in Algorithm 3, we use the weight-updating technique instead of the integrated consensus improving technique to promote consensus reaching. The main thread of Method 3 is listed below.

Steps 1 and 2: the same as Algorithm 2 (i.e., the probabilistic linguistic MAGDM approach with the novel CRP).
Step 3: use Algorithm 3 to implement the consensus process. If the CRP ends, then go to Step 4.
Steps 4–6: the same as Algorithm 2.

Method 3 is applied to solving the case in this paper. To facilitate the comparison of the different methods, it is assumed that all the parameters involved are the same as the decision process in Section 6.2. After 21 rounds of consensus iteration, we obtain  =  = , which shows the CRP is terminated. We obtain the final attribute weights: , , , and . Also, we get the final expert weights: , , and . So, the final group PLDM can be obtained as follows:

Then, we get the weighted general expected value (), the weighted general variance value (), and the performance value () of emergency as follows:

Since , then the consensus ranking is , which implies that is the most severe Internet public opinion crisis. The consensus ranking is consistent with the one derived by Algorithm 2 while there is a slight difference in the performance values of each emergency obtained by two different consensus improving procedures (i.e., Algorithms 1 and 3). The group consensus level with the adaptive updating of expert weights by the above different consensus improving strategies is shown in Figures 4 and 5, respectively. By comparing Figures 4 with 5, the common feature of the two consensus improving processes can be concluded that the same acceptable group consensus degree (i.e., a consensus threshold established a priori) is achieved by punishing the weight of the expert with less ICCC and rewarding the weight of the experts and . However, the number of consensus iterations using Algorithm 3 is extremely larger than the one using Algorithm 1, which shows that the consensus improving algorithm proposed in this paper is better in terms of consensus efficiency. The main reason is that the adaptive assessment-adjusting model in Section 5.3 is a useful supplement to the rapid achievement of group consensus.

7. Concluding Remarks

To build consensus in probabilistic linguistic MAGDM with PLDMs, this paper proposed an adaptive consensus reaching model with an integrated improving strategy based on PL-Wasserstein distance. Compared to the existing consensus reaching models with PLDMs, the proposed model has the following advantages. (a) By applying the PL-Wasserstein distance, the group consensus degree and the ICCC degree, two key indicators of conducting the adaptive CRP, can be accurately measured. (b) The presented CRP is an adaptive CRP that can not only reduce the reliance on the moderator but also eliminate the subjective influence of the moderator in CRP. (c) The integrated consensus improving strategy which considers both weight-updating (i.e., dynamic weights of experts and attributes) and assessment-adjusting is employed to greatly improve the consensus efficiency of MAGDM. Especially for emergency MAGDM problems, this treatment can be very beneficial for rapid emergency response.

Meanwhile, we find the following limitations of the paper, which need to be overcome in future research. (a) Different people have different understandings regarding the same word, which is characterized by personalized individual semantics (PIS) [68, 69]. However, we failed to consider PIS of each expert in constructing the consensus model for MAGDM with probabilistic linguistic assessment information. (b) Moreover, the psychological behaviors (such as regret and disappointment [70], bounded confidence [71], and overconfidence [72]) of emergency experts are often implicit in the crisis evaluation of the online public opinion. However, we did not integrate the behavior of decision makers into the construction of the consensus model. Thus, for evaluating the network public opinion emergencies, we argue that there are two interesting research paths for the future. (a) Consensus issues should be investigated in the PIS-based emergency MAGDM framework. (b) Decision makers’ behaviors ought to be considered when designing consensus-driven emergency MAGDM approaches.

Data Availability

The data used to support the findings of this study are included within this article. They are also available from the corresponding author upon request.

Conflicts of Interest

The authors declare that there are no conflicts of interest regarding the publication of this paper.

Acknowledgments

This study was supported by the Humanities and Social Sciences Foundation of Ministry of Education of China (nos. 18YJC630249 and 16YJC630077), the National Natural Science Foundation of China (nos. 72074001, 71601002, and 71704001), the China Postdoctoral Science Foundation (no. 2019M660411), the Anhui Provincial Natural Science Foundation (no. 1708085MG168), and the Provincial Humanities and Social Science Research Project of Anhui Colleges (no. SK2018A0605).