Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

Artificial neural network-based models used for predicting 28- and 90-day mortality of patients with hepatitis B-associated acute-on-chronic liver failure

BMC Gastroenterology volume 20, Article number: 75 (2020) Cite this article

Abstract

Background

This study aimed to develop prognostic models for predicting 28- and 90-day mortality rates of hepatitis B virus (HBV)-associated acute-on-chronic liver failure (HBV-ACLF) through artificial neural network (ANN) systems.

Methods

Six hundred and eight-four cases of consecutive HBV-ACLF patients were retrospectively reviewed. Four hundred and twenty-three cases were used for training and constructing ANN models, and the remaining 261 cases were for validating the established models. Predictors associated with mortality were determined by univariate analysis and were then included in ANN models for predicting prognosis of mortality. The receiver operating characteristic curve analysis was used to evaluate the predictive performance of the ANN models in comparison with various current prognostic models.

Results

Variables with statistically significant difference or important clinical characteristics were input in the ANN training process, and eight independent risk factors, including age, hepatic encephalopathy, serum sodium, prothrombin activity, γ-glutamyltransferase, hepatitis B e antigen, alkaline phosphatase and total bilirubin, were eventually used to establish ANN models. For 28-day mortality in the training cohort, the model’s predictive accuracy (AUR 0.948, 95% CI 0.925–0.970) was significantly higher than that of the Model for End-stage Liver Disease (MELD), MELD-sodium (MELD-Na), Chronic Liver Failure-ACLF (CLIF-ACLF), and Child-Turcotte-Pugh (CTP) (all p < 0.001). In the validation cohorts the predictive accuracy of ANN model (AUR 0.748, 95% CI: 0.673–0.822) was significantly higher than that of MELD (p = 0.0099) and insignificantly higher than that of MELD-Na, CTP and CLIF-ACLF (p > 0.05). For 90-day mortality in the training cohort, the model’s predictive accuracy (AUR 0.913, 95% CI 0.887–0.938) was significantly higher than that of MELD, MELD-Na, CTP and CLIF-ACLF (all p < 0.001). In the validation cohorts, the prediction accuracy of the ANN model (AUR 0.754, 95% CI: 0.697–0.812 was significantly higher than that of MELD (p = 0.019) and insignificantly higher than MELD-Na, CTP and CLIF-ACLF (p > 0.05).

Conclusions

The established ANN models can more accurately predict short-term mortality risk in patients with HBV- ACLF.

The main content has been postered as an abstract at the AASLD Hepatology Conference (https://doi.org/10.1002/hep.30257).

Peer Review reports

Background

Hepatitis B virus (HBV) infects approximate 240 million people worldwide and particularly 93 million in China [1, 2]. HBV has become one of the leading causes for acute-on-chronic liver failure (ACLF), mainly characterized as a rapid deterioration of liver function with a high short-term mortality [3]. In China, HBV-associated ACLF (HBV-ACLF) accounts for more than 80% of the whole ACLF cases and would cause a high mortality rate (60–80%) if left without effective treatment (e.g. transplantation) [4]. Liver transplantation is currently the most effective therapeutic option for HBV-ACLF. However, due to shortage of liver donors and some socioeconomic problems, liver transplantation is limited in clinics [5]. To decrease mortality of HBV-ACLF, it is vital to accurately identify patients with poor prognosis so as to take treatment as early, including prior organ allocation from limited liver donors.

At present, there have actually no ideal models to predict short-term outcomes of patients with HBV-ACLF yet. Model of end-stage liver disease (MELD) and the modified type--MELD integrating sodium (MELD-Na)--have been gradually proposed [6,7,8] to predict prognosis of patients with ACLF, with moderate accuracy [9]. However, due to limited predictive accuracy, these scoring systems are still unsatisfactory [9, 10]. More accurate prognostic models are urgent.

It is important to combine more kinds of important parameters to construct models to predict short-term mortality of ACLF. The artificial neural networks (ANNs), structurally and functionally mimic biological neural systems, have been widely using to manage nonlinear complex biological systems. For example, ANN models have been used to predict post-hepatectomy survival of early hepatocellular carcinoma [11], in-hospital mortality of type 2 diabetes after major lower extremity amputation [12], neuroblastoma patients’ outcome [13], and cardiac complications following posterior lumbar spine fusion [14]. It has been revealed that the ANN models are more accurate than multiple logistic regression and multiple linear discriminant analysis models [15, 16]. In this study, we established ANN-based models to predict 28- and 90- day mortality of HBV-ACLF.

Methods

Patient characteristics

From January 2008 to May 2016, a total of 2532 cases of patients with chronic HBV (CHB)-ACLF who were hospitalized for an acute deterioration of liver function at the Beijing Ditan Hospital, Capital Medical University (Beijing, China), First Hospital Affiliated to Hunan University of Chinese Medicine (Changsha, China), First Affiliated Hospital of Guangxi University of Chinese Medicine (Nanning, China), Affiliated Hospital of Shandong University of Traditional Chinese Medicine (Jinan, China), Beijing 302 Hospital (Beijing, China), Renmin Hospital Hospital of Wuhan University (Wuhan, China), Hubei Provincial Hospital of Traditional Chinese Medicine (Wuhan, China), and Xiamen Hospital of Traditional Chinese Medicine (Xiamen, China) were retrospective reviewed. All the above hospital were tertiary hospitals in China. Patients’ inclusion criteria were: 1) patients were diagnosed with HBV-ACLF, 2) patients received standard medical management (except liver transplantation), including absolute bed rest, energy and vitamin supplement, maintenance water, intravenous infusions of albumin, electrolyte and acid-base correction, and prevention and management of complications, 3) patients received antiviral therapy (i.e. administration of lamivudine, adefovir dipivoxil, entecavir, telbivudine and tenofovir) based on the HBV replication levels, and the financial condition and willingness of patients, and 4) patients were followed up from their diagnosis until either the end of the 28- or 90-day follow-up period or their death in hospital. Patients who had: 1) hepatocellular carcinoma or other liver malignancy, 2) other organ malignancies that might influence treatment outcomes, 3) infection of hepatitis A, C, D, or E virus, 4) other virus infection (such as cytomegalovirus and human immunodeficiency virus co-infection), 5) autoimmune liver disease, 6) liver decompensated cirrhosis, or 7) severe chronic extrahepatic diseases (such as cardiovascular diseases, diabetes, kidney diseases), were excluded. Patients who were pregnancy or failed to meet the Asia Pacific Association for the Study of the Liver (APASL) criteria for ACLF were also excluded. Eventually, 684 cases of patients who were diagnosed with HBV-ACLF at the admission day or within 90 days after admission were analyzed; 423 of them from the Beijing Ditan Hospital were used for training and constructing ANN-based models and the remaining 261 from other hospitals were for validating the established models. All the involved centers were tertiary hospitals, with reliable treatment conditions and levels. In addition, if there was any difference in the units, presentation meas, etc. of parameters among different hospitals, they would be uniformly transformed. All these could make data measured in different hospitals comparable.

To validate the constructed models, 261 cases, including 103 from the First Hospital Affiliated to Hunan University of Chinese Medicine, 42 from the First Affiliated Hospital of Guangxi University of Chinese Medicine, 14 from the Affiliated Hospital of Shandong University of Traditional Chinese Medicine, 30 from the Beijing 302 Hospital, 32 from the Renmin Hospital of Wuhan University, 25 from the Hubei Provincial Hospital of Traditional Chinese Medicine, and 15 from Xiamen Hospital of Traditional Chinese Medicine, were retrospectively reviewed. The study protocol was in accordance with the ethical guidelines of the Declaration of Helsinki, and was approved by the ethics committees of the above hospitals.

Diagnosis

CHB was determined as the detection of hepatitis B surface antigen for over 6 months [17]. Cirrhosis was diagnosed on the basis of previous liver biopsy examinations or the following combined parameters [18, 19], including: 1) ultrasonography, computed tomography, and magnetic resonance imaging characteristics of a small liver with or without splenomegaly/ascites; 2) an aspartate aminotransferase (AST)-platelet ratio index score > 2; and 3) an albumin level < 35 g·L− 1, without other definite reasons of hypoalbuminemia, such as renal and gastrointestinal loss. Organ failure was defined according to the CLIF-COF score [20], including liver failure with total bilirubin (TBIL) ≥ 12 mg·dL− 1, renal failure with creatinine ≥2 mg·dL− 1 or a requirement of renal support therapy, cerebral failure with hepatic encephalopathy (HE) grade III/IV, coagulation failure with an international normalized ratio (INR) ≥ 2.5, circulatory failure with a requirement of vasoconstrictors for maintenance of arterial pressure, and respiratory failure with SpO2/FiO2 ≤ 214 or PaO2/FiO2 ≤ 200.

ACLF was defined on the basis the APASL criteria as follows (3): 1) acute hepatic damage manifesting as jaundice, TBIL ≥5 mg·dL− 1 (85 μM) and coagulopathy, 2) with INR ≥ 1.5 or prothrombin activity (PTA) < 40%, 3) complicated with clinical ascites and/or HE within 4 weeks in patients who were previously diagnosed or undiagnosed chronic liver disease. Chronic Liver Failure-ACLF (CLIF-ACLF), MELD, MELD-Na, and Child-Turcotte-Pugh (CTP) scores were calculated on the basis of previously published criteria, respectively. All scores and definitions were applied upon the enrollment in this study.

Data collection

Patients’ demographics, laboratory parameters, clinical variables (HBV reactivation, bacterial infection, gastrointestinal hemorrhage, hepatotoxic drugs, active alcoholism, and surgery), complications (HE, hepatorenal syndrome, hyponatremia, and spontaneous bacterial peritonitis), and organ (liver, renal, brain, coagulation, circulatory, and respiratory) failure were collected from patients’ medical records and the hospitals’ databases upon the HBV-ACLF diagnosis and during hospitalization. Four scoring systems related to clinical prognosis, including MELD, MELD-Na, CLIF-ACLF and CTP scores, were assessed at baseline. Patients receiving liver transplantation were taken as lost to follow-up, and mortality rate was estimated as transplant-free rate. Mortality at 28 and 90 days after enrollment was confirmed from patients’ medical records or through direct contact with their families, and mortality rates were thus calculated accordingly.

Construction of ANN

ANN comprises highly complicated and interconnected processing units (neurones) related to weighted connections, with an input, an output, and one or more hidden layers [21,22,23,24]. The advantages of ANN include self-learning, self-adapting and inference processes. By learning from examples, ANN connect each input with the corresponding output through changing the weight of the connections within neurones. When applied, an input will be propagated from the first layer of neurones via each upper layer till an output is generated, followed by a self-adapting process. The value of the produced output is compared with that of the desired one. If there is a discrepancy between these two values, an error signal will then be produced and accordingly, a back propagation (BP) method should be used to modify the weight of the interneurone connections to reduce the total error of the network. During the learning process, the error between the values of the produced and desired outputs is decreasing until a minimum is reached (i.e. convergence of the network). Thereafter, inference process is performed, where the outputs (prognosis) can be produced from new input data on the basis of the knowledge accumulated during training process. Therefore, the ANN can accurately carry out predictions on data sets [21,22,23,24].

In this study, 28- and 90-day mortality in the 423 HBV-ACLF input layers contained neurones that imported the data available, including various clinical, demographic and laboratory data, and the output layers comprised neurones that exported the corresponding predictive outcomes. The hidden layers were applied to make complicated interactions between the input and output neurones. Variables significantly associated with prognosis of HBV-ACLF patients were included to construct ANNs by using Mathematica 11.1.1 for Microsoft windows (64-bit) (April 18, 2017), a graphical neural network development tool. Six hundred and eight-four eligible patients were allocated to a training cohort (n = 423, 61.8%) or validation cohort (n = 261, 38.2%).

The learning process of this ANN was carried out by BP through assessing the errors between the values of the generated and desired outputs. The interneurone connections was adjusted the weight to reduce the overall errors of the network. Learning (training) would be stopped if the total of square errors reached minimum in comparison with the cross-validation data set. Eventually, the final form provided the 28- and 90-day mortality risks in each patient.

Statistical analysis

All statistical analysis were conducted by using SPSS software (Version 19.0, IBM, Armonk, NY, USA). The Kolmogorov-Smirnov test was used to evaluate whether the sample data was normally distributed. Patients were assigned to survivor and non-survivor groups, respectively at 28 and 90 days during the follow-up. For continuous variables, data were presented as mean ± standard deviation or median with interquartile range, and were analyzed with the Student’s t-test or Mann-Whitney U test between survivor and non-survivor groups. For categorical variables, data were presented as frequencies or percentages, and were then compared between groups as appropriate using the Pearson chi-square or Fisher’s exact test. After the association of the demographic, biochemical and clinical variables (inputs) with prognosis (outputs) was determined, the variables with statistically significant difference or important clinical characteristics were selected as the input layers to construct ANNs for prediction of 28- and 90-day mortality of patients with HBV-ACLF. Odds ratio (OR) and the corresponding 95% confidence interval (95% CI) were determined.

Prediction performances of the ANN models both in the training and validation cohorts were assessed by receiver operating characteristic curve (ROC) analysis, respectively, where area under the ROC curve (AUR) was applied to compare the ANN’s prediction performance with that of MELD, MELD-Na, CTP and CLIF-ACLF, respectively using Mann-Whitney U test. p < 0.05 was considered statistical difference.

Results

Baseline characteristics of patients

Six hundred and eight-four cases of patients diagnosed with HBV-ACLF were eventually reviewed in the study, with a mean age of 43.9 ± 11.7 years and a male proportion of 85.1%. The basic characteristics, biochemical parameters and some scoring systems (such as MELD) of patients were shown in Table 1. One hundred and seventy-five patients (25.6%) died during a 28-day follow-up and 251 patients (36.7%) died during a 90-day follow-up. The mean MELD, MELD-Na, CTP and CLIF-ACLF scores of the total study population were 22.9 (20.0, 26.5), 22.3 (18.1, 28.0), 11 (10, 12), and 38.6 ± 8.1, respectively.

Table 1 Basic clinical characteristics of patients with HBV- ACLF
Full size table

Construction of ANN models

Patients were assigned to survivor and non-survivor groups, respectively at 28 and 90 days during the follow-up. PTA (OR = 0.908, 95% CI: 0.891–0.926, p < 0.001), TBIL (OR = 1.003, 95% CI: 1.002–1.004, p < 0.001), age (OR = 1.037, 95% CI: 1.022–1.053, p < 0.001), serum sodium (OR = 0.923, 95% CI: 0.892–0.955, p < 0.001), alkaline phosphatase (ALP) (OR = 0.995, 95% CI: 0.991–0.999, p = 0.009), gamma-glutamyl transpeptidase (GGT) (OR = 0.996, 95% CI: 0.993–0.999, p = 0.006), HE (OR = 5.623, 95% CI: 2.358–10.891, p < 0.001) and hepatitis B e antigen (HBeAg) positive rate (OR = 0.616, 95% CI: 0.429–0.884, p = 0.009) were significantly associated with 28-day mortality (Table 2). All these variables were included to build an ANN model.

Table 2 Univariate analysis of 28- and 90-day mortality of patients with HBV- ACLF
Full size table

In addition, PTA (OR = 0.922, 95% CI: 0.907–0.937, p < 0.001), TBIL (OR = 1.003, 95% CI: 1.003–1.004, p < 0.001), age (OR = 1.040, 95% CI: 1.026–1.054, p < 0.001), sodium (OR = 1.379, 95% CI: 1.113–1.708, p = 0.003), ALP (OR = 0.997, 95% CI: 0.993–1.000, p = 0.034), GGT (OR = 0.997, 95% CI: 0.994–0.999, p = 0.005), HE (OR = 2.235, 95% CI: 1.883–4.837, p < 0.001) and HBeAg positive rate (OR = 1.005, 95% CI: 1.003–1.006, p < 0.001) were significantly associated with 90-day mortality. Similarly, these variables were also included to build an ANN model.

As one of the most recognized ANN architectures, multilayer perceptron (MLP) including the input, output and hidden layers were used to establish ANN models. Neurones were shown linkage with weighted connections (Figs. 1 and 2). Generally, the numbers of input and output variables were respectively consistent with those of demographic, biochemical and clinical parameters and those of the set prognosis. As shown in Figs. 1 and 2, the MLP comprises eight input neurones and one output neurone. Following many times of debugging and testing, two hidden neurones were included in the hidden layers in order to increase the performance of MLP. The ANN models for 28- and 90-day mortality of HBV-ACLF patients were shown in Figs. 1 and 2, respectively.

Fig. 1
figure 1

An ANN model for predicting 28-day mortality of patients with HBV-ACLF

Full size image
Fig. 2
figure 2

An ANN model for predicting 90-day mortality of patients with HBV-ACLF

Full size image

Evaluation of the predictive accuracy of ANN models for 28- and 90-day mortality of HBV-ACLF

For 28-day mortality in the training cohort, the ANN model’s predictive accuracy (AUR 0.948, 95% CI 0.925–0.970) was significantly higher than that of MELD (AUR 0.777, 95% CI: 0.735–0.820, p < 0.001), MELD-Na (AUR 0.758, 95% CI: 0.711–0.805, p < 0.001), CTP (AUR 0.697, 95% CI: 0.650–0.744, P < 0.001), and CLIF-ACLF (AUR 0.813, 95% CI: 0.772–0.853, p < 0.001) (Fig. 3a). In the validation cohorts, the AUR of ANN model for 28-day mortality was 0.748 (95% CI: 0.673–0.822), which was still higher than that of MELD (AUR 0.619, 95% CI: 0.536–0.701, p = 0.0099), MELD-Na (AUR 0.720, 95% CI: 0.642–0.799, p = 0.424), CTP (AUR 0.713, 95% CI: 0.634–0.792, p = 0.303), and CLIF-ACLF (AUR 0.696, 95% CI: 0.615–0.777, p = 0.2004) (Fig. 3b).

Fig. 3
figure 3

ROC analysis of MELD, MELD-Na, CTP, CILF-ACLF, and the constructed ANN model to predict 28-day mortality of HBV-ACLF in the (a) training and (b) validation cohorts, respectively

Full size image

For 90-day mortality in the training cohort, the ANN model’s prediction accuracy (AUR 0.913, 95% CI 0.887–0.938) was significantly higher than that of MELD (AUR 0.765, 95% CI: 0.726–0.805, p < 0.001), MELD-Na (AUR 0.775, 95% CI: 0.733–0.817, p < 0.001), CTP (AUR 0.712, 95% CI: 0.669–0.755, p < 0.001), and CLIF-ACLF (AUR 0.818, 95% CI: 0.782–0.854, p < 0.001) (Fig. 4a). In the validation cohorts, the AUR of ANN model was 0.754 (95% CI: 0.697–0.812), which was still higher than that of MELD (AUR 0.626, 95% CI: 0.560–0.691, p = 0.019), MELD-Na (AUR 0.669, 95% CI: 0.604–0.733, p = 0.133), CTP (AUR 0.656, 95% CI: 0.591–0.720, P = 0.076), and CLIF-ACLF (AUR 0.632, 95% CI: 0.565–0.698, p = 0.264) (Fig. 4b).

Fig. 4
figure 4

ROC analysis of MELD, MELD-Na, CTP, CILF-ACLF, and the constructed ANN model to predict 90-day mortality of HBV-ACLF in the (a) training and (b) validation cohorts, respectively

Full size image

Discussion

MELD and other MELD-based scoring systems have been mainly using in patients with decompensated cirrhosis. However, since ACLF is different from liver cirrhosis in multiple aspects (e.g. mortality), MELD and other MELD-based scoring systems are not adequately enough to predict mortality of ACLF. In addition, compared with single factors, combination of multiple factors can be more effective in the prediction of prognosis of ACLF. Until now, there have some nomograms established to predict prognosis of ACLF. For example, Gao et al. combined neutrophil to lymphocyte ratio (NLR), HE, INR, age and TBIL to construct a prediction model for 90-day mortality of HBV-ACLF, which showed better predictive values in comparison with MELD, MELD-Na, and CTP [25]. Lei et al. proposed a formula model based on NLR, GGT, albumin, sodium and artificial liver support therapy to predict short-term mortality of HBV-ACLF [26]. Chen et al. combined age, serum sodium and MELD score to develop a prognostic nomogram to assess 3-month mortality of HBV-ACLF, which exhibited better efficacy than MELD, MELD-Na and iMELD [27]. Lin et al. developed a prognostic nomogram, on the basis of risk factors (including age, MELD and liver to abdominal area ratio), to predict 3-month mortality of HBV-ACLF, with higher prediction accuracy of 87.7% in comparison with MELD score, MELD-Na and CTP [28].

In contrast to multiple regression models combining variables significantly associated with mortality of HBV-ACLF, ANN is generally more suitable to model nonlinear complex biological systems. We first identified risk factors for mortality of HBV-ACLF. We showed significant differences in PTA, TBIL, age, serum sodium, ALP, HBeAg positivity rate, GGT and HE between the survivors and non-survivors both at 28 days and 90 days during the follow-up. It had been shown that PTA was associated with mortality of HBV-ACLF [29], and age, TBIL HE and serum sodium were also used to predict the prognosis of HBV-ACLF [7, 8, 25, 29, 30]. In addition, HBeAg negativity was shown to be significantly correlated with more severity of liver disease [31,32,33], showing a correlation of HBeAg positivity rate with better prognosis of liver disease. Our result was generally consist with those reported. Interestingly, we showed sodium and HBeAg positivity rate were negatively associated with 28-day mortality but were positively associated with 90-day mortality. There might be several reasons. First, the univariate analysis may be affected by confound factors because of interaction between variables. There should be difference in physiological status, physiological and biochemical parameters, etc. between the 28-day and 90-day mortality groups, which may cause difference in interference in the univariant analysis. As a result, parameters such as serum sodium and HBeAg positive rate may exhibit association with 28- and 90-day mortality in different way. Second, this might reflect the complexity of the prediction systems for the 28-day vs 90-day mortality.

We first carried out univariate analysis to preliminarily screen variables statistically associated with 28- and 90-day mortality of patients with HBV-ACLF. These variables with statistically significant difference or important clinical characteristics were input in the ANN training processes to select variables (a part of the variables in the training process) with contribution to significantly improve the predictive accuracy, which were eventually included in the ANN models. Those without significant contribution, such as white blood cell, INR and serum creatinine, were excluded. Therefore, only a part of the variables with statistically significant difference after univariate analysis were eventually included in the ANN models. The selection criteria of variables was to see if they could significantly increase the prediction efficacy of models. To produce more variables in the ANN training process and bring about more variables eventually including in the ANN models to get more satisfactory predictive efficacy, we performed single univariate analysis instead of extra multivariate analysis, and then directly included the variables with statistical difference into the ANN models. We thus established ANN-based models to predict the 28- and 90-day mortality of HBV-ACLF on a level of individual patients. The ANN models were trained and constructed in a large cohort of HBV-ACLF patients (n = 423) and were then validated in another independent cohort (n = 261). ROC analysis demonstrated that the ANN models had higher predictive accuracy for the 28- and 90- mortality in the training cohort compared with the MELD-based and other scoring systems, including MELD, MELD-Na, CTP and CLIF-ACLF. This may be attributable to the complicated, multidimensional and nonlinear advantages of ANN.

In this study, the prediction models were established and then cross-validated in different cohorts from different centers. This assures that the constructed models can be independently and effectively validated. With an inference process, the ANN can reduce errors caused by new data sets, as a result, the final form provided accurate prediction values of 28- and 90-day mortality risks in each patient, with higher score predicting higher risk of mortality of HBV-ACLF patients.

Until now, there has only one similar study reporting ANN-based model for predicting short-term mortality risk of HBV-ACLF [34]. In comparison with Zheng et al.’ study (402 cases in one hospital), the present study not only analyzed more (684) cases of patients but also involved more (eight) tertiary hospitals in different sites of China which may increase the statistical power and research reliability. Zheng et al. combined 6 variables including age, PTA, serum sodium, TBIL, HBeAg positive rate and hemoglobin to construct an ANN model for predicting 3-month mortality risk of HBV-ACLF, with a prediction accuracy of 86.9 and 75.5% in the training and validation cohorts, respectively [34]. In contrast, our study involved more subjects both in the training and validation cohorts, and included more (up to 8) variables (PTA, TBIL, age, NA, ALP, GGT, HE and HBeAg positive rate) to build ANN models used for predicting both 28- and 90-day mortality of HBV-ACLF, with a higher predictive accuracy of 91.3 and 81.8% for 90-day mortality in the training and validation cohorts, respectively. Establishment of ANN models are becoming popular. Generally, inclusion of more subjects, more variables, etc. may bring about more accuracy of models. In the present study we selected all the variables with statistical significance after the univariate analysis in the ANN training process to observe the predictive efficacy. We did find the eight variables, eventually included in the present ANN models, significantly increased the predictive efficacy of 28- and 90- day mortality of HBV-ACLF. The present result also supported that the more variables-based ANN models showed better predictive efficacy for mortality of HBV-ACLF than Zheng et al.’ study. In addition, we also built an ANN model used for predicting 28-day mortality risk, with a general satisfactory predictive accuracy of 94.8% in the training cohort and 74.8% in the validation cohorts, which has not been previously reported. Our ANN prediction models for mortality of HBV-ACLF can be available on line (https://zsg.github.io/ditan_zxyjh/).

The ANNs have obvious advantages in rapidly and accurately managing nonlinear complex biological systems. In the coming ‘Big Data’ era, large clinical data regarding the cases of HBV-ACLF patients can be shared from various medical centers, and enough related variables and large sample size will in turn make ANN models much more accurate to predict the prognosis of HBV-ACLF in the future.

There are some limitations in this study. First, the employed black-box solution (nonlinear mapping) in neural network models is a major drawback in determining possible internal correlations between input and output variables. Further analyses (such as sensitivity analysis) are thus needed to reveal their inference mechanism. Second, this was a retrospective study which might bring about bias in the case selection and incompletion of clinical information. Moreover, this was not a randomized study that patients in the training and validation cohorts had different mortality rates. The 28-day and 90-day mortality rates in the training cohort were significantly higher than in the validation cohort (28-day mortality 31.2% vs 16.5%, P < 0.001; 90-day mortality 40.9% vs 29.9%, p = 0.004, respectively). Generally, mortality rate in a cohort would be correlated with the prediction efficacy by models. It is thus not surprising that the prediction performance of the ANN in validation cohort is inferior to that in training cohort. Next, multicentered, prospectively designed, randomized studies involving more patients over longer follow-up period are needed to validate this result. Third, HBV infection-related factors (such as HBV-DNA level and HBeAg positive rate) were included in analysis, while some other HBV infection markers, such as HBsAg titers, were not evaluated in the present study since complete information for all patients was not available. In the future prospective study, more variables especially including more HBV markers (such as HBsAg titers) will be collected and analyzed. Fourth, multiple regression models combining several variables significantly associated with mortality of HBV-ACLF would improve the prediction efficacy of prognosis in comparison with single variables, while we did not try them. However, given the advantages of ANN models which are generally more suitable for analysis of non-linear data with much more complexity, we believe the established ANN models will be superior to other models (including multiple regression models). Next, multiple regression models and other models will be prepared to further validate the advantages of the ANN models in the prediction of 28- and 90-mortality of HBV-ACLF patients.

Conclusions

In summary, we established ANN-based models for predicting 28- and 90-day mortality of HBV-ACLF, which exhibited superiority to the conventional MELD-based and other routine scoring systems. This study might be helpful to identify HBV-ACLF patients with poor prognosis so as to take treatment as early to achieve better outcomes.

Availability of data and materials

The dataset used and analysed during the study can be available from the corresponding author on reasonable request.

Abbreviations

95% CI:

95% Confidence interval

ACLF:

Acute-on-chronic liver failure

ALP:

Alkaline phosphatase

ALT:

Alanine aminotransferase

ANN:

Artificial neural network

APASL:

Asia Pacific Association for the Study of the Liver

AST:

Aspartate aminotransferase

AUR:

Area under the ROC curve

BP:

Back propagation

CHB:

Chronic HBV

CLIF-ACLF:

Chronic Liver Failure-ACLF

CTP:

Child-Turcotte-Pugh

GGT:

Gamma-glutamyl transpeptidase

HBeAg:

Hepatitis B e antigen

HBV:

Hepatitis B virus

HBV-ACLF:

HBV-associated ACLF

HE:

Hepatic encephalopathy

INR:

International normalized ratio

MELD:

Model for End-stage Liver Disease

MELD-Na:

MELD integrating sodium

MLP:

Multilayer perceptron

NLR:

Neutrophil to lymphocyte ratio

NLR:

Neutrophil to lymphocyte ratio

NUCs:

Nucleotide analogs

OR:

Odds ratio

PTA:

Prothrombin activity

ROC:

Receiver operating characteristic curve

TBIL:

Total bilirubin

References

  1. Schweitzer A, Horn J, Mikolajczyk RT, Krause G, Ott JJ. Estimations of worldwide prevalence of chronic hepatitis B virus infection: a systematic review of data published between 1965 and 2013. Lancet. 2015;386:1546–55.

    Article  Google Scholar 

  2. Chinese Society of Hepatology, Chinese Medical Association; Chinese Society of Infectious Diseases, Chinese Medical Association, Hou JL, Lai W. The guideline of prevention and treatment for chronic hepatitis B: a 2015 update. Zhonghua Gan Zang Bing Za Zhi. 2015;23:888–905.

    Google Scholar 

  3. Sarin SK, Kumar A, Almeida JA, Chawla YK, Fan ST, Garg H, et al. Acute-on-chronic liver failure: consensus recommendations of the Asian Pacific association for the study of the liver (APASL). Hepatol Int. 2009;3:269–82.

    Article  Google Scholar 

  4. Liu Q, Liu Z, Wang T, Wang Q, Shi X, Dao W. Characteristics of acute and sub-acute liver failure in China: nomination, classification and interval. J Gastroenterol Hepatol. 2007;22:2101–6.

    Article  Google Scholar 

  5. Arulraj R, Neuberger J. Liver transplantation: filling the gap between supply and demand. Clin Med (Lond). 2011;11:194–8.

    Article  Google Scholar 

  6. Malinchoc M, Kamath PS, Gordon FD, Peine CJ, Rank J, ter Borg PC. A model to predict poor survival in patients undergoing transjugular intrahepatic portosystemic shunts. Hepatology. 2000;31:864–71.

    Article  CAS  Google Scholar 

  7. Biggins SW, Kim WR, Terrault NA, Saab S, Balan V, Schiano T, et al. Evidence-based incorporation of serum sodium concentration into MELD. Gastroenterology. 2006;130:1652–60.

    Article  Google Scholar 

  8. Luca A, Angermayr B, Bertolini G, Koenig F, Vizzini G, Ploner M, et al. An integrated MELD model including serum sodium and age improves the prediction of early mortality in patients with cirrhosis. Liver Transpl. 2007;13:1174–80.

    Article  Google Scholar 

  9. Zheng YX, Zhong X, Li YJ, Fan XG. Performance of scoring systems to predict mortality of patients with acute-on-chronic liver failure: a systematic review and meta-analysis. J Gastroenterol Hepatol. 2017;32:1668–78.

    Article  Google Scholar 

  10. Zheng MH, Shi KQ, Fan YC, Li H, Ye C, Chen QQ, et al. A model to determine 3-month mortality risk in patients with acute-on-chronic hepatitis B liver failure. Clin Gastroenterol Hepatol. 2011;9:351–356.e3.

    Article  Google Scholar 

  11. Qiao G, Li J, Huang A, Yan Z, Lau WY, Shen F. Artificial neural networking model for the prediction of post-hepatectomy survival of patients with early hepatocellular carcinoma. J Gastroenterol Hepatol. 2014;29:2014–20.

    Article  CAS  Google Scholar 

  12. Lopez-de-Andres A, Hernandez-Barrera V, Lopez R, Martin-Junco P, Jimenez-Trujillo I, Alvaro-Meca A, et al. Predictors of in-hospital mortality following major lower extremity amputations in type 2 diabetic patients using artificial neural networks. BMC Med Res Methodol. 2016;16:160.

    Article  Google Scholar 

  13. Cangelosi D, Pelassa S, Morini M, Conte M, Bosco MC, Eva A, et al. Artificial neural network classifier predicts neuroblastoma patients' outcome. BMC Bioinformatics. 2016;17(Suppl 12):347.

    Article  Google Scholar 

  14. Kim JS, Merrill RK, Arvind V, Kaji D, Pasik SD, Nwachukwu CC, et al. Examining the ability of artificial neural networks machine learning models to accurately predict complications following posterior lumbar spine fusion. Spine (Phila Pa 1976). 2018;43:853–60.

    Article  Google Scholar 

  15. Montie JE, Wei JT. Artificial neural networks for prostate carcinoma risk assessment. An overview. Cancer. 2001;91(8 Suppl):1647–52.

    Article  CAS  Google Scholar 

  16. Wang D, Wang Q, Shan F, Liu B, Lu C. Identification of the risk for liver fibrosis on CHB patients using an artificial neural network based on routine and serum markers. BMC Infect Dis. 2010;10:251.

    Article  CAS  Google Scholar 

  17. Liaw YF, Kao JH, Piratvisuth T, Chan HL, Chien RN, Liu CJ, et al. Asian-Pacific consensus statement on the management of chronic hepatitis B: a 2012 update. Hepatol Int. 2012;6:531–61.

    Article  Google Scholar 

  18. Shiha G, Sarin SK, Ibrahim AE, Omata M, Kumar A, Lesmana LA, et al. Liver fibrosis: consensus recommendations of the Asian Pacific Association for the Study of the liver (APASL). Hepatol Int. 2009;3:323–33.

    Article  Google Scholar 

  19. Wai CT, Greenson JK, Fontana RJ, Kalbfleisch JD, Marrero JA, Conjeevaram HS, et al. A simple noninvasive index can predict both significant fibrosis and cirrhosis in patients with chronic hepatitis C. Hepatology. 2003;38:518–26.

    Article  Google Scholar 

  20. Olson JC, Wendon JA, Kramer DJ, Arroyo V, Jalan R, Garcia-Tsao G, et al. Intensive care of the patient with cirrhosis. Hepatology. 2011;54:1864–72.

    Article  Google Scholar 

  21. Cross SS, Harrison RF, Kennedy RL. Introduction to neural networks. Lancet. 1995;346:1075–9.

    Article  CAS  Google Scholar 

  22. Baxt WG. Application of artificial neural networks to clinical medicine. Lancet. 1995;346:1135–8.

    Article  CAS  Google Scholar 

  23. Forsström JJ, Dalton KJ. Artificial neural networks for decision support in clinical medicine. Ann Med. 1995;27:509–17.

    Article  Google Scholar 

  24. Dayhoff JE, DeLeo JM. Artificial neural networks: opening the black box. Cancer. 2001;91(8 Suppl):1615–35.

    Article  CAS  Google Scholar 

  25. Gao F, Sun L, Ye X, Liu Y, Liu H, Geng M, et al. Development and validation of a prognostic model for acute-on-chronic hepatitis B liver failure. Eur J Gastroenterol Hepatol. 2017;29:669–78.

    Article  Google Scholar 

  26. Lei Q, Ao K, Zhang Y, Ma D, Ding D, Ke C, et al. Prognostic factors of the short-term outcomes of patients with hepatitis B virus-associated acute-on-chronic liver failure. Clinics (Sao Paulo). 2017;72:686–92.

    Article  Google Scholar 

  27. Chen RC, Wang XD, Dong JZ, Lin Z, Wu JM, Cai YJ, et al. A MELD-based nomogram for predicting 3-month mortality of patients with acute-on-chronic hepatitis B liver failure. Clin Chim Acta. 2017;468:195–200.

    Article  CAS  Google Scholar 

  28. Lin S, Chen J, Wang M, Han L, Zhang H, Dong J, et al. Prognostic nomogram for acute-on-chronic hepatitis B liver failure. Oncotarget. 2017;8:109772–82.

    PubMed  PubMed Central  Google Scholar 

  29. Liu XY, Hu JH, Wang HF. Analysis of prognostic factors for patients with acute-on-chronic liver failure. Zhonghua Gan Zang Bing Za Zhi. 2009;17:607–10.

    CAS  PubMed  Google Scholar 

  30. Cai J, Zhang M, Han T, Jiang HQ. Characteristics of infection and its impact on short-term outcome in patients with acute-on-chronic liver failure. Medicine (Baltimore). 2017;96:e8057.

    Article  Google Scholar 

  31. Chung GE, Kim W, Lee JH, Kim YJ, Yoon JH, Lee JM, et al. Negative hepatitis B envelope antigen predicts intrahepatic recurrence in hepatitis B virus-related hepatocellular carcinoma after ablation therapy. J Gastroenterol Hepatol. 2011;26:1638–45.

    Article  CAS  Google Scholar 

  32. Wong GL, Wong VW, Choi PC, Chan AW, Chim AM, Yiu KK, et al. Evaluation of alanine transaminase and hepatitis B virus DNA to predict liver cirrhosis in hepatitis B e antigen-negative chronic hepatitis B using transient elastography. Am J Gastroenterol. 2008;103:3071–81.

    Article  Google Scholar 

  33. Ke WM, Li XJ, Yu LN, Lai J, Li XH, Gao ZL, et al. Etiological investigation of fatal liver failure during the course of chronic hepatitis B in Southeast China. J Gastroenterol. 2006;41:347–51.

    Article  Google Scholar 

  34. Zheng MH, Shi KQ, Lin XF, Xiao DD, Chen LL, Liu WY, et al. A model to predict 3-month mortality risk of acute-on-chronic hepatitis B liver failure using artificial neural network. J Viral Hepat. 2013;20:248–55.

    Article  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

This study was supported by the National Natural Science Foundation of China (Nos: 81273743 and 81473641), Beijing Ditan Hospital Nosocomial Fund (No: DTQL201602), and Beijing Municipal Science and Technology Commission Programme (No. Z181100001718052). The roles of the funding bodies were data collection, analysis and interpretation.

Author information

Authors and Affiliations

  1. Center of Integrative Medicine, Beijing Ditan Hospital, Capital Medical University, Beijing, 100015, People’s Republic of China

    Yixin Hou, Fangyuan Gao, Zhiyun Yang & Xianbo Wang

  2. Department of Hepatology, The First Hospital Affiliated to Hunan University of Chinese Medicine, Changsha, Hunan, 410007, People’s Republic of China

    Qianqian Zhang & Kewei Sun

  3. Department of Hepatology, The First Affiliated Hospital of Guangxi University of Chinese Medicine, Nanning, Guangxi, 530021, People’s Republic of China

    Dewen Mao

  4. Center of Integrative Medicine, Beijing 302 Hospital, Beijing, 100039, People’s Republic of China

    Jun Li

  5. Department of Infectious Diseases, Renmin Hospital of Wuhan University, Wuhan, Hubei, 430060, People’s Republic of China

    Zuojiong Gong

  6. Department of Hepatology, Hubei Provincial Hospital of Traditional Chinese Medicine, Wuhuan, Hubei, 430061, People’s Republic of China

    Xinla Luo

  7. Department of Hepatology, Xiamen Hospital of Traditional Chinese Medicine, Xiamen, Fujian, 361009, People’s Republic of China

    Guoliang Chen

  8. Department of Hepatology, The Affiliated Hospital of Shandong University of Traditional Chinese Medicine, Jinan, Shandong, 250014, People’s Republic of China

    Yong Li

Authors
  1. Yixin Hou
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Qianqian Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Fangyuan Gao
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Dewen Mao
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jun Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Zuojiong Gong
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Xinla Luo
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Guoliang Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Yong Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Zhiyun Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Kewei Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. Xianbo Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

XW, KS and ZY designed the study and interpreted the results. YH, QZ, FG, DM, JL, ZG, XL, GC and YL collected the data and carried out analysis. All authors read and approved the final manuscript.

Corresponding authors

Correspondence to Zhiyun Yang, Kewei Sun or Xianbo Wang.

Ethics declarations

Ethics approval and consent to participate

The study protocol was in accordance with the ethical guidelines of the Declaration of Helsinki, and was approved by the etnics commettiees of the Beijing Ditan Hospital, First Hospital Affiliated to Hunan University of Chinese Medicine, First Affiliated Hospital of Guangxi University of Chinese Medicine, Affiliated Hospital of Shandong University of Traditional Chinese Medicine, Beijing 302 Hospital, Renmin Hospital Hospital of Wuhan University, Hubei Provincial Hospital of Traditional Chinese Medicine, and Xiamen Hospital of Traditional Chinese Medicine. As this study retrospectively reviewed the basic and clinical information of patients, consent to participate was waived.

Consent for publication

Not applicable.

Competing interests

The authors decalare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hou, Y., Zhang, Q., Gao, F. et al. Artificial neural network-based models used for predicting 28- and 90-day mortality of patients with hepatitis B-associated acute-on-chronic liver failure. BMC Gastroenterol 20, 75 (2020). https://doi.org/10.1186/s12876-020-01191-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12876-020-01191-5

Keywords

BMC Gastroenterology

ISSN: 1471-230X

Contact us