Back to Journals » Clinical Interventions in Aging » Volume 17

Development and Validation of a Prediction Rule for Major Adverse Cardiac and Cerebrovascular Events in High-Risk Myocardial Infarction Patients After Primary Percutaneous Coronary Intervention

Authors Zhao X, Liu C, Zhou P, Sheng Z, Li J, Zhou J, Chen R , Wang Y, Chen Y, Song L, Zhao H, Yan H 

Received 17 January 2022

Accepted for publication 6 June 2022

Published 18 July 2022 Volume 2022:17 Pages 1099—1111

DOI https://doi.org/10.2147/CIA.S358761

Checked for plagiarism Yes

Review by Single anonymous peer review

Peer reviewer comments 2

Editor who approved publication: Dr Maddalena Illario



Xiaoxiao Zhao,1 Chen Liu,1 Peng Zhou,1 Zhaoxue Sheng,1 Jiannan Li,1 Jinying Zhou,1 Runzhen Chen,1 Ying Wang,1 Yi Chen,1 Li Song,1 Hanjun Zhao,1 Hongbing Yan2

1Department of Cardiology, Fuwai Hospital, National Center for Cardiovascular Diseases, Peking Union Medical College & Chinese Academy of Medical Sciences, BeiJing, People’s Republic of China; 2Fuwai Hospital, Chinese Academy of Medical Sciences, Shenzhen, People’s Republic of China

Correspondence: Hongbing Yan, Fuwai Hospital, Chinese Academy of Medical Sciences, 12 Langshan Road, Shenzhen, 518000, People’s Republic of China, Tel +86-13701339287, Email [email protected] Hanjun Zhao, Department of Cardiology, Fuwai Hospital, Chinese Academy of Medical Sciences, No. 167, Beijing, 100037, People’s Republic of China, Tel +86-15210020808, Email [email protected]

Background and Aims: We aimed to develop a clinical prediction tool to improve the prognosis of major adverse cardiac and cerebrovascular events (MACCE) among high-risk myocardial infarction (MI) patients undergoing primary percutaneous coronary intervention (PCI).
Methods: The present study was a prospective and observational study. A total of 4151 consecutive MI patients who underwent primary PCI at Fuwai Hospital in Beijing, China (January 2010 and June 2017) were enrolled. Forty-eight patients without follow-up data were excluded from the study. The pre-specified criteria (Supplementary Information 1) were chosen to enroll MI patients at high risk for MACCE complications after PCI.
Results: The full model included seven variables, with a risk score of 160 points. Derivation and validation cohort models predicting MACCE had C-statistics of 0.695 and 0.673. The area under the curve (AUC) of the survival receiver operating characteristic curve (ROC) for predicting MACCE was 0.991 and 0.883 in the derivation and validation cohorts, respectively.
Conclusion: The predicted model was internally validated and calibrated in large cohorts of patients with high-risk MI receiving primary PCI to predict MACCE and showed modest accuracy in the derivation and validation cohorts.

Keywords: primary percutaneous coronary intervention, high-risk, follow-up, risk prediction score

Introduction

Early primary percutaneous coronary intervention (PPCI) has been established as the first-line treatment for patients with acute myocardial infarction (MI).1 A randomized trial of moderate size2–7 showed a significant increase in major adverse cardio cerebral events (MACCE) post PPCI. Indeed, residual atherothrombotic risk remains substantial in high-risk patients and lesion subsets, including those older than 65 years, with renal dysfunction, diabetes mellitus (DM), thrombotic target lesions, and multi-vessel disease. The Framingham Heart Study investigators have developed various cardiovascular disease risk prediction models that identify high-risk patients more precisely than the conventional classification. It is beneficial and effective that pretreatment risk factors to reduce the risk of cardiovascular disease in patients who are evaluated as being high-risk with multivariable prediction equations than treating patients with high levels of single risk factors.8 However, few tools have been provided to assess the incidence of MACCE among high-risk MI patients undergoing PPCI to guide long-term risk management. Using these specific data elements, a new risk score was created, with which we sought to 1) define major independent predictors of MACCE among high-risk MI patients post PPCI and 2) develop and validate a full pre-procedure risk prediction model that can be adapted to individuals based on precision medicine and healthcare decisions. We present the following article in accordance with the TRIPOD reporting check. The main purpose of predictive models is to support medical decision-making. Therefore, it is important to determine the target population of the predictive models to develop and validate a representative database. At the same time, the target population must be clearly described to evaluate or validate the model performance and identify the target for its proper usage. Including these variables minimizes the risk of being unduly penalized for hospitals that disproportionately care for patients with these high-risk characteristics. Ultimately, this model could improve long-term treatment safety at centers with higher than expected risk-adjusted MACCE rates. Therefore, we consider it necessary to establish a predicting model for identifying high-risk patients.

Materials and Methods

Study Population – Enrollment and Randomization

This observational, prospective cohort study analyzed data from Fuwai Hospital, National Center for Cardiovascular Diseases, Peking Union Medical College, and the Chinese Academy of Medical Sciences. In total, 4151 consecutive MI patients who underwent PPCI at Fuwai Hospital, Beijing, China, between January 2010 and June 2017 were selected for inclusion. Forty-eight patients without follow-up data were excluded from this study. For enrollment in the study, patients were required to meet at least one of the clinical inclusion criteria and one of the angiographic inclusion criteria, but not none of the exclusion criteria, as shown in Figure 1. The clinical criteria were as follows: 1) adult patients ≥65 years of age; 2) female sex; 3) documented peripheral artery disease (PAD) or coronary artery disease (CAD)/PAD revascularization; 4) diabetes mellitus; 5) chronic kidney disease; and 6) troponin positivity. The angiographic inclusion criteria were 1) multivessel coronary artery disease; 2) target lesion requiring a total stent length >30 mm; 3) thrombotic target lesion; 4) bifurcation lesions; 5) left main (≥50%) or proximal left anterior descending (LAD) (≥70%) lesion; and 6) calcified target lesion. These prespecified criteria were selected to enroll patients with MI at a high risk for MACCE complications after PPCI. Elements are included in validated risk scores for ischemia, bleeding, or both types of complications after PPCI.10–18 R software was used to divide the derivation and validation cohorts randomly and proportionally (70%:30%). All patients were referred to the coronary catheterization center with a diagnosis of MI fulfilling the criteria for PPCI according to guidelines.19,20 The study was approved by the Ethics Committee of Fuwai Hospital, and all enrolled patients provided written informed consent for coronary angiography and PPCI. Patient records, including demographics, medical history, physical examination, blood test results, electrocardiography (ECG), echocardiography data, and discharge medication regimens, were reviewed. The primary endpoints were identified and extracted from recordings of hospital, clinical notes, laboratory report in the event of MACCE by physicians who in charge of follow-up blinded to the clinical and laboratory information via telephone enquiry and health records which get permission from the Review Board of Fuwai Hospital. Blood testing was performed at the clinical laboratory of Fuwai Hospital. The experimental protocols and the process for obtaining informed consent were approved by the appropriate ethics review committee of Fuwai Hospital. This study conformed to the principles outlined in the Declaration of Helsinki. Informed written consent was obtained from the patients prior to the inclusion.

Figure 1 Study sample selection flow diagram.

Definitions and Primary Outcome

The primary outcome of this analysis was MACCE, which was defined as the composite of all-cause death, recurrent MI, stroke (including ischemic stroke and hemorrhagic stroke), heart failure, or target-vessel revascularization. Hypertension was defined as blood pressure ≥140/90 mmHg on three occasions at rest or a previous diagnosis of hypertension and current use of antihypertensive drugs. DM was defined according to the 75-g oral glucose tolerance test (OGTT), and patients were diagnosed with DM if they met one of the following criteria: (i) a fasting plasma glucose level of ≥7.0 mmol/L, (ii) a 2-h value of ≥11.1 mmol/L in the 75-g OGTT, and (iii) a casual plasma glucose level of ≥11.1 mmol/L. Dyslipidemia, guided by the 2019 ESC/EAS Guidelines9 for the management of dyslipidemia, was defined as a lipid profile consisting of the following abnormalities either singly or in combination: A triglyceride level ≥150 mg/dL, low-density lipoprotein cholesterol level ≥100 mg/dL, total cholesterol level ≥200 mg/dL, and high-density lipoprotein cholesterol level <40 mg/dL. Height and weight were measured by trained medical staff, and body mass index was calculated as weight (kg)/height squared (m2). The no-reflow phenomenon was defined as thrombolysis in MI (TIMI) flow grade <3 after PPCI. Stroke was defined by the World Health Organization (WHO) Multinational Monitoring of Trends and Determinants in Cardiovascular Diseases (MONICA) standards, as a rapidly developing focal or general brain dysfunction that lasts for more than 24 h or causes death, excluding non-vascular causes (such as trauma, metabolic disorders, tumors, and any neurological abnormalities caused by CNS infection). According to the imaging examination in the first week of onset, the neurologist-diagnosed stroke included subarachnoid hemorrhage, intracranial hemorrhage, cerebral thrombosis, and cerebral embolism; hemorrhagic stroke included subarachnoid and intracranial hemorrhages; and ischemic stroke included cerebral thrombosis and embolism. Transient ischemic attack (TIA) and chronic cerebrovascular diseases were not included. The outcomes of this study included initial stroke only. Investigators collected data, including head CT and head MRI, and hospital records from patients during their hospitalization.

Statistical Analysis

The normal distribution of outcome variables was confirmed using the Kolmogorov–Smirnov test. Categorical variables are summarized as frequencies (percentages) and were compared using Pearson’s chi-squared tests. Continuous variables are presented as medians and were compared using an independent t-test. The characteristics of the derivation and validation cohorts are shown in Table 1. The study population was randomly split into a development sample consisting of 70% admissions and a validation sample consisting of the remaining 30% admissions. The baseline patient characteristics and variables from coronary angiography and diagnostic catheterization were considered candidate variables and were prespecified. Candidate variables had <1.8% missing data, except for the use of Intra-aortic balloon pump (IABP) (27%), apolipoprotein A (29.2%), and uric acid (12.6%). To account for missing values in baseline serum IABP (27%) and ApoA (29.2%), covariates for each model were identified in an iterative process that multiple imputation with automated variable selection. Five imputations were generated from the original dataset, and using multivariate normal regression was used to substitute missing values for IABP and ApoA within each impute in the first step.

Table 1 The Characteristics of Derivation Cohort and Validation Cohort

The variables included in the least absolute shrinkage and selection operator (LASSO) regression are shown in Supplementary Table 1 and are used to screen the independent variables to draw the corresponding nomogram model (Supplementary Model 1). LASSO selects variables for sample data based on the penalty method. By compressing the original coefficients, the originally small coefficients are directly compressed to 0, so that the corresponding variables of these coefficients are regarded as non-significant variables and the non-significant variables are directly discarded.

We developed a predicting model using all potential predictive variables selected by LASSO regression. We also developed a risk prediction score by taking the regression coefficients from the pre-procedure model and assigning them an integer weighted associated with the risk factors. The corresponding nomogram model is drawn according to the regression coefficient of the selected independent variables. For the variables selected in the nomogram model, the values of different variables can correspond to different scores on the integral line at the top of the nomogram (the score range is 0–160 points) through the projection of the vertical line, and the total score can be obtained by adding up the scores corresponding to the values of each variable. The cumulative occurrence probability of MACCE events in 3 and 5 years can be obtained from the total score on the prediction line at the bottom of the nomogram.

In order to reduce the over-fitting bias, the self-sampling method is used to verify the nomogram model. The Harrell’s C-statistic was used to compare discrimination between derivation cohort and validation cohort including 3-year and 5-year. Calibration plots were used to access goodness of fit. We draw the survival receiver operator characteristic curve (survival ROC curve) by R language. Survival ROC curves export the best cut-off values and divided into low-risk group and high-risk group by R language. We conducted the K-M survival analysis between two groups and export the discrepancy result of the analysis. The subgroup of the K-M curves included the all-caused death, recurrence MI and stroke during 3 and 5 years. The cox regression analysis was performed using the survival package. Furthermore, due to the number of cases are sufficient, we conducted the k-fold cross validation in order to optimize the model and find the superparameter value which makes the model generalization performance optimal.

Standard statistical metrics of model and discrimination performance (R2, Harrell’s C statistic) were calculated. The calibration and discrimination performance of equations developed in the derivation sub-cohort was assessed in the validation sub-cohort and compared with the performance of models developed in the entire cohort; baseline survival functions and hazard ratios were also compared. Indicators of internal verification include c-index and calibration degree, which, respectively, represent the prediction accuracy and prediction consistency of the nomogram prediction model. The degree of calibration is represented by a calibration graph. Decision Tree is a learning technique of machine for data classification in a fixed set of classes and has been explored systematically with success in many classification problems. Supposing that data from variant calling have various features of ease-discretization, decision trees turn into an outstanding deterministic model for information search. The present work aims to classify variants in establishing the predicting model among high-risk population. In this work, we describe a decision tree modeling to improve the accuracy of the risk factor identification process. We expect that this procedure can be used to support the screening of identified risk factors. The technique of decision tree is based on a hierarchical structure of “if-then” rules which produce bifurcations and promote a tree shape. The classification consists of traverse a tree through its edges from the root and executes a test over variable.

The main software used for statistical analysis in this study used survival and rms package in R language version I 386 3.6.3. Other analyses were performed using SPSS version 20.0 (IBM Corp., Armonk, NY, United States). All p-values were two-tailed, and statistical significance was set at p < 0.05.

Results

Patient Demographics of Derivation and Validation Cohort

Between January 1, 2010, and June 30, 2017, 4151 men and women underwent PPCI at Fuwai Hospital. Of these, 48 people were excluded from the study. After applying the inclusion criteria, 3404 high-risk MI patients were included. Meeting at least one clinical and at least one angiographic criteria to be eligible were enrolled in the study. There were 578 high-risk MI subjects that had MACCE events in derivation cohort after undergoing PPCI procedures, yielding a MACCE event rate of 24.24%. Of these events, 25.09% were all-caused death; whereas 14.09% were detected due to recurrence MI, 60.07% by revascularization, 3.99% by heart failure, 8.15% by ischemic stroke and 1.39% were hemorrhagic stroke. The mean follow-up duration was 3 years. Patients must have met at least one clinical and at least one angiographic criterion to be eligible for treatment in the study. The derivation and validation cohorts comprised 2384 and 1020 patients, respectively, which were used in these analyses by random allocation (Figure 1). Candidate variables had <1.8% missing data, except for the use of IABP (27%), apolipoprotein A (29.2%), and uric acid (12.6%). Table 1 displays the baseline patient, procedural, and hospital characteristics of the development and validation samples.

Screening Risk Factors for MACCE by the LASSO Method

Baseline patient characteristics and variables from coronary angiography and diagnostic catheterization were considered candidate variables and were all prespecified (Supplementary Table 1). These variables were filtered using the LASSO regression method, and the filtering and cross-validation processes for the independent variables are shown in Figure 2A1 and A2, respectively. Lambda.1se is the lambda value of the optimal efficiency model within the standard error range, which provides a model with excellent performance.

Figure 2 The establishment procedure of the model. (A1 and A2) Least absolute shrinkage and selection operator (LASSO) regression. The filtering and cross-validation processes of independent variables are shown in (A1 and A2) respectively. Lambda.1se is the lambda value of the optimal efficiency model in the standard error range which gives a model with excellent performance. (B) Forest plot by using the multivariable COX regression; HR, hazard ratio; CABG, coronary artery bypass grafting. (C) Decision tree flow diagram. The binary decision diagram of the variables was shown in (C and D) the risk score nomogram. The score, ranging from 0 to 160, assigned points as follows: for patients younger than 40 years, 100 points; for age 40 to younger than 50 years, 80 points; for age 50 to younger than 60 years, 60 points; for age 60 to younger than 70 years, 40 points; for age 70 to younger than 80 years, 20 points; for patients 80 years or older,0; for Killip II, 7.68; for Killip III, 15.36; for Killip IV, 23.03; for EF at admissio≦50%, 4.62; for previous history of CABG, 20; for in-stent restenosis, 4.81; for stent thrombosis, 9.62; for without complete revascularization, 3.45; for multi-vessel lesion, 18. Age group, 1 stand for age less than 40 years/ 2 stand for age range from 40 to 50 years/ 3 stand for age range from 50 to 60 years/4 stand for age range from 60 to 70 years/ 5 stand for age range from 70 to 80 years/ 6 age stand for age more than 80 years. Killip classification, 1= Killip I, 2= Killip II, 3= Killip III, 4=Killip IV. EF, 0 stands for >50%, 1 stands for less than 50%. History of CABG, 1=with, 0=without; type of lesion, 1= De novo lesion, 2=restenosis, 3= stent thrombosis; complete revascularization, 0=without, 1=with; multivessel disease, 1=with, 0=without. Histogram refers to the score distribution in the derivation cohort. For the variables selected in the nomogram model, the values of different variables can correspond to different scores on the integral line at the top of the nomogram (the score range is 0–160 points) through the projection of the vertical line, and the total score can be obtained by adding up the scores corresponding to the values of each variable. The cumulative occurrence probability of MACCE in 30 days, 3 year, 5 year and 7 years can be obtained from the total score on the prediction line at the bottom of the nomogram. (E) Elements of clinical prediction score and distribution of score among high-risk MI patients who underwent PPCI. (E) The left side has shown the clinical prediction score variable and corresponding points. The right side has shown the graph of distribution of the clinical prediction score.

Establishment of the Risk Prediction Model

Seven independent variables (age subgroup, Killip classification, ejection fraction, history of coronary artery bypass grafting (CABG), type of lesions, complete revascularization at admission, and multi-vessel disease of the coronary artery) were included in the predictive model. The forest plot of the variables obtained by the multivariate Cox regression is shown in Figure 2B, and the binary decision diagram of the variables is shown in Figure 2C. Multivariate Cox regression by full model from observed data is shown in Supplementary Table 2 and Supplementary Model 1. Furthermore, multivariate Cox regression by stepwise selected model from observed data is shown in Supplementary Table 3 and Supplementary Model 2. ROC curve analysis and optimal threshold analysis of prediction model are shown in Supplementary Table 4.

It is necessary to convert the classification variables into factorization and then use the as.matrix () function to convert the data from the non-matrix format to the matrix format before the R language “glmet” package can call the data. According to the nomogram model (Figure 2D), the score predicting project included seven variables as predictive factor variables.

Clinical Prediction Score

A simplified risk score was generated to predict MACCE events. The scores, ranging from 0 to 160, were as follows: for patients <40 years, 100 points; for age 40 to <50 years, 80 points; for age 50 to <60 years, 60 points; for age 60 to <70 years, 40 points; for age 70 to <80 years, 20 points; for patients 80 years or older, 0; for Killip II, 7.68; for Killip III, 15.36; for Killip IV, 23.03; for ejection fraction (EF) at admission ≤50%, 4.62; for previous history of CABG, 20; for in-stent restenosis, 4.81; for stent thrombosis, 9.62; for without complete revascularization, 3.45; and for multivessel lesion, 18 (Figure 2E). The elements of the clinical prediction score and distribution of scores among high-risk MI patients who underwent PPCI are shown in Figure 2E.

Performance of the Risk Score Model

The MACCE risk prediction model had good discrimination in both the development and validation samples (c-index, development sample 0.695; validation sample 0.673). The calibration plot for the full model is shown in Figure 3A–D. There was high concordance between the risk predicted by the models and observed MACCE events. Calibration was indicated by the estimated risk of survival from Kaplan–Meier analysis, in which the gray line represents perfect calibration. Figure 3E and F shows survival (time-dependent) receiver operating characteristic (ROC) curves for the discriminatory value of the 3- and 5-year evaluation performance of the risk prediction model. The cut-off points of the 3- and 5-year survival ROC curves were 0.22663 and 0.09733, respectively, and the area under the curve (AUC) was 0.991 and 0.931, respectively. The cut-off points of the 3- and 5-year survival ROC curves were –0.35597 and –0.35597, and the AUCs were 0.883 and 0.883 in the validation cohort, respectively. We have drawn the ROC curves of the Grace risk score model among the derivation cohort (N = 2384) in the Supplement Figure 2 as follows. The AUC of the Grace risk score model is 0.672. Furthermore, we have the drawn the ROC curves of the new established model in the manuscript and the AUC was 0.767. The AUC of the new model is larger than the grace score model, which showed excellent performance and indicated that the risk score was helpful for discrimination in the clinical prediction models. Supplementary Figure 1A–D shows the decision curve analysis of the 3- and 5-year survival in the derivation and validation cohorts.

Figure 3 The internal validation of the model. (AD) Risk score calibration in the derivation cohort and the internal validation cohort; the stroke events risk score of 3-year (A) 5-year (B) in the derivation cohort and 3-year (C) 5-year (D) in the validation cohort. Calibration is shown as the estimated risk against survival from Kaplan- Meier analysis. Gray line=perfect calibration. (E) showed the survival ROC curve of derivation cohort (AUC=0.767, p<0.001). (F) showed the survival ROC curve of validation cohort (AUC=0.696, p<0.001). AUC, area under the curve; ROC, survival receiver operating characteristic; TP, true positive; FP, false positive.

Survival ROC curves export the best cut-off values and are divided into relatively low-risk and high-risk groups using R language. We conducted Kaplan–Meier survival analysis (Figure 4A–D) and exported the discrepancy results. In the group predicting MACCE, the two groups displayed significant differences in both the derivation cohort (p < 0.001) and validation cohort (p < 0.001), as shown in Figure 4A–D. In the subgroup predicting all-cause death, there was a remarkable difference (p < 0.001) between the high-risk and relatively low-risk groups in both the development and validation groups (Supplementary Figure 3A–D). Furthermore, when the endpoint was recurrent MI, the log-rank p-value was <0.02 in the 3-year derivation cohort and <0.01 in the 5-year Kaplan–Meier curve in the derivation cohort (Supplementary Figure 3E–H). We also found distinct discrepancies in predicting stroke events (p < 0.05) (Supplementary Figure 3I–L) in the 3- and 5-year development and validation cohorts. Supplementary Figure 4 has shown the one-fold cross validation and the AUC was 0.744 and the confidence interval was 0.645–0.789. Furthermore, we took a 10-fold cross validation. First, we divided the data into ten parts, and then we took the first data set as the training set. Finally, the fitting model is obtained and the ten-fold cross validation was 0.670.

Figure 4 K-M survival analysis; in the group of predicting MACCE events, the two groups displayed significant difference in both derivation cohort (p<0.001) and validation cohort (p<0.001) shown in (AD).

Discussion

This study developed a clinical prediction score based on clinical and coronary angiography indices to predict the incidence of long-term MACCE among patients with high-risk MI who underwent PPCI. The MACCE prediction risk model had good discrimination in both the development and validation samples (c-index, validation sample 0.673; development sample 0.695). For patients who were divided into the relatively low-risk group and the high-risk group by the best cut-off values in the prediction model study (derivation cohort), the relatively high-risk group had a significantly greater likelihood of occurrence of all-cause death, recurrence of MI, heart failure, ischemic stroke, hemorrhagic stroke, and revascularization compared to the low-risk group. These results suggest that it may be possible to identify patients with a discordant incidence of MACCE. Although the prediction score is expected to be applied to the patients represented by the enrollment criteria, inconsistency in evaluating treatment risks and benefits and adjusting treatment according to personal data provides opportunities for further optimization of the results to maximize benefits and reduce harm. However, few equivalent scores are available for use in high-risk patients with acute MI undergoing PPCI. For these patients, cardiac imaging, coronary angiography, and advanced biomarkers are routinely available at admission; therefore, it is convenient to include them in a score for this setting for long-term management.

Many patient characteristics are correlated with the long-term incidence of MACCE. Many of the predictive elements that we identified have been previously shown to be predictive of MACCE events. For instance, age is consistently associated with an increased risk of MACCE incidence,21 as are other variables, such as Killip classification, EF at admission, history of CABG, and multi-vessel lesions of the coronary artery.22 In addition to these factors, we also identified unique variables not present in other predictive models, such as complete revascularization and the type of lesion detected by coronary angiography. The addition of such forecasting factors is noteworthy as the acuity of clinical presentation is generally not as severe as that of previous models that merely include clinical characteristics. It is important to minimize the risk of inappropriate care and management of patients with MI with high-risk characteristics who undergo PPCI by including these factors. Bleeding complications, including hemorrhagic stroke after PPCI, are common and are correlated with an increased short- and long-term risk of mortality.23,24 The use of vascular closure devices, bivalirudin, and the radial approach, known as bleeding avoidance strategies, has been proposed to reduce hemorrhage among higher-risk patients.25–28 Therefore, this model can be used to predict the long-term incidence of MACCE in high-risk MI patients post-PCI, identify leaders and laggards, and ultimately improve the long-term prognosis of PPCI by making healthcare decisions during follow-up and encouraging the adoption of corresponding measures at admission.

According to the present model, the score predicting model included seven variables of predictive factors, including age, Killip classification, ejection fraction, history of CABG, type of lesions, complete revascularization at admission, and multi-vessel disease of the coronary artery. Previous analyses29,30 have also shown that risk factors, including age, atrial fibrillation, female sex, Killip classification, and chronic disease, can predict the incidence of stroke within 12-months of PPCI, which is generally in accordance with classic risk variables in the general population. Stroke, including ischemic and hemorrhagic, is a devastating complication with high MACE and mortality rates following PPCI. Similarly, a database derived from the British Cardiovascular Intervention Society (BCIS) reported that ischemic stroke was independently associated with both 30-day mortality and in-hospital MACE after adjusting for baseline clinical and procedural demographics.31 Previously, Luke et al32 demonstrated that the incidence of stroke among outpatients following PPCI is higher in younger patients than in the general population. This is coincident with our score projection that age <40 years contributed to greater weight compared to other age groups. Furthermore, at the beginning of the cardiac catheterization period (1970–1980s), the incidence of cerebrovascular events ranged from 0.03% to 0.06%33 compared to 0.18–0.44% during the following years. The increased incidence of stroke-complicating PPCI might account for the extended use of PCI and coronary angiography, especially among patients with severe vascular calcification.34 The time of risk assessment post-event and cardiovascular disease are the main factors to evaluate the performance of the risk score for secondary prevention. CALIBER35 enrolled 102,023 patients with stable CAD and developed a risk score to identify patients at high-risk assist with management decisions.

The reason for using relatively old data from 2010 to 2017 was due to the duration of funding. Based on the national Polish PCI registry database,36 the study has enrolled 132,686 patients in high-volume interventional cardiology centers in the National Registry of Drug Eluting Stents (NRDES) Registry from October 2010 to October 2011 in Poland. The results showed a large selection bias for Drug Eluting stents with regard to angiographic and demographic characteristics in ACS. The implantation of drug-eluting stents was linked to ischemic outcomes similar to those of bare metal stents at the 1-year follow-up. In the present study, PPCI was performed via the radial or femoral access. Thrombus aspiration was performed to reduce thrombus burden and restore antegrade coronary flow. However, the proportion of radial and femoral access surgeries was not counted and the radial experience of the operator was not evaluated. In a previous study37, 539 invasive cardiologists from 151 invasive cardiology centers in Poland were included. The results suggested that the highest-proficiency operators in radial access were correlated with a higher risk of periprocedural stroke, mortality, and other complications at the access site during angiography via femoral access. In both stable and acute situations, sufficient experience and utilization of radial access are associated with adverse outcomes of PCIs performed via the femoral artery. The time of the procedure in the present study included on- and off-hours. A previous study38 demonstrated a higher rate of periprocedural mortality for PCIs performed during off-hours among 99,783 cohorts. They found that more professional and sufficiently trained operators performed PPCI during regular work hours compared to off-hours. Furthermore, the influence of fatigue and reduced operator experience among invasive interventions should be considered. Thus, the confounding factors of the procedure time should be controlled for in further investigations. A previous study39 suggested that the radial approach was associated with lower periprocedural mortality than the femoral approach in 3565 consecutive patients with MI. The radial approach appears to be a worthwhile option in technical situations. Furthermore, some comprehensive insights into the real-world clinical practice of MI were provided in this study. Radial professional and experienced operators may be critical in decreasing the number of periprocedural complications. The literature40 drew the conclusion that a reduction in the risk of periprocedural mortality was observed in greater experienced radial operators.

Study Limitation

Several limitations of our study should be considered when interpreting the results. Based on the clinical and angiographic inclusion and exclusion criteria of the trial, as well as the single-center study design, the score project of the model should be interpreted with the understanding that patients enrolled in clinical trials may not be completely representative of those cared for in the routine practice of PPCI. Therefore, the analysis should be regarded as exploratory despite the predetermination of the score variables, and the predictive score should be used with circumspection until further external validation has been performed. Optimal and suitable long-term management of the procedure and care should be administered independently of the patient’s score to reduce overall MACCE. Furthermore, the extent and severity of granular measures of atherosclerosis were unavailable, and the situation of receiving ticagrelor or other antiplatelet combinations may, in part, affect the discrimination of the cohort and have a different risk–benefit relationship.41 Finally, cerebrovascular events were determined by contacting the participants, followed by validation through medical records. Although it is likely to cover almost all hemorrhagic and ischemic strokes, stroke incidence may be underestimated if the patients are asymptomatic and not admitted to hospital.

Conclusion

In summary, we developed a risk prediction model for estimating the long-term (3- and 5-year) incidence of MACCE based on clinical parameters and indices of coronary angiography, which were suitable for high-risk patients with MI who underwent PPCI. The scoring can be implemented alongside further medical investigations to support therapeutic decision-making. This model requires further prospective assessment to evaluate the potential impacts on patient management, as well as external validation in other cohorts.

Data Sharing Statement

The datasets used and/or analyzed during this study are available from the corresponding authors on reasonable request.

Ethics Approval

It is from the ethics committee of the department of Cardiology, Fuwai Hospital, National Center for Cardiovascular Diseases, Peking Union Medical College, China.

Consent for Publication

Written informed consent for publication was obtained from all participants.

Acknowledgments

The authors gratefully acknowledge all individuals who participated in this study.

Author Contributions

All authors made a significant contribution to the work reported, whether that is in the conception, study design, execution, acquisition of data, analysis and interpretation, or in all these areas; took part in drafting, revising or critically reviewing the article; gave final approval of the version to be published; have agreed on the journal to which the article has been submitted; and agree to be accountable for all aspects of the work.

Funding

This study was supported by the Chinese Academy of Medical Sciences Innovation Fund for Medical Sciences (2016-I2M-1–009), National Natural Science Funds (number: 81970308), the Fund of “Sanming” Project of Medicine in Shenzhen (number: SZSM201911017) and Shenzhen Key Medical Discipline Construction Fund (number: SZXK001).

Disclosure

The authors report no conflicts of interest in this work.

References

1. Ibanez B, James S, Agewall S, et al. 2017 ESC Guidelines for the management of acute myocardial infarction in patients presenting with ST-segment elevation: the task force for the management of acute myocardial infarction in patients presenting with ST-segment elevation of the European Society of Cardiology (ESC). Eur Heart J. 2018;39:119–77.

2. Head SJ, Milojevic M, Daemen J, et al. Stroke rates following surgical versus percutaneous coronary revascularization. J Am Coll Cardiol. 2018;72(4):386–398. doi:10.1016/j.jacc.2018.04.071

3. Vlaar PJ, Svilaas T, van der Horst IC, et al. Cardiac death and reinfarction after 1 year in the thrombus aspiration during percutaneous coronary intervention in acute myocardial infarction Study (TAPAS): a 1-year follow-up study. Lancet. 2008;371(9628):1915–1920. doi:10.1016/S0140-6736(08)60833-8

4. Steg PG, James SK, Atar D, et al. ESC Guidelines for the management of acute myocardial infarction in patients presenting with ST-segment elevation. Eur Heart J. 2012;33:2569–2619.

5. Kinnaird T, Johnson T, Anderson R, et al. Intravascular imaging and 12-month mortality after unprotected left main stem PCI: an analysis from the British cardiovascular intervention society database. JACC Cardiovasc Interv. 2020;13(3):346–357. doi:10.1016/j.jcin.2019.10.007

6. Kontsevaya AV, Bates K, Schirmer H, et al. Management of patients with acute ST-segment elevation myocardial infarction in Russian hospitals adheres to international guidelines. Open Heart. 2020;7(1):e001134. doi:10.1136/openhrt-2019-001134

7. Takeuchi M, Ogita M, Wada H, et al. Comparison of long-term mortality between living alone patients vs. living together patients with acute coronary syndrome treated with percutaneous coronary intervention. Eur Heart J Qual Care Clin Outcomes. 2020;6(4):332–337.

8. Mihaylova B, Emberson J, Blackwell L, et al. The effects of lowering LDL cholesterol with statin therapy in people at low risk of vascular disease: meta-analysis of individual data from 27 randomised trials. Lancet. 2012;380:581–590.

9. Mach F, Baigent C, Catapano AL, et al. 2019 ESC/EAS Guidelines for the management of dyslipidaemias: lipid modification to reduce cardiovascular risk. Eur Heart J. 2020;41(1):111–188.

10. Kang S-H, Park KH, Ahn H-S, et al. Everolimus-eluting versus sirolimus-eluting coronary stents in patients with and without diabetes mellitus. EuroIntervention. 2014;10(1):74–82. doi:10.4244/EIJV10I1A13

11. Brar SS, Kim J, Brar SK, et al. Long-term outcomes by clopidogrel duration and stent type in a diabetic population with de novo coronary artery lesions. J Am Coll Cardiol. 2008;51(23):2220–2227. doi:10.1016/j.jacc.2008.01.063

12. Baber U, Bander J, Karajgikar R, et al. Combined and independent impact of diabetes mellitus and chronic kidney disease on residual platelet reactivity. Thromb Haemost. 2013;110(1):118–123. doi:10.1160/TH13-01-0004

13. Baber U, Mehran R, Kirtane AJ, et al. Prevalence and impact of high platelet reactivity in chronic kidney disease: results from the assessment of dual antiplatelet therapy with drug-eluting stents registry. Circ Cardiovasc Interv. 2015;8(6):e001683. doi:10.1161/CIRCINTERVENTIONS.115.001683

14. Angiolillo DJ, Bernardo E, Capodanno D, et al. Impact of chronic kidney disease on platelet function profiles in diabetes mellitus patients with coronary artery disease taking dual antiplatelet therapy. J Am Coll Cardiol. 2010;55(11):1139–1146. doi:10.1016/j.jacc.2009.10.043

15. Morrow DA. Cardiovascular risk prediction in patients with stable and unstable coronary heart disease. Circulation. 2010;121(24):2681–2691. doi:10.1161/CIRCULATIONAHA.109.852749

16. Danga GD, Claessen BE, Mehran R, et al. Development and validation of a stent thrombosis risk score in patients with acute coronary syndromes. JACC Cardiovasc Interv. 2012;5(11):1097–1105. doi:10.1016/j.jcin.2012.07.012

17. Rao SV, McCoy LA, Spertus JA, et al. An updated bleeding model to predict the risk of post-procedure bleeding among patients undergoing percutaneous coronary intervention: a report using an expanded bleeding definition from the National Cardiovascular Data Registry CathPCI Registry. JACC Cardiovasc Interv. 2013;6(9):897–904. doi:10.1016/j.jcin.2013.04.016

18. Mehran R, Baber U, Sharma SK, et al. Ticagrelor with or without aspirin in high-risk patients after PCI. N Engl J Med. 2019;381(21):2032–2042. doi:10.1056/NEJMoa1908419

19. Steg PG, James SK, Atar D, et al. ESC guidelines for the management of acute myocardial infarction in patients presenting with ST-segment elevation. Eur Heart J. 2012;33(20):2569–2619. doi:10.1093/eurheartj/ehs215

20. O’Gara PT, Kushner FG, Ascheim DD, et al. 2013 ACCF/AHA guideline for the management of ST-elevation myocardial infarction: executive summary: a report of the American College of Cardiology Foundation/American Heart Association task force on practice guidelines. Circulation. 2013;127(4):529–555. doi:10.1161/CIR.0b013e3182742c84

21. Zhang C, Jiang L, Lianjun X, et al. Implications of N-terminal pro-B-type natriuretic peptide in patients with three-vessel disease. Eur Heart J. 2019;40(41):3397–3405. doi:10.1093/eurheartj/ehz394

22. Tan C, Luo E, Wang D, et al. Usefulness of haemoglobin level combined with CAMI-STEMI score for predicting MACCE in patients with acute ST-elevation myocardial infarction after PCI. Biomed Res Int. 2019;2019(8):1–8.

23. Doyle BJ, Rihal CS, Gastineau DA, et al. Bleeding, blood transfusion, and increased mortality after percutaneous coronary intervention: implications for contemporary practice. J Am Coll Cardiol. 2009;53:2019–2027.

24. Rao SV, Kaul PR, Liao L, et al. Association between bleeding, blood transfusion, and costs among patients with non-ST-segment elevation acute coronary syndromes. Am Heart J. 2008;155(2):369–374. doi:10.1016/j.ahj.2007.10.014

25. Sherev DA, Shaw RE, Brent BN. Angiographic predictors of femoral access site complications: implication for planned percutaneous coronary intervention. Catheter Cardiovasc Interv. 2005;65(2):196–202. doi:10.1002/ccd.20354

26. Kirtane AJ, Piazza G, Murphy SA, et al. Correlates of bleeding events among moderate- to high-risk patients undergoing percutaneous coronary intervention and treated with eptifibatide: observations from the PROTECT-TIMI-30 trial. J Am Coll Cardiol. 2006;47:2374–2379. doi:10.1016/j.jacc.2005.09.080

27. Verheugt FWA, Steinhubl SR, Hamon M, et al. Incidence, prognostic impact, and influence of antithrombotic therapy on access and nonaccess site bleeding in percutaneous coronary intervention. J Am Coll Cardiol Intv. 2011;4:191–197. doi:10.1016/j.jcin.2010.10.011

28. Rao SV, Ou F-S, Wang TY, et al. Trends in the prevalence and outcomes of radial and femoral approaches to percutaneous coronary intervention: a report from the national cardiovascular data registry. J Am Coll Cardiol Intv. 2008;1:379–386. doi:10.1016/j.jcin.2008.05.007

29. Benjamin EJ, Blaha MJ, Chiuve SE, et al. Heart disease and stroke statistics-2017 update: a report from the American Heart Association. Circulation. 2017;135:e146–e603. doi:10.1161/CIR.0000000000000485

30. Martin JO, Chin SL, Rangarajan S, et al. Global and regional effects of potentially modifiable risk factors associated with acute stroke in 32 countries (interstroke): a case-control study. Lancet. 2016;388:761–775. doi:10.1016/S0140-6736(16)30506-2

31. Kwok CS, Kontopanteli E, Myint PK, et al. Stroke following percutaneous coronary intervention: type-specific incidence, outcomes and determinants seen by the British Cardiovascular Intervention Society 2007–12. Eur Heart J. 2015;36:1618–1628. doi:10.1093/eurheartj/ehv113

32. Dawson LP, Cole JA, Lancefield TF, et al. Lancefield Incidence and risk factors for stroke following percutaneous coronary intervention. Int J Stroke. 2020;15(8):1–14.

33. Bredlau CE, Roubin GS, Leimgruber PP, et al. In-hospital morbidity and mortality in patients undergoing elective coronary angioplasty. Circulation. 1985;72:1044–1052. doi:10.1161/01.CIR.72.5.1044

34. Hoffman SJ, Routledge HC, Lennon RJ, et al. Procedural factors associated with percutaneous coronary intervention-related ischemic stroke.JACC. Cardiovasc Interv. 2012;5:200–206.

35. Rapsomaniki E, Shah A, Perel P, et al. Prognostic models for stable coronary artery disease based on electronic health record cohort of 102 023 patients. Eur Heart J. 2014;35(13):844–852. doi:10.1093/eurheartj/eht533

36. Siudak Z, Dziewierz A, Rakowski T, et al. Borderline trend towards long-term mortality benefit from drug eluting stents implantation in ST-elevation myocardial infarction patients in Poland-data from NRDES registry. Catheter Cardiovasc Interv. 2014;83(3):436–442. doi:10.1002/ccd.25169

37. okarek T, Dziewierz A, Plens K, et al. Radial approach expertise and clinical outcomes of percutanous coronary interventions performed using femoral approach. J Clin Med. 2019;8(9):1484. doi:10.3390/jcm8091484

38. Tokarek T, Dziewierz A, Plens K, et al. Percutaneous coronary intervention during on- and off-hours in patients with ST-segment elevation myocardial infarction. Hellenic J Cardiol. 2021;62(3):212–218. doi:10.1016/j.hjc.2021.01.011

39. Tokarek T, Dziewierz A, Plens K, et al. Radial approach reduces mortality in patients with ST-segment elevation myocardial infarction and cardiogenic shock. Pol Arch Intern Med. 2021;131(5):421–428.

40. Dziewierz A, Siudak Z, Tokarek T, et al. Determinants of stroke following percutaneous coronary intervention in acute myocardial infarction (from ORPKI Polish National Registry). Int J Cardiol. 2016;15(223):236–238. doi:10.1016/j.ijcard.2016.08.214

41. Yeh RW, Secemsky EA, Kereiakes DJ, et al. Development and validation of a prediction rule for benefit and harm of dual antiplatelet therapy beyond 1 year after percutaneous coronary intervention. JAMA. 2016;315(16):1735–1749. doi:10.1001/jama.2016.3775

Creative Commons License © 2022 The Author(s). This work is published and licensed by Dove Medical Press Limited. The full terms of this license are available at https://www.dovepress.com/terms.php and incorporate the Creative Commons Attribution - Non Commercial (unported, v3.0) License. By accessing the work you hereby accept the Terms. Non-commercial uses of the work are permitted without any further permission from Dove Medical Press Limited, provided the work is properly attributed. For permission for commercial use of this work, please see paragraphs 4.2 and 5 of our Terms.