A Prediction Nomogram Combining Epworth Sleepiness Scale and Other Clinical Parameters to Predict Obstructive Sleep Apnea in Patients with Hypertension

Wang, Lin; Sun, Dongsheng; Xie, Jianhong; Zhang, Li; Lao, Dibo; Xu, Shaokun

doi:https://doi.org/10.1155/2022/3861905

International Journal of Hypertension

On this page

Abstract Introduction Materials and Methods Results Discussion Conclusions Data Availability Ethical Approval Conflicts of Interest Authors’ Contributions Acknowledgments References Copyright Related Articles

Research Article | Open Access

Volume 2022 | Article ID 3861905 | https://doi.org/10.1155/2022/3861905

A Prediction Nomogram Combining Epworth Sleepiness Scale and Other Clinical Parameters to Predict Obstructive Sleep Apnea in Patients with Hypertension

Lin Wang,¹Dongsheng Sun,¹Jianhong Xie,¹Li Zhang,¹Dibo Lao,¹and Shaokun Xu¹

Academic Editor: Lanfranco D Elia

Received04 Feb 2022

Revised25 Jun 2022

Accepted04 Jul 2022

Published05 Aug 2022

Abstract

Background. Obstructive sleep apnea (OSA) is common in patients with hypertension. Nonetheless, OSA is underdiagnosed despite considerable evidence of the association between OSA and adverse health outcomes. This study developed and validated a clinical nomogram to predict OSA in patients with hypertension based on the Epworth Sleepiness Scale (ESS) score and OSA-related parameters. Methods. A total of 347 hypertensive patients with suspected OSA were retrospectively enrolled and randomly assigned to a training set and a validation set at 70 : 30 (N = 242/N = 105) ratio. OSA was diagnosed through sleep monitoring and was defined as an apnea-hypopnea index ≥5 events/h. Using the least absolute shrinkage and selection operator regression model, we identified potential predictors of OSA and constructed a nomogram model in the training set. The predictive performance of the nomogram was assessed and validated by discrimination and calibration. The nomogram was also compared with ESS scores according to decision curve analysis (DCA), integrated discrimination index (IDI), and net reclassification index (NRI). Results. ESS scores, body mass index, neck circumference, snoring, and observed apnea predicted OSA are considered. The nomogram showed similar discrimination between the training set (AUC: 0.799, 95% CI: 0.743–0.847) and validation set (AUC: 0.766, 95% CI: 0.673–0.843) and good calibration in the training () and validation () sets. Compared with the predictive value of the ESS, the nomogram was clinically useful and significantly improved reclassification accuracy (NRI: 0.552, 95% CI: 0.282–0.822, ; IDI: 0.088, 95% CI: 0.045–0.133, ) at a probability threshold of >42%. Conclusions. We developed a novel OSA prediction nomogram based on ESS scores and OSA-related parameters. This nomogram may help improve clinical decision-making, especially in communities and primary clinics, where polysomnography is unavailable.

1. Introduction

Obstructive sleep apnea (OSA) is the most common sleep-disordered breathing (SDB), with a prevalence of 2%–26% in adults [1–3]. OSA increases the risk of hypertension [4] and cardiovascular [5], cerebrovascular [6], and metabolic diseases [7, 8]. In this respect, approximately 30% of patients with primary hypertension and up to 80% of patients with drug-resistant hypertension have OSA [9]. Additionally, OSA increases the risk of hypertension-related morbidities [9]. The prevalence of hypertension is positively correlated with OSA severity [10]. The coexistence and worsening of OSA and hypertension increase the risk of adverse health outcomes [11]. Thus, the early diagnosis and treatment of OSA in patients with hypertension are crucial.

At present, polysomnography (PSG) and portable monitoring (PM) are the gold standards for diagnosing OSA [12, 13]. However, these diagnostic methods are expensive and complex, and their availability is limited. In addition, the waiting time for diagnosis and treatment is long [14]. Late diagnosis delays OSA treatment, increasing the risk of comorbidities. Therefore, a simple and reliable method to identify and screen patients at a high risk of OSA is urgently needed.

Clinical questionnaires and scales (i.e., Epworth Sleepiness Scale [ESS], the STOP-Bang questionnaire [SBQ], and the Berlin questionnaire [BQ]) are used to diagnose OSA in the absence of standard PSG; however, these questionnaires have limitations [15]. Many OSA-related parameters, including body mass index (BMI), neck circumference (NC), gender, and comorbidities, are relevant for predicting OSA [16, 17]. This study constructed and validated a simple-to-use nomogram based on ESS scores and OSA-related parameters to diagnose OSA in patients with hypertension.

2. Materials and Methods

2.1. Study Subjects

This cross-sectional study used data from 347 hypertensive patients with suspected OSA, who were referred to the Hypertension Clinic of the People’s Hospital of Zhejiang Province between January 1, 2019, and December 30, 2020. We excluded patients with hypothyroidism or hyperthyroidism, Cheyne-Stokes respiration, ischemic or hemorrhagic stroke, nasopharyngeal or oropharyngeal diseases (uncontrolled acute tonsillitis, acute otitis media, rhinitis, and sinusitis), missing questionnaires or information, and patients aged <18 and >80 years.

2.2. Portable Monitoring

All subjects underwent whole-night sleep monitoring with a PM (Murrysville, America) at home from 10 pm until 6 am the next day, with at least 7 h of recording. PM measured the airflow (nasal/oral thermocouple and a nasal pressure transducer), respiratory effort (thoracic and abdominal), arterial oxygen saturation and pulse rate, snoring time and intensity, and changes in body position.

Apnea was defined as the complete cessation of airflow or a ≥90% decrease in peak thermal sensor excursion for at least 10 s. Hypopnea was defined as a decrease in nasal pressure signal excursion of ≥50% from baseline with a SpO₂ decrease of >3% from baseline for ≥10 s [18]. The apnea-hypopnea index (AHI) was calculated as the total number of OSA and hypopnea episodes per hour of sleep. Subjects were divided into an OSA group (AHI ≥5 events/h) and a control group (AHI <5 events/h) [18].

2.3. Data Collection and Potential Predictors

Demographic characteristics (age, sex, occupation, height, weight, and NC), OSA symptoms (snoring, tiredness, and observed apnea), tea consumption, cigarette consumption, disease history (including cerebrovascular and respiratory diseases), and answers to the ESS questionnaire were collected before PM. BMI was defined as kg/m².

2.4. ESS Evaluation

The ESS consists of eight self-rated items and assesses the probability of dozing using a scale ranging from 0 (never) to 3 (high). The sum of each item score yielded a global score (range, 0–24) [19]. ESS, originally designed to assess the risk of daytime sleepiness, can determine the subjective probability of falling asleep in various environments, and is used to detect OSA [20]. This study used the Chinese version of the ESS [21] and considered ESS scores as a continuous variable.

2.5. Statistical Analysis

Descriptive analyses were conducted using SPSS version 22.0 for Windows (SPSS Inc., Chicago, IL, USA). Continuous variables were summarized as mean ± standard deviations or medians (interquartile ranges) and were compared using student’ t-test or Wilcoxon rank-sum test. Categorical variables were expressed as percentages and were compared using Pearson chi-square test.

The derivation and assessment of the nomogram were performed according to the five steps: (1) All subjects were randomly assigned to a training set (to construct the nomogram) and a validation set at a 70 : 30 ratio (N = 242/N = 105); (2) Independent potential predictors of OSA in the training set were identified using the least absolute shrinkage and selection operator (LASSO) regression model [22, 23]; (3) The nomogram model based on these predictors was developed by multivariate logistic regression analysis, and the results were presented as odds ratios (ORs), with associated 95% confidence intervals (95% CIs) and corresponding -values [24]; (4) In the training and validation sets, discrimination and calibration of the nomogram model were assessed using the area under the receiver operating characteristic (ROC) curve (AUC) and calibration curve plot, respectively [25]. AUC >0.75 indicated good discrimination of the model. in the calibration curves suggested good consistency between the new model and standard diagnostic criteria; (5) The clinical benefits and utility of the nomogram compared with the ESS were evaluated using the net reclassification index (NRI) [26], integrated discrimination improvement (IDI) [27], and decision curve analysis (DCA) [28].

The LASSO, nomogram, ROC curve, DCA, NRI, IDI, and bootstrap analysis were performed using the packages “glmnet,” “rms,” “ROCR,” “rmda,” “nricens,” and “PredictABEL” in R version 4.0.1, respectively. Statistical significance was set at .

3. Results

3.1. Baseline Characteristics

In total, 347 subjects with a mean age of 46.6 ± 12.4 years were enrolled. Men accounted for 77.8% of the cohort. There were no significant differences in baseline characteristics between the training and validation sets () (Table 1).

3.2. Selection of Predictors by LASSO Regression

Potential predictors of OSA in the training set were identified using the LASSO regression model. Five factors-ESS scores, BMI, NC, snoring, and observed apnea-were significant predictors of OSA (Figures 1(a), 1(b)) and had nonzero coefficients (Lambda.1se = 0.05989) in the 10-fold cross-validation LASSO regression model (Table 2).

(a)

(b)

Figure 1

Demographic, anthropometric value, OSA-related signs and symptoms, and ESS score selection using the LASSO binary logistic regression model. (a) Optimal parameter (lambda) selection in the LASSO model used ten fold cross-validation via minimum criteria. The partial likelihood deviance (binomial deviance) curve was plotted versus log(lambda). Dotted vertical lines were drawn at the optimal values by using the minimum criteria and the 1 SE of the minimum criteria (the 1-SE criteria). (b) LASSO coefficient profiles of the 12 features. A coefficient profile plot was produced against the log(lambda) sequence. Vertical line was drawn at the value selected using ten-fold cross-validation, where optimal lambda resulted in five features with nonzero coefficients. LASSO, least absolute shrinkage and selection operator; SE, standard error. OSA, Obstructive sleep apnea; ESS, Epworth sleepiness scale.

3.3. Multivariate Logistic Regression Analysis in the Training Set

OSA and the five predictors were considered dependent and independent variables, respectively. The results of multivariate logistic regression analysis showed that ESS scores (per 1 score increase) (OR = 1.24, 95% CI: 1.12–1.38), BMI (OR = 1.06, 95% CI: 0.94–1.20), NC (OR = 1.20, 95% CI: 1.04–1.38), snoring (OR = 2.36, 95% CI: 0.94–5.92), and observed apnea (OR = 1.88, 95% CI: 0.87–4.03) were independent predictors of OSA in patients with hypertension (Table 3).

3.4. Construction and Assessment of the Nomogram

Based on the results of multivariate logistic regression analysis, we constructed a nomogram to predict OSA (Figure 2), which can also be calculated using the formula: probability (OSA) = 1/(1 + exp (−(−9.980 + 0.216 × ESS score + 0.057 × BMI (kg/m²) + 0.180 × NC (cm) + 0.857 snoring (yes = 1, no = 0) + 0.629 × observed apnea (yes = 1, no = 0).

The AUC for the nomogram was 0.799 (95% CI: 0.743–0.847), indicating good discrimination (Figure 3(a)). The calibration curve plot indicated good agreement between the predicted and actual probability of OSA () (Figure 4(a)).

(a)

(b)

(a)

(b)

3.5. Internal Validation of the Nomogram

The nomogram showed good discrimination (AUC: 0.766; 95% CI: 0.673–0.843) (Figure 3(b)) and good calibration (; Figure 4(b)) in the validation set. Thus, the nomogram performed well in the training and validation sets.

3.6. Clinical Value of the Nomogram

ROC analysis showed that the AUC of the nomogram was 0.799, significantly higher than that of the ESS (0.719) () (Figure 3(a)). The accuracy of the nomogram and the ESS was compared using the NRI and IDI. The NRI and IDI were 0.552 (95% CI: 0.282–0.822, ) and 0.088 (95% CI: 0.045–0.133, ), respectively (Table 4). These results indicated that the predictive accuracy of the nomogram was higher than that of the ESS.

The clinical benefits of the nomogram and ESS were compared. DCA curves showed that the nomogram could better predict OSA and was more clinically beneficial than ESS at threshold probabilities of >42% using the treat-all-patients scheme and the treat-none scheme (Figure 5).

Figure 5

Decision curve analysis for the nomogram for predict OSA in validation set. Notes: The y-axis measures the net benefit. The blue line represents the OSA risk nomogram. The red line represents the ESS prediction risk of OSA. The thin solid line represents the assumption that all patients are non-OSA. Thin thick solid line represents the assumption that no patients are non-OSA. The decision curve showed that if the threshold probability of a patient and a doctor is more than 42%, using this nomogram for OSA in the current study to predict OSA risk adds more benefit than the ESS, intervention-all-patients scheme, or the intervention-none scheme. OSA, obstructive sleep apnea; ESS, Epworth sleepiness scale.

4. Discussion

This study developed and validated an easy-to-use nomogram model for diagnosing OSA. To our knowledge, this study is the first to establish a prediction model based on ESS scores and other OSA-related clinical parameters to distinguish OSA from non-OSA in patients with hypertension. The nomogram model demonstrated good accuracy and discrimination. Additionally, we assessed the quality of the nomogram using decision analysis (net benefit and decision curves) and measures related to reclassification tables (NRI and IDI).

Although the morbidity of OSA is high, the actual situation may be more serious. Young et al. reported that approximately 82% of men and 93% of women with moderate to severe OSA were not clinically diagnosed [29, 30]. In addition, a Sleep Heart Health study found that only 1.6% of patients with OSA were clinically diagnosed, and only 0.6% were treated [31]. These results indicate that the diagnosis and treatment of OSA are inadequate. The major reason for underdiagnosis is limitations in diagnostic methods. The gold standard is PSG; however, the equipment is expensive and requires specialized venues and analysts.

Biomarkers, scales, and models used to diagnose OSA have limitations. For instance, NC underestimates OSA in lean individuals [32], and the diagnostic accuracy of NC varies between races and ethnicities. In addition, the optimal cutoff values of NC for predicting OSA in non-Asian populations are inconsistent [33–35], and few studies have measured these values in Asian populations. Therefore, the optimal cutoff of NC for OSA diagnosis should be determined in different ethnic populations to improve the diagnostic performance of NC. In the present study, NC was considered as a continuous variable in the nomogram, combined with other OSA-related clinical measurements, increasing the predictive accuracy of NC in Asian patients with hypertension. The AUC of a nomogram model with eight predictors of OSA in Chinese adults was 0.84 [36]; however, the model was based on blood markers, which involved invasive tests, and did not include patients with hypertension. Aaronson et al. developed a prediction model of OSA by logistic regression analysis using sociodemographic factors, self-reported symptoms, and clinical features [37]; nonetheless, the study population consisted of patients with stroke, limiting the generalizability of the results.

OSA is screened using well-designed questionnaires, including the ESS and STOP-Bang. However, the results were not satisfactory [15]. For instance, Sil et al. [38] found that the AUC of the ESS was 0.672, indicating that this model was marginally useful for predicting OSA. The diagnostic sensitivity and specificity of the ESS for OSA were 54% and 65%, respectively [39], demonstrating the low accuracy of this scale to screen OSA. In the present study, DCA, NRI, and IDI indicated that at a probability threshold of >42%, the nomogram was more clinically beneficial and could better predict OSA than the ESS. STOP-Bang was initially used to screen surgical patients [40], and its ability to predict mild, moderate, and severe OSA was higher than that of the sleep apnea clinical score, BQ, and ESS [41]. However, the AUC of OSA for all degrees of severity (0.72) was lower than that of our model [20]. Additionally, although the SBQ seems more accurate than other questionnaires for screening OSA, its relatively low specificity limits its clinical utility [39]. Conversely, the ability of our nomogram to discriminate between OSA and non-OSA was high. Twelve potential risk predictors, including ESS- and OSA-related parameters, were used to construct the nomogram, and five predictors were selected using LASSO regression to reduce overfitting [42]. DCA weighs the benefits and risks by comparing the net benefits of models with different threshold probabilities versus performing PM examinations for all patients [43]. The results showed that our nomogram was more beneficial than treating all patients or treating none. Therefore, this model may improve decision-making and the early treatment of high-risk patients, particularly in clinics lacking PSG systems.

The proposed model detects OSA using clinical characteristics and ESS scores and can be easily applied in clinical settings by generating graphs of each case. Furthermore, this nomogram is noninvasive and uses objective and subjective parameters.

This study has limitations. First, our model was not externally validated in different ethnic groups and populations. Second, the single-center nature of the study may limit the generalizability of our findings. Third, using PM rather than standard PSG may have underestimated the severity of sleep apnea. However, PM is recommended by clinical guidelines for diagnosing OSA [18]. In addition, PM has unique advantages because sleep monitoring in a home environment is less likely to interfere with the routines of daily life, including sleep, and is better related to real sleep-disordered breathing in some cases [44].

5. Conclusions

We developed and validated an accurate nomogram model comprising the ESS and other OSA-related parameters to predict OSA in subjects with hypertension, improving clinical decision-making.

Data Availability

Materials included in the article, including all relevant raw data, will be made freely available to any researchers who wish to use them for noncommercial purposes, while preserving any necessary confidentiality and anonymity.

Ethical Approval

Ethical approval was obtained from the Ethics Review Committee of Zhejiang Province People’s Hospital (2019KY335).

Conflicts of Interest

The authors declare that they have no conflicts of interest.

Authors’ Contributions

LW, DS, and SX were involved in this study. LW, DS, JX, LZ, DL, and SX participated in the data collection and quality control. LW performed the statistical analyses. LW drafted the manuscript. DS, JX, LZ, DL and SX critically revised the manuscript. DS and SX provided important suggestions and made significant changes. All authors reviewed and approved the final version of the manuscript. Lin Wang and Dongsheng Sun contributed equally to this work and share the first authorship.

Acknowledgments

The authors thank all the subjects who participated in this study. The authors thank Xuan Xiao for polysomnography monitoring of each subject. This work was supported by a grant from the Basic Public Welfare Research Program of Zhejiang Province (No. LGF20H020009).

References

C. V. Senaratna, J. L. Perret, C. J. Lodge et al., “Prevalence of obstructive sleep apnea in the general population: a systematic review,” Sleep Medicine Reviews, vol. 34, pp. 70–81, 2017.
View at: Publisher Site | Google Scholar
F. Chung, R. Subramanyam, P. Liao, E. Sasaki, C. Shapiro, and Y. Sun, “High STOP-Bang score indicates a high probability of obstructive sleep apnoea,” British Journal of Anaesthesia, vol. 108, no. 5, pp. 768–775, 2012.
View at: Publisher Site | Google Scholar
P. E. Peppard, T. Young, J. H. Barnet, M. Palta, E. W. Hagen, and K. M. Hla, “Increased prevalence of sleep-disordered breathing in adults,” American Journal of Epidemiology, vol. 177, no. 9, pp. 1006–1014, 2013.
View at: Publisher Site | Google Scholar
P. E. Peppard, T. Young, M. Palta, and J. Skatrud, “Prospective study of the association between sleep-disordered breathing and hypertension,” New England Journal of Medicine, vol. 342, no. 19, pp. 1378–1384, 2000.
View at: Publisher Site | Google Scholar
T. Kasai, J. S. Floras, and T. D. Bradley, “Sleep apnea and cardiovascular disease: a bidirectional relationship,” Circulation, vol. 126, no. 12, pp. 1495–1510, 2012.
View at: Publisher Site | Google Scholar
S. Redline, G. Yenokyan, D. J. Gottlieb et al., “Obstructive sleep apnea-hypopnea and incident stroke: the sleep heart health study,” American Journal of Respiratory and Critical Care Medicine, vol. 182, no. 2, pp. 269–277, 2010.
View at: Publisher Site | Google Scholar
J. E. Shaw, N. M. Punjabi, J. P. Wilding, K. G. M. Alberti, and P. Z. Zimmet, “International diabetes federation taskforce on epidemiology and prevention. Sleep-Disordered breathing and type 2 diabetes: a report from the international diabetes federation taskforce on epidemiology and prevention,” Diabetes Research and Clinical Practice, vol. 81, no. 1, pp. 2–12, 2008.
View at: Publisher Site | Google Scholar
S. Jin, S. Jiang, and A. Hu, “Association between obstructive sleep apnea and non-alcoholic fatty liver disease: a systematic review and meta-analysis,” Sleep and Breathing, vol. 22, no. 3, pp. 841–851, 2018.
View at: Publisher Site | Google Scholar
J. S. Floras, “Hypertension and sleep apnea,” Canadian Journal of Cardiology, vol. 31, no. 7, pp. 889–897, 2015.
View at: Publisher Site | Google Scholar
A. Bikov, S. Frent, R. Pleava et al., “The burden of associated comorbidities in patients with obstructive sleep apnea-regional differences in two central-eastern European sleep centers,” Journal of Clinical Medicine, vol. 9, no. 11, p. 3583, 2020.
View at: Publisher Site | Google Scholar
L. A. Salman, R. Shulman, and J. B. Cohen, “Obstructive sleep apnea, hypertension, and cardiovascular risk: epidemiology, pathophysiology, and management,” Current Cardiology Reports, vol. 22, no. 2, 2020.
View at: Publisher Site | Google Scholar
V. K. Kapur, D. H. Auckley, S. Chowdhuri et al., “Clinical practice guideline for diagnostic testing for adult obstructive sleep apnea: an American academy of sleep medicine clinical practice guideline,” Journal of Clinical Sleep Medicine, vol. 13, no. 03, pp. 479–504, 2017.
View at: Publisher Site | Google Scholar
Chinese Medicine Doctors Association Sleep medicine Specialized Committee (CMDASM), “Multidisciplinary guideline for diagnostic testing for adult obstructive sleep apnea,” Chinese Medical Journal, vol. 2, 2018.
View at: Google Scholar
W. W. Flemons, N. J. Douglas, S. T. Kuna, D. O. Rodenstein, and J. Wheatley, “Access to diagnosis and treatment of patients with suspected sleep apnea,” American Journal of Respiratory and Critical Care Medicine, vol. 169, no. 6, pp. 668–672, 2004.
View at: Publisher Site | Google Scholar
Z. Zheng, X. Sun, R. Chen et al., “Comparison of six assessment tools to screen for obstructive sleep apnea in patients with hypertension,” Clinical Cardiology, vol. 44, no. 11, pp. 1526–1534, 2021.
View at: Publisher Site | Google Scholar
J. Zou, J. Guan, H. Yi et al., “An effective model for screening obstructive sleep apnea: a large-scale diagnostic study,” PLoS One, vol. 8, no. 12, Article ID e80704, 2013.
View at: Publisher Site | Google Scholar
B. Ustun, M. B. Westover, C. Rudin, and M. T. Bianchi, “Clinical prediction models for sleep apnea: the importance of medical history over symptoms,” Journal of Clinical Sleep Medicine, vol. 12, no. 02, pp. 161–168, 2016.
View at: Publisher Site | Google Scholar
N. A. Collop, W. M. Anderson, B. Boehlecke et al., “Clinical guidelines for the use of unattended portable monitors in the diagnosis of obstructive sleep apnea in adult patients. Portable Monitoring Task Force of the American Academy of Sleep Medicine,” Journal of Clinical Sleep Medicine, vol. 3, no. 7, pp. 737–747, 2007.
View at: Google Scholar
M. W. Johns, “A new method for measuring daytime sleepiness: the Epworth sleepiness scale,” Sleep, vol. 14, no. 6, pp. 540–545, 1991.
View at: Publisher Site | Google Scholar
R. L. M. Duarte, F. J. Magalhães-da-Silveira, T. S. Oliveira-E-Sá, M. F. Rabahi, F. C. Q. Mello, and D. Gozal, “Predicting obstructive sleep apnea in patients with insomnia: a comparative study with four screening instruments,” Lung, vol. 197, no. 4, pp. 451–458, 2019.
View at: Publisher Site | Google Scholar
N. H. Chen, M. W. Johns, H. Y. Li et al., “Validation of a Chinese version of the Epworth sleepiness scale,” Quality of Life Research: An International Journal of Quality of Life Aspects of Treatment, Care and Rehabilitation, vol. 11, no. 8, pp. 817–821, 2002.
View at: Publisher Site | Google Scholar
R. Alhamzawi and H. T. M. Ali, “The Bayesian adaptive lasso regression,” Mathematical Biosciences, vol. 303, pp. 75–82, 2018.
View at: Publisher Site | Google Scholar
Z. Li and M. J. Sillanpää, “Overview of LASSO-related penalized regression methods for quantitative trait mapping and genomic selection,” Theoretical and Applied Genetics, vol. 125, no. 3, pp. 419–435, 2012.
View at: Publisher Site | Google Scholar
V. P. Balachandran, M. Gonen, J. J. Smith, and R. P. DeMatteo, “Nomograms in oncology: more than meets the eye,” The Lancet Oncology, vol. 16, no. 4, pp. e173–e180, 2015.
View at: Publisher Site | Google Scholar
A. Poncet, T. V. Perneger, P. Merlani, M. Capuzzo, and C. Combescure, “Determinants of the calibration of SAPS II and SAPS 3 mortality scores in intensive care: a European multicenter study,” Critical Care, vol. 21, no. 1, p. 85, 2017.
View at: Publisher Site | Google Scholar
M. J. Pencina, R. B. D’Agostino, and E. W. Steyerberg, “Extensions of net reclassification improvement calculations to measure usefulness of new biomarkers,” Statistics in Medicine, vol. 30, no. 1, pp. 11–21, 2011.
View at: Publisher Site | Google Scholar
O. V. Demler, M. J. Pencina, N. R. Cook, and R. B. D’Agostino, “Asymptotic distribution of ∆AUC, NRIs, and IDI based on theory of U-statistics,” Statistics in Medicine, vol. 36, no. 21, pp. 3334–3360, 2017.
View at: Publisher Site | Google Scholar
A. J. Vickers and E. B. Elkin, “Decision curve analysis: a novel method for evaluating prediction models,” Medical Decision Making, vol. 26, no. 6, pp. 565–574, 2006.
View at: Publisher Site | Google Scholar
T. Young, L. Evans, L. Finn, and M. Palta, “Estimation of the clinically diagnosed proportion of sleep apnea syndrome in middle-aged men and women,” Sleep, vol. 20, no. 9, pp. 705-706, 1997.
View at: Publisher Site | Google Scholar
T. Young, P. E. Peppard, and D. J. Gottlieb, “Epidemiology of obstructive sleep apnea: a population health perspective,” American Journal of Respiratory and Critical Care Medicine, vol. 165, no. 9, pp. 1217–1239, 2002.
View at: Publisher Site | Google Scholar
K. M. Oltmanns, “Abdominal fat and sleep apnea: the chicken or the egg? Response to Pillar and Shehadeh,” Diabetes Care, vol. 31, no. 7, pp. e61–e62, 2008.
View at: Publisher Site | Google Scholar
R. J. Davies and J. R. Stradling, “The relationship between neck circumference, radiographic pharyngeal anatomy, and the obstructive sleep apnoea syndrome,” European Respiratory Journal, vol. 3, no. 5, pp. 509–514, 1990.
View at: Google Scholar
L. B. d M. Fonseca, E. A. Silveira, N. M. Lima, and M. F. Rabahi, “STOP-Bang questionnaire: translation to Portuguese and cross-cultural adaptation for use in Brazil,” Jornal Brasileiro de Pneumologia, vol. 42, no. 4, pp. 266–272, 2016.
View at: Publisher Site | Google Scholar
R. L. d M. Duarte, L. B. d M. Fonseca, F. J. Magalhães-da-Silveira, E. A. D. Silveira, and M. F. Rabahi, “Validation of the STOP-Bang questionnaire as a means of screening for obstructive sleep apnea in adults in Brazil,” Jornal Brasileiro de Pneumologia, vol. 43, no. 6, pp. 456–463, 2017.
View at: Publisher Site | Google Scholar
A. Onat, G. Hergenç, H. Yüksel et al., “Neck circumference as a measure of central obesity: associations with metabolic syndrome and obstructive sleep apnea syndrome beyond waist circumference,” Clinical Nutrition, vol. 28, no. 1, pp. 46–51, 2009.
View at: Publisher Site | Google Scholar
H. Xu, X. Zhao, Y. Shi et al., “Development and validation of a simple-to-use clinical nomogram for predicting obstructive sleep apnea,” BMC Pulmonary Medicine, vol. 19, no. 1, 2019.
View at: Publisher Site | Google Scholar
J. A. Aaronson, J. Nachtegaal, T. van Bezeij et al., “Can a prediction model combining self-reported symptoms, sociodemographic and clinical features serve as a reliable first screening method for sleep apnea syndrome in patients with stroke?” Archives of Physical Medicine and Rehabilitation, vol. 95, no. 4, pp. 747–752, 2014.
View at: Publisher Site | Google Scholar
A. Sil and G. Barr, “Assessment of predictive ability of Epworth scoring in screening of patients with sleep apnoea,” Journal of Laryngology & Otology, vol. 126, no. 4, pp. 372–379, 2012.
View at: Publisher Site | Google Scholar
H. Y. Chiu, P. Y. Chen, L. P. Chuang et al., “Diagnostic accuracy of the Berlin questionnaire, STOP-BANG, STOP, and Epworth sleepiness scale in detecting obstructive sleep apnea: a bivariate meta-analysis,” Sleep Medicine Reviews, vol. 36, pp. 57–70, 2017.
View at: Publisher Site | Google Scholar
F. Chung, B. Yegneswaran, P. Liao et al., “STOP questionnaire: a tool to screen patients for obstructive sleep apnea,” Anesthesiology, vol. 108, no. 5, pp. 812–821, 2008.
View at: Publisher Site | Google Scholar
M. Xiong, W. Hu, M. Dong et al., “The screening value of ESS, SACS, BQ, and SBQ on obstructive sleep apnea in patients with chronic obstructive pulmonary disease,” International Journal of Chronic Obstructive Pulmonary Disease, vol. 14, pp. 2497–2505, 2019.
View at: Publisher Site | Google Scholar
T. Hepp, M. Schmid, O. Gefeller, E. Waldmann, and A. Mayr, “Approaches to regularized regression – a comparison between gradient boosting and the lasso,” Methods of Information in Medicine, vol. 55, no. 05, pp. 422–430, 2016.
View at: Publisher Site | Google Scholar
M. Luo, H. Y. Zheng, Y. Zhang et al., “A nomogram for predicting the likelihood of obstructive sleep apnea to reduce the unnecessary polysomnography examinations,” Chinese Medical Journal, vol. 128, no. 16, pp. 2134–2140, 2015.
View at: Publisher Site | Google Scholar
P. Mayer, A. Herrero Babiloni, G. Beetz et al., “The evaluation of autonomic arousals in scoring sleep respiratory disturbances with polysomnography and portable monitor devices: a proof of concept study,” Nature and Science of Sleep, vol. 12, pp. 443–451, 2020.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2022 Lin Wang et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

379

Downloads

612

Citations