Abstract
Different biological signals are recorded in sleep labs during sleep for the diagnosis and treatment of human sleep problems. Classification of sleep stages with electroencephalography (EEG) is preferred to other biological signals due to its advantages such as providing clinical information, cost-effectiveness, comfort, and ease of use. The evaluation of EEG signals taken during sleep by clinicians is a tiring, time-consuming, and error-prone method. Therefore, it is clinically mandatory to determine sleep stages by using software-supported systems. Like all classification problems, the accuracy rate is used to compare the performance of studies in this domain, but this metric can be accurate when the number of observations is equal in classes. However, since there is not an equal number of observations in sleep stages, this metric is insufficient in the evaluation of such systems. For this purpose, in recent years, Cohen’s kappa coefficient and even the sensitivity of NREM1 have been used for comparing the performance of these systems. Still, none of them examine the system from all dimensions. Therefore, in this study, two new metrics based on the polygon area metric, called the normalized area of sensitivity polygon and normalized area of the general polygon, are proposed for the performance evaluation of sleep staging systems. In addition, a new sleep staging system is introduced using the applications offered by the MATLAB program. The existing systems discussed in the literature were examined with the proposed metrics, and the best systems were compared with the proposed sleep staging system. According to the results, the proposed system excels in comparison with the most advanced machine learning methods. The single-channel method introduced based on the proposed metrics can be used for robust and reliable sleep stage classification from all dimensions required for real-time applications.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Akben SB, Alkan A (2016) Visual interpretation of biomedical time series using Parzen window-based density-amplitude domain transformation. PLoS ONE. https://doi.org/10.1371/journal.pone.0163569
Aydemir O (2020) A new performance evaluation metric for classifiers: polygon area metric. J Classif. https://doi.org/10.1007/s00357-020-09362-5
Boashash B, Ouelha S (2016) Automatic signal abnormality detection using time-frequency features and machine learning: a newborn EEG seizure case study. Knowl Based Syst 106:38–50. https://doi.org/10.1016/j.knosys.2016.05.027
Cohen J (1960) A coefficient of agreement for nominal scales. Educ Psychol Meas 20(1):37–46. https://doi.org/10.1177/001316446002000104
Dhok S, Pimpalkhute V, Chandurkar A, Bhurane AA, Sharma M, Acharya UR (2020) Automated phase classification in cyclic alternating patterns in sleep stages using Wigner–Ville distribution based features. Comput Biol Med 119:103691. https://doi.org/10.1016/j.compbiomed.2020.103691
Ghimatgar H, Kazemi K, Helfroush MS, Aarabi A (2019) An automatic single-channel EEG-based sleep stage scoring method based on hidden Markov model. J Neurosci Methods 324:108320. https://doi.org/10.1016/j.jneumeth.2019.108320
Goldberger AL et al (2000) PhysioBank, PhysioToolkit, and PhysioNet: components of a new research resource for complex physiologic signals. Circulation. https://doi.org/10.1161/01.cir.101.23.e215
Hassan AR, Bhuiyan MIH (2016a) Computer-aided sleep staging using complete ensemble empirical mode decomposition with adaptive noise and bootstrap aggregating. Biomed Signal Process Control 24:1–10. https://doi.org/10.1016/j.bspc.2015.09.002
Hassan AR, Bhuiyan MIH (2016b) A decision support system for automatic sleep staging from EEG signals using tunable Q-factor wavelet transform and spectral features. J Neurosci Methods 271:107–118. https://doi.org/10.1016/j.jneumeth.2016.07.012
Hassan AR, Bhuiyan MIH (2016c) Automatic sleep scoring using statistical features in the EMD domain and ensemble methods. Biocybern Biomed Eng 36(1):248–255. https://doi.org/10.1016/j.bbe.2015.11.001
Hassan AR, Bhuiyan MIH (2017a) An automated method for sleep staging from EEG signals using normal inverse Gaussian parameters and adaptive boosting. Neurocomputing 219:76–87. https://doi.org/10.1016/j.neucom.2016.09.011
Hassan AR, Bhuiyan MIH (2017b) Automated identification of sleep states from EEG signals by means of ensemble empirical mode decomposition and random under sampling boosting. Comput Methods Programs Biomed 140:201–210. https://doi.org/10.1016/j.cmpb.2016.12.015
Hassan AR, Subasi A (2017) A decision support system for automated identification of sleep stages from single-channel EEG signals. Knowl Based Syst 128:115–124. https://doi.org/10.1016/j.knosys.2017.05.005
Hassan AR, Bashar SK, Bhuiyan MIH (2015) On the classification of sleep states by means of statistical and spectral features from single channel electroencephalogram. In: 2015 international conference on advances in computing, communications and informatics, ICACCI 2015, pp 2238–2243. https://doi.org/10.1109/ICACCI.2015.7275950
Hassan AR, Bashar SK, Bhuiyan MIH (2016) Automatic classification of sleep stages from single-channel electroencephalogram. In: 12th IEEE international conference electronics, energy, environment, communication, computer, control: (E3-C3), INDICON 2015.https://doi.org/10.1109/INDICON.2015.7443756
Horne J (2013) Why REM sleep? Clues beyond the laboratory in a more challenging world. Biol Psychol 92(2):152–168. https://doi.org/10.1016/j.biopsycho.2012.10.010
Hsu YL, Yang YT, Wang JS, Hsu CY (2013) Automatic sleep stage recurrent neural classifier using energy features of EEG signals. Neurocomputing 104:105–114. https://doi.org/10.1016/j.neucom.2012.11.003
Kayikcioglu T, Maleki M, Eroglu K (2015) Fast and accurate PLS-based classification of EEG sleep using single channel data. Expert Syst Appl 42(21):7825–7830. https://doi.org/10.1016/j.eswa.2015.06.010
Kemp B, Zwinderman AH, Tuk B, Kamphuisen HAC, Oberyé JJL (2000) Analysis of a sleep-dependent neuronal feedback loop: the slow-wave microcontinuity of the EEG. IEEE Trans Biomed Eng 47(9):1185–1194. https://doi.org/10.1109/10.867928
Lajnef T et al (2015) Learning machines and sleeping brains: automatic sleep stage classification using decision-tree multi-class support vector machines. J Neurosci Methods 250:94–105. https://doi.org/10.1016/j.jneumeth.2015.01.022
Li Y, Luo ML, Li K (2016) A multiwavelet-based time-varying model identification approach for time-frequency analysis of EEG signals. Neurocomputing 193:106–114. https://doi.org/10.1016/j.neucom.2016.01.062
Liang SF, Kuo CE, Hu YH, Pan YH, Wang YH (2012) Automatic stage scoring of single-channel sleep EEG by using multiscale entropy and autoregressive models. IEEE Trans Instrum Meas 61(6):1649–1657. https://doi.org/10.1109/TIM.2012.2187242
Mousavi Z, Yousefi Rezaii T, Sheykhivand S, Farzamnia A, Razavi SN (2019) Deep convolutional neural network for classification of sleep stages from single-channel EEG signals. J Neurosci Methods 324:108312. https://doi.org/10.1016/j.jneumeth.2019.108312
Penzel T, Conradt R (2000) Computer based sleep recording and analysis. Sleep Med Rev 4(2):131–148. https://doi.org/10.1053/smrv.1999.0087
Rechtschaffen A, Kales A (1968) A manual for standardized terminology, techniques and scoring system for sleep stages in human subjects. Brain Inf Serv 32:332–337
Ronzhina M, Janoušek O, Kolářová J, Nováková M, Honzík P, Provazník I (2012) Sleep scoring using artificial neural networks. Sleep Med Rev 16(3):251–263. https://doi.org/10.1016/j.smrv.2011.06.003
Seifpour S, Niknazar H, Mikaeili M, Nasrabadi AM (2018) A new automatic sleep staging system based on statistical behavior of local extrema using single channel EEG signal. Expert Syst Appl 104:277–293. https://doi.org/10.1016/j.eswa.2018.03.020
Sharma R, Pachori RB, Upadhyay A (2017) Automatic sleep stages classification based on iterative filtering of electroencephalogram signals. Neural Comput Appl 28(10):2959–2978. https://doi.org/10.1007/s00521-017-2919-6
Sharma M, Goyal D, Achuth PV, Acharya UR (2018a) An accurate sleep stages classification system using a new class of optimally time-frequency localized three-band wavelet filter bank. Comput Biol Med 98:58–75. https://doi.org/10.1016/j.compbiomed.2018.04.025
Sharma M, Agarwal S, Acharya UR (2018b) Application of an optimal class of antisymmetric wavelet filter banks for obstructive sleep apnea diagnosis using ECG signals. Comput Biol Med 100:100–113. https://doi.org/10.1016/j.compbiomed.2018.06.011
Sharma M, Patel S, Choudhary S, Acharya UR (2019a) Automated detection of sleep stages using energy-localized orthogonal wavelet filter banks. Arab J Sci Eng 45(4):2531–2544. https://doi.org/10.1007/s13369-019-04197-8
Sharma M, Raval M, Acharya UR (2019b) A new approach to identify obstructive sleep apnea using an optimal orthogonal wavelet filter bank with ECG signals. Inform Med Unlock 16:100170. https://doi.org/10.1016/j.imu.2019.100170
Sharma M, Patel S, Acharya UR (2020) Automated detection of abnormal EEG signals using localized wavelet filter banks. Pattern Recognit Lett 133:188–194. https://doi.org/10.1016/j.patrec.2020.03.009
Shephard J (1991) Atlas of sleep medicine. Futur. Publ. Co., New York
Zhu G, Li Y, Wen PP (2014) Analysis and classification of sleep stages based on difference visibility graphs from a single-channel EEG signal. IEEE J Biomed Heal Inform 18(6):1813–1821. https://doi.org/10.1109/JBHI.2014.2303991
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Electronic supplementary material
Below is the link to the electronic supplementary material.
Appendix
Appendix
See Tables 16, 17, 18, 19, 20, 21 and 22.
Rights and permissions
About this article
Cite this article
Melek, M., Manshouri, N. & Kayikcioglu, T. An automatic EEG-based sleep staging system with introducing NAoSP and NAoGP as new metrics for sleep staging systems. Cogn Neurodyn 15, 405–423 (2021). https://doi.org/10.1007/s11571-020-09641-2
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11571-020-09641-2