Skip to main content
SpringerLink
Log in

A Systematic Review of Hidden Markov Models and Their Applications

  • Original Paper
  • Published:
Archives of Computational Methods in Engineering Aims and scope Submit manuscript

Abstract

The hidden Markov models are statistical models used in many real-world applications and communities. The use of hidden Markov models has become predominant in the last decades, as evidenced by a large number of published papers. In this survey, 146 papers (101 from Journals and 45 from Conferences/Workshops) from 93 Journals and 44 Conferences/Workshops are considered. The authors evaluate the literature based on hidden Markov model variants that have been applied to various application fields. The paper represents a short but comprehensive description of research on hidden Markov model and its variants for various applications. The paper shows the significant trends in the research on hidden Markov model variants and their applications.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20

Similar content being viewed by others

References

  1. Rabiner LR (1989) A tutorial on hidden Markov models and selected applications in speech recognition. Proc IEEE 77(2):257–286

    Google Scholar 

  2. Alghamdi R (2016) Hidden Markov models (HMMs) and security applications. Int J Adv Comput Sci Appl 7(2):39–47

    Google Scholar 

  3. Hidden Markov model. https://en.wikipedia.org/wiki/Hidden_Markov_model. Accessed 5 May 5 2019

  4. Liu J, Zhu L, Wang Y, Liang X, Hyyppa J, Chu T, Liu K, Chen R (2015) Reciprocal estimation of pedestrian location and motion state toward a smartphone geo-context computing solution. Micromachines 6(6):699–717

    Google Scholar 

  5. Yamato J, Ohya J, Ishii K (1992) Recognizing human action in time-sequential images using hidden Markov model. In: Proceedings of IEEE computer society conference on computer vision and pattern recognition, Champaign, Illinois, USA, 15–18 June, pp 379–385

  6. Yanchenko AK (2017) Classical music composition using hidden Markov models. Master’s Thesis, Duke University, Durham, North Carolina, 1st edn

  7. Rabiner LR, Levinson SE, Sondhi MM (1983) On the application of vector quantization and hidden Markov models to speaker-independent, isolated word recognition. Bell Syst Tech J 62(4):1075–1105

    Google Scholar 

  8. Levinson SE, Rabiner LR, Sondhi MM (1983) Speaker independent isolated digit recognition using hidden Markov models. In: Proceedings of IEEE international conference on acoustics, speech, and signal processing (ICASSP), Boston, Massachusetts, USA, 14–16 April, pp 1049–1052

  9. Schwartz R, Chow Y, Roucos S, Krasner M, Makhoul J (1984) Improved hidden Markov modeling of phonemes for continuous speech recognition. In: Proceedings of IEEE international conference on acoustics, speech, and signal processing (ICASSP’84), San Diego, California, USA, 19–21 March, pp 21–24

  10. Juang BH, Rabiner LR (1991) Hidden Markov models for speech recognition. Technometrics 33(3):251–272

    MathSciNet  MATH  Google Scholar 

  11. Bahl LR, Brown PF, De Souza PV, Mercer RL (1986) Maximum mutual information estimation of hidden Markov model parameters for speech recognition. In: Proceedings of IEEE international conference on acoustics, speech, and signal processing (ICASSP’86), Tokyo, Japan, 7–11 April, pp 49–52

  12. Poritz A (1982) Linear predictive hidden Markov models and the speech signal. In: Proceedings of IEEE international conference on acoustics, speech, and signal processing (ICASSP’82), Paris, France, 3–5 May, pp 1291–1294

  13. Rose RC, Paul DB (1990) A hidden Markov model based keyword recognition system. In: Proceedings of IEEE international conference on acoustics, speech, and signal processing (ICASSP), Albuquerque, New Mexico, USA, 3–6 April, pp 129–132

  14. Lee KF, Hon HW (1989) Speaker-independent phone recognition using hidden Markov models. IEEE Trans Acoust Speech Signal Process 37(11):1641–1648

    Google Scholar 

  15. Juang BH (1984) On the hidden Markov model and dynamic time warping for speech recognition—a unified view. AT&T Bell Lab Tech J 63(7):1213–1243

    MathSciNet  MATH  Google Scholar 

  16. Varga AP, Moore RK (1990) Hidden Markov model decomposition of speech and noise. In: Proceedings of IEEE international conference on acoustics, speech, and signal processing (ICASSP), Albuquerque, New Mexico, USA, 3–6 April, pp 845–848

  17. Sonnhammer EL, Heijne GV, Krogh A (1998) A hidden Markov model for predicting transmembrane helices in protein sequences. In: Proceeding of 6th international conference on intelligent systems for molecular biology (ISMB), Montreal, Canada, 28 June–1 July, pp 175–182

  18. Churchill GA (1992) Hidden Markov chains and the analysis of genome structure. Comput Chem 16(2):107–115

    MATH  Google Scholar 

  19. Soruri M, Zahiri SH, Sadri J (2013) A new approach of training Hidden Markov Model by PSO algorithm for gene sequence modeling. In: Proceeding of 1st Iranian conference on pattern recognition and image analysis (PRIA), Birjand, Iran, 6–8 March, pp 1–4

  20. Krogh AS (1994) Hidden Markov models for labeled sequences. In: Proceedings of the 12th IAPR international conference on pattern recognition (ICPR), conference C: signal processing, Jerusalem, Israel, 9–13 October, pp 140–144

  21. Manogaran G, Vijayakumar V, Varatharajan R, Kumar PM, Sundarasekar R, Hsu CH (2018) Machine learning based big data processing framework for cancer diagnosis using hidden Markov model and GM clustering. Wirel Pers Commun 102(3):2099–2116

    Google Scholar 

  22. Xin G, Hamzaoui N, Antoni J (2018) Semi-automated diagnosis of bearing faults based on a hidden Markov model of the vibration signals. Measurement 127:141–166

    Google Scholar 

  23. Yao L, Wang J, Chen A, Wang Y (2018) V2X routing in a VANET based on the hidden Markov model. IEEE Trans Intell Transp Syst 19(3):889–899

    Google Scholar 

  24. Petersen BK, Mayhew MB, Ogbuefi KO, Greene JD, Liu VX, Ray P (2018) Modeling sepsis progression using hidden markov models. ArXiv preprint arXiv:1801.02736

  25. Tang H, Dong C (2019) Detection of malicious domain names based on an improved hidden Markov model. Int J Wirel Mob Comput 16(1):58–65

    MathSciNet  Google Scholar 

  26. Zhuo Z, Zhang Y, Zhang ZL, Zhang X, Zhang J (2018) Website fingerprinting attack on anonymity networks based on profile hidden Markov model. IEEE Trans Inf Forensics Secur 13(5):1081–1095

    MathSciNet  Google Scholar 

  27. Putland RL, Ranjard L, Constantine R, Radford CA (2018) A hidden Markov model approach to indicate Bryde’s whale acoustics. Ecol Indic 84:479–487

    Google Scholar 

  28. Habayeb M, Murtaza SS, Miranskyy A, Bener AB (2018) On the use of hidden Markov model to predict the time to fix bugs. IEEE Trans Softw Eng 44(12):1224–1244

    Google Scholar 

  29. Ullah I, Ahmad R, Kim D (2018) A prediction mechanism of energy consumption in residential buildings using hidden Markov model. Energies 11(2):1–20

    Google Scholar 

  30. Yip CF, Ng WL, Yau CY (2018) A hidden Markov model for earthquake prediction. Stoch Environ Res Risk Assess 32(5):1415–1434

    Google Scholar 

  31. Pastell M, Frondelius L (2018) A hidden Markov model to estimate the time dairy cows spend in feeder based on indoor positioning data. Comput Electron Agric 152:182–185

    Google Scholar 

  32. Alshamaa D, Chkeir A, Mourad-Chehade F, Honeine P (2019) A hidden Markov model for indoor trajectory tracking of elderly people. In: Proceedings of IEEE sensors applications symposium (SAS), Sophia Antipolis, France, 11–13 March, pp 1–7

  33. Liu S, Zheng K, Zhao L, Fan P (2019) A driving intention prediction method based on hidden Markov model for autonomous driving. ArXiv preprint arXiv:1902.09068

  34. Jiang J, Chen R, Chen M, Wang W, Zhang C (2019) Dynamic fault prediction of power transformers based on hidden Markov model of dissolved gases analysis. IEEE Trans Power Deliv 34(4):1393–1400

    Google Scholar 

  35. Lu S, Lin G, Liu H, Ye C, Que H, Ding Y (2019) A weekly load data mining approach based on hidden Markov model. IEEE Access 7:34609–34619

    Google Scholar 

  36. Xu R, Chen X, Zhang F (2019) Green technology innovation ecosystem based on hidden Markov model. Ekoloji 28(107):1729–1736

    Google Scholar 

  37. Joo T, Seo M, Shin D (2019) An adaptive approach for determining batch sizes using the hidden Markov model. J Intell Manuf 30(2):917–932

    Google Scholar 

  38. Coast DA, Stern RM, Cano CG, Briller SA (1990) An approach to cardiac arrhythmia analysis using hidden Markov models. IEEE Trans Biomed Eng 37(9):826–836

    Google Scholar 

  39. Yang WJ, Lee JC, Chang YC, Wang HC (1998) Hidden Markov model for Mandarin lexical tone recognition. IEEE Trans Acoust Speech Signal Process 36(7):988–992

    MATH  Google Scholar 

  40. Lee LM, Jean FR (2016) High-order hidden Markov model for piecewise linear processes and applications to speech recognition. J Acoust Soc Am 140(2):204–210

    Google Scholar 

  41. Xiong H, Mamon R (2016) A self-updating model driven by a higher-order hidden Markov chain for temperature dynamics. J Comput Sci 17(1):47–61

    MathSciNet  Google Scholar 

  42. Zhu DM, Lu J, Ching WK, Siu TK (2017) Discrete-time optimal asset allocation under higher-order hidden Markov model. Econ Model 66:223–232

    Google Scholar 

  43. Quan C, Ren F (2016) Weighted high-order hidden Markov models for compound emotions recognition in text. Inf Sci 329:581–596

    Google Scholar 

  44. Seifert M, Gohr A, Strickert M, Grosse I (2012) Parsimonious higher-order hidden Markov models for improved array-CGH analysis with applications to Arabidopsis thaliana. PLOS Comput Biol 8(1):1–15

    Google Scholar 

  45. Lee LM, Lee JC (2006) A study on high-order hidden Markov models and applications to speech recognition. In: Proceedings of 19th international conference on industrial, engineering and other applications of applied intelligent systems (IEA/AIE 2006), Annecy, France, 27–30 June, Lecture Notes in Computer Science, vol 4031, pp 682–690

  46. Xiong C, Yang D, Zhang L (2018) A high-order hidden Markov model and its applications for dynamic car ownership analysis. Transp Sci 52(6):1365–1375

    Google Scholar 

  47. Zhang M, Jiang X, Fang Z, Zeng Y, Xu K (2019) High-order Hidden Markov Model for trend prediction in financial time series. Physica A Stat Mech Appl 517:1–12

    Google Scholar 

  48. Chen Z, Qiu RC (2010) Prediction of channel state for cognitive radio using higher-order hidden Markov model. In: Proceedings of the IEEE southeast conference (SoutheastCon), ConCord, North Carolina, 18–21 March, pp 276–282

  49. Boussemart Y, Cummings ML (2011) Predictive models of human supervisory control behavioral patterns using hidden semi-Markov models. Eng Appl Artif Intell 24(7):1252–1262

    Google Scholar 

  50. Hidden Semi-Markov model. https://en.wikipedia.org/wiki/Hidden_semi-Markov_model, Accessed on 5 May 5 2019

  51. Groves R (2013) Automatic harmonization using a hidden semi-Markov model. In: Proceedings of 9th artificial intelligence and interactive digital entertainment conference (AIIDE), Boston, Massachusetts, USA, 14–18 October, pp 48–54

  52. Narimatsu H, Kasai H (2017) State duration and interval modeling in hidden semi-Markov model for sequential data analysis. Ann Math Artif Intell 81(3–4):377–403

    MathSciNet  MATH  Google Scholar 

  53. Zhu K, Liu T (2018) Online tool wear monitoring via hidden semi-Markov model with dependent durations. IEEE Trans Ind Inform 14(1):69–78

    Google Scholar 

  54. Liu T, Zhu K, Zeng L (2018) Diagnosis and prognosis of degradation process via hidden semi-Markov model. IEEE/ASME Trans Mechatron 23(3):1456–1466

    Google Scholar 

  55. Li X, Makis V, Zuo H, Cai J (2018) Optimal Bayesian control policy for gear shaft fault detection using hidden semi-Markov model. Comput Ind Eng 119:21–35

    Google Scholar 

  56. Liu Z, Wang S (2017) Decoding Chinese stock market returns: three-state hidden semi-markov model. Pac Basin Finance J 44:127–149

    Google Scholar 

  57. Xiao Q, Fang Y, Liu Q, Zhou S (2018) Online machine health prognostics based on modified duration-dependent hidden semi-Markov model and high-order particle filtering. Int J Adv Manuf Technol 94(1–4):1283–1297

    Google Scholar 

  58. Kong D, Chen Y, Li N (2017) Hidden semi-markov model-based method for tool-wear estimation in milling process. Int J Adv Manuf Technol 92(9–12):3467–3657

    Google Scholar 

  59. Wu H, Yu Z, Wang Y (2017) Real-time FDM machine condition monitoring and diagnosis based on acoustic emission and hidden semi-Markov model. Int J Adv Manuf Technol 90(5–8):2027–2036

    Google Scholar 

  60. Pertsinidou CE, Tsaklidis G, Papadimitriou E, Limnios N (2017) Application of hidden semi-Markov models for the seismic hazard assessment of the North and South Aegean Sea, Greece. J Appl Stat 44(6):1064–1085

    MathSciNet  MATH  Google Scholar 

  61. Bang JH, Cho YJ, Kang K (2017) Anomaly detection of network-initiated LTE signaling traffic in wireless sensor and actuator networks based on a Hidden semi-Markov Model. Comput Secur 65:108–120

    Google Scholar 

  62. Tanwani AK, Calinon S (2016) Learning robot manipulation tasks with task-parameterized semitied hidden semi-Markov model. IEEE Robot Autom Lett 1(1):235–242

    Google Scholar 

  63. Cai J, Luo JZ, Lei F (2016) Analyzing network protocols of application layer using hidden Semi-Markov model. In: Mathematical Problems in Engineering, pp 1–15

  64. Roman-Galvez R, Roman-Roldan R, Martinez-Aroza J, Gomez-Lopera JF (2015) Semi-hidden Markov models for generation and analysis of sequences. Math Comput Simul 118:320–328

    MathSciNet  MATH  Google Scholar 

  65. Liu Q, Dong M, Lv W, Geng X, Li Y (2015) A novel method using adaptive hidden semi-Markov model for multi-sensor monitoring equipment health prognosis. Mech Syst Signal Process 64–65:217–232

    Google Scholar 

  66. Xiao S, Dong M (2015) Hidden semi-Markov model-based reputation management system for online to offline (O2O) e-commerce markets. Decis Supp Syst 77:87–99

    Google Scholar 

  67. Yue SG, Jiao P, Zha YB, Yin QJ (2015) A logical hierarchical hidden semi-Markov model for team intention recognition. Discrete Dyn Nat Soc 2015:1–20

    MathSciNet  MATH  Google Scholar 

  68. Altuve M, Carrault G, Beuchee A, Pladys P, Hernandez AI (2015) Online apnea-bradycardia detection based on hidden semi-Markov models. Med Biol Eng Comput 53(1):1–13

    Google Scholar 

  69. Votsi I, Limnios N, Tsaklidis G, Papadimitriou E (2014) Hidden semi-Markov modeling for the estimation of earthquake occurrence rates. Commun Stat Theory Methods 43(7):1484–1502

    MathSciNet  MATH  Google Scholar 

  70. Du Y, Murani E, Ponsuksili S, Wimmers K (2014) BiomvRhsmm: genomic segmentation with hidden semi-Markov model. BioMed Res Int 2014:1–12

    Google Scholar 

  71. Xu C, Du C, Zhao GF, Yu S (2013) A novel model for user clicks identification based on hidden semi-Markov. J Netw Comput Appl 36(2):791–798

    Google Scholar 

  72. Liu AA, Li K, Kanade T (2012) A semi-Markov model for mitosis segmentation in time-lapse phase contrast microscopy image sequences of stem cell populations. IEEE Trans Med Imaging 31(2):359–369

    Google Scholar 

  73. Dong M, Peng Y (2011) Equipment PHM using non-stationary segmental hidden semi-Markov model. Robot Comput Integr Manuf 27(3):581–590

    Google Scholar 

  74. Liang Y, Liu X, Lou Y, Shan B (2011) An improved noise-robust voice activity detector based on hidden semi-Markov models. Pattern Recogn Lett 32(7):1044–1053

    Google Scholar 

  75. Xie Y, Hu J, Tang S, Huang X (2012) A forward-backward algorithm for nested hidden semi-Markov model and application to network traffic. Comput J 56(2):229–238

    Google Scholar 

  76. Kerk MVD, Onorato DP, Criffield MA, Bolker BM, Augustine BC, McKinley SA, Oli MK (2015) Hidden semi-Markov models reveal multiphasic movement of the endangered Florida panther. J Anim Ecol 84(2):576–585

    Google Scholar 

  77. Duan C, Makis V, Deng C (2019) Optimal Bayesian early fault detection for CNC equipment using hidden semi-Markov process. Mech Syst Signal Process 122:290–306

    Google Scholar 

  78. Chen R, Shen W, Srinivasamurthy A, Chordia P (2012) Chord recognition using Duration-explicit hidden Markov models. In: Proceedings of 13th international society for music information retrieval conference (ISMIR 2012), Porto, Portugal, 8–12 October, pp 445–450

  79. Karg M, Seiberl W, Kreuzpointner F, Haas JP, Kulic D (2015) Clinical gait analysis: comparing explicit state duration HMMs using a reference-based index. IEEE Trans Neural Syst Rehabil Eng 23(2):319–331

    Google Scholar 

  80. Benouareth A, Ennaji A, Sellami M (2008) Semi-continuous HMMs with explicit state duration for unconstrained Arabic word modeling and recognition. Pattern Recognit Lett 29(12):1742–1752

    MATH  Google Scholar 

  81. Benetos E, Weyde T (2013) Explicit duration hidden Markov Models for multiple-instrument polyphonic music transcription. In: Proceedings of 14th international society for music information retrieval conference (ISMIR), Curitiba, Brazil, 4–8 November, pp 269–274

  82. Yue W, Hong GS, Wong YS (2010) HMM with explicit state duration for prognostics in face milling. In: Proceedings of IEEE conference on robotics, automation and mechatronics (RAM), Singapore, 28–30 June, pp 218–223

  83. Calinon S, Pistillo A, Caldwell DG (2011) Encoding the time and space constraints of a task in explicit-duration hidden Markov model. In: Proceedings of IEEE/RSJ international conference on intelligent robots and systems (IEEEIROS), San Francisco, CA, USA, 25–30 September, pp 3413–3418

  84. Chordia P, Sastry A, entrk S (2011) Predictive Tabla modelling using variable-length Markov and hidden Markov models. J New Music Res 40(2):105–118

    Google Scholar 

  85. Senturk S (2011) Computational modeling of improvisation in Turkish folk music using variable-length Markov models. Master of Science in Music Technology dissertation, Georgia Institute of Technology, Atlanta, Georgia, 1st edn

  86. Senturk S, Chordia P (2011) Modeling melodic improvisation in Turkish folk music using variable-length Markov models. In: Proceedings of 12th international society for music information retrieval conference (ISMIR), Miami, Florida, USA, 24–28 October, pp 269–274

  87. Pikrakis A, Theodoridis S, Kamarotos D (2006) Classification of musical patterns using variable duration hidden Markov models. IEEE Trans Audio Speech Lang Process 14(5):1795–1807

    Google Scholar 

  88. Dumont T (2014) Context tree estimation in variable length hidden Markov models. IEEE Trans Inf Theory 60(6):3196–3208

    MathSciNet  MATH  Google Scholar 

  89. Chen MY, Kundu A, Srihari SN (1995) Variable duration hidden Markov model and morphological segmentation for handwritten word recognition. IEEE Trans Image Process 4(12):1675–1687

    Google Scholar 

  90. Liang YM, Shih SW, Shih ACC, Liao HYM, Lin CC (2009) Learning atomic human actions using variable-length Markov models. IEEE Trans Syst Man Cybern Part B (Cybern) 39(1):268–280

    Google Scholar 

  91. Cao H, Jiang D, Pei J, Chen E, Li H (2009) Towards context-aware search by learning a very large variable length hidden Markov model from search logs. In: Proceedings of the 18th international conference on world wide web (IW3C2), Madrid, Spain, 20–24 April, pp 191–200

  92. Bianne-Bernard AL, Menasri F, Likforman-Sulem L, Mokbel C, Kermorvant C (2012) Variable length and context-dependent HMM letter form models for Arabic handwritten word recognition. In: Proceedings of document recognition and retrieval conference, international society for optics and photonics, Burlingame, California, USA, 22–26 January, pp 1–8

  93. Chen C, Liang J, Zhao H, Hu H, Tian J (2009) Factorial HMM and parallel HMM for gait recognition. IEEE Trans Syst Man Cybern Part C (Appl Rev) 39(1):114–123

    Google Scholar 

  94. Betkowska A, Shinoda K, Furui S (2007) Robust speech recognition using factorial HMMs for home environments. EURASIP J Adv Signal Process 2007(1):1–9

    MATH  Google Scholar 

  95. Ghahramani Z, Jordan MI (1996) Factorial hidden Markov models. Adv Neural Inf Process Syst 9:472–478

    MATH  Google Scholar 

  96. Ozerov A, Fevotte C, Charbit M (2009) Factorial scaled hidden Markov model for polyphonic audio representation and source separation. In: Proceedings of IEEE workshop on applications of signal processing to audio and acoustics (WASPAA), Mohonk, New York, United States, 18–21 October, pp 121–124

  97. Bonfigli R, Principi E, Fagiani M, Severini M, Squartini S, Piazza F (2017) Non-intrusive load monitoring by using active and reactive power in additive Factorial Hidden Markov Models. Appl Energy 208:1590–1607

    Google Scholar 

  98. Khorasani A, Daliri MR, Pooyan M (2016) Recognition of amyotrophic lateral sclerosis disease using factorial hidden Markov model. Biomed Eng 61(1):119–126

    Google Scholar 

  99. Li Z, He Y, Chu F, Han J, Hao W (2006) Fault recognition method for speed-up and speed-down process of rotating machinery based on independent component analysis and Factorial Hidden Markov Model. J Sound Vib 291(1–2):60–71

    Google Scholar 

  100. Husmeier D (2005) Discriminating between rate heterogeneity and interspecific recombination in DNA sequence alignments with phylogenetic factorial hidden Markov models. Bioinformatics 21(2):166–172

    Google Scholar 

  101. Durrieu JL, Thiran JP (2013) Source/filter factorial hidden Markov model, with application to pitch and formant tracking. IEEE Trans Audio Speech Lang Process 21(12):2541–2553

    Google Scholar 

  102. Kolter JZ, Jaakkola T (2012) Approximate inference in additive factorial HMMs with application to energy disaggregation. In: Proceedings of the 15th international conference on artificial intelligence and statistics (AISTATS), La Palma, Canary Islands, 21–23 April, pp 1472–1482

  103. Mari JF, Fohr D, Junqua JC (1996) A second-order HMM for high Performance word and phoneme-based continuous speech recognition. In: Proceedings of IEEE international conference on acoustics, speech, and signal processing (ICASSP), Atlanta, Georgia, USA, 7–10 May, pp 435–438

  104. Sung-Hyun Y, Thapa K, Kabir MH, Hee-Chan L (2018) Log-viterbi algorithm applied on second-order hidden Markov Model for human activity recognition. Int J Distrib Sens Netw 14(4):1–11

    Google Scholar 

  105. Kabir MH, Hoque MR, Thapa K, Yang SH (2016) Two-layer hidden Markov model for human activity recognition in home environments. Int J Distrib Sens Netw 12(1):1–12

    Google Scholar 

  106. Zhou YH, Brooks P, Wang X (2018) A two-stage hidden Markov Model design for biomarker detection, with application to microbiome research. Stat Biosci 10:1–18

    Google Scholar 

  107. Liang W, Zhang Y, Tan J, Li Y (2014) A novel approach to ECG classification based upon two-layered HMMs in body sensor networks. Sensors 14(4):5994–6011

    Google Scholar 

  108. Othman H, Aboulnasr T (2001) A simplified second-order HMM with application to face recognition. In: Proceedings of IEEE international symposium on circuits and systems (ISCAS), Sydney, Australia, May 6–9, pp 161–164

  109. Wu YC, Chen HS, Tsai WJ, Lee SY, Yu JY (2008) Human action recognition based on layered-HMM. In: Proceedings of IEEE international conference on multimedia and expo (ICME), Hanover, Germany, 23–26 June, pp 1453–1456

  110. Zhang D, Gatica-Perez D, Bengio S, McCowan I (2006) Modeling individual and group actions in meetings with layered HMMs. IEEE Trans Multimed 8(3):509–520

    Google Scholar 

  111. Mari JF, Haton JP, Kriouile A (1997) Automatic word recognition based on second-order hidden Markov models. IEEE Trans Speech Audio Process 5(1):22–25

    Google Scholar 

  112. Thede SM, Harper MP (1997) A second-order hidden Markov model for part-of-speech tagging. In: Proceedings of the 37th annual meeting of the Association for Computational Linguistics, California, USA, 6–9 July, pp 175–182

  113. Wei H, He J, Tan J (2011) Layered hidden Markov models for real-time daily activity monitoring using body sensor networks. Knowl Inf Syst 29(2):479–494

    Google Scholar 

  114. Glodek M, Layher G, Schwenker F, Palm G Recognizing human activities using a layered HMM architecture. In: Proceedings of international conference on artificial neural networks (ICANN 2012), Lausanne, Switzerland, September 11–14, pp 677–684

  115. Oliver N, Garg A, Horvitz E (2004) Layered representations for learning and inferring office activity from multiple sensory channels. Comput Vis Image Underst 96(2):163–180

    Google Scholar 

  116. Lee YS, Cho SB (2016) Layered hidden Markov models to recognize activity with built-in sensors on Android smartphone. Pattern Anal Appl 19(4):1181–1193

    MathSciNet  Google Scholar 

  117. Razin YS, Pluckter K, Ueda J, Feigh K (2017) Predicting task intent from surface electromyography using layered hidden Markov models. IEEE Robot Autom Lett 2(2):1180–1185

    Google Scholar 

  118. Glodek M, Bigalke L, Schels M, Schwenker F (2011) Incorporating uncertainty in a layered HMM architecture for human activity recognition. In: Proceedings of joint ACM workshop on Human gesture and behavior understanding, Scottsdale, Arizona, USA, 1 December, pp 33–34

  119. Aarno D, Kragic D (2006) Layered HMM for motion intention recognition. In: Proceedings of IEEE/RSJ international conference on intelligent robots and systems, Beijing, China, 9–15 October, pp 5130–5135

  120. Oliver N, Horvitz E, Garg A (2002) Layered representations for human activity recognition. In: Proceedings of 4th IEEE international conference on multimodal interfaces, Pittsburgh, USA, 14–16 October, pp 3–8

  121. Barnard M, Odobez JM (2005) Sports event recognition using layered HMMs. In: Proceedings of IEEE international conference on multimedia and expo (ICME), Amsterdam, Netherlands, 6–8 July, pp 1150–1153

  122. Zhang C, Qiu J, Zheng S, Yang X (2012) Cross-layered Hidden Markov Modeling for surveillance event recognition. In: Proceedings of IEEE international conference on multimedia and expo workshop (ICMEW), Melbourne, Australia, 9–13 July, pp 175–180

  123. Runsewe O, Samaan N (2017) Cloud resource scaling for big data streaming applications using a layered multi-dimensional hidden Markov model. In: Proceeding of 17th IEEE/ACM international symposium on cluster, cloud and grid computing (CCGRID), Madrid, Spain, 14–17 May, pp 848–857

  124. Solaimanpour S, Doshi P (2017) A layered HMM for predicting motion of a leader in multi-robot settings. In: Proceedings of IEEE international conference on robotics and automation (ICRA), Singapore, 29 May–3 June, pp 788–793

  125. Ingels P (1996) Connected text recognition using layered HMMs and token passing. Arxiv, arXiv preprint cmp-lg/9607036

  126. Perdikis S, Dimitrios T, Strintzis MG (2008) Recognition of humans actions using layered hidden Markov models. In: Proceedings of 1st IAPR workshop on cognitive information processing, Santorini, Greece, 9–10 June, pp 114–119

  127. Guan X, Raich R, Wong WK (2016) Efficient multi-instance learning for activity recognition from time series data using an auto-regressive hidden Markov model. In: Proceedings of 33rd international conference on machine learning, New York, USA, 19–24 June, pp 2330–2339

  128. Stanculescu I, Williams CKI, Freer Y (2014) Autoregressive hidden Markov models for the early detection of neonatal sepsis. IEEE J Biomed Health Inform 18(5):1560–1570

    Google Scholar 

  129. Asahara A, Maruyama K, Shibasaki R (2012) A mixed autoregressive hidden-Markov-chain model applied to people’s movements. In: Proceedings of the 20th international conference on advances in geographic information systems, Redondo Beach, California, 6–9 November, pp 414–417

  130. Dang S, Chaudhury S, Lall B, Roy PK (2017) Learning effective connectivity from fMRI using autoregressive hidden Markov model with missing data. J Neurosci Methods 278(8):87–100

    Google Scholar 

  131. Zhao J, Zhoub J, Su W, Liu F (2017) Online outlier detection for time-varying time series on improved ARHMM in geological mineral grade analysis process. Earth Sci Res J 21(3):135–139

    Google Scholar 

  132. Malesevic N, Markovic D, Kanitz G, Controzzi M, Cipriani C, Antfolk C (2018) Vector Autoregressive Hierarchical Hidden Markov Models for extracting finger movements using multichannel surface EMG signals. Complexity 2018:1–12

    Google Scholar 

  133. Seifert M, Abou-El-Ardat K, Friedrich B, Klink B, Deutsch A (2014) Autoregressive higher-order hidden Markov models: exploiting local chromosomal dependencies in the analysis of tumor expression profiles. PLOS ONE 9(6):1–15

    Google Scholar 

  134. Nakamura E, Cuvillier P, Cont A, Ono N, Sagayama S (2015) Autoregressive hidden semi-Markov model of symbolic music performance for score following. In: Proceedings of 16th international society for music information retrieval conference (ISMIR), Malaga, Spain, 26–30 October

  135. Barber C, Bockhorst J, Roebber P (2010) Auto-regressive HMM inference with incomplete data for short-horizon wind forecasting. In: Proceedings of 24th Advances in neural information processing systems conference, Vancouver, British Columbia, Canada, 6–9 December, pp 136–144

  136. Sasou A, Goto M, Hayamizu S, Tanaka K (2005) An auto-regressive, non-stationary excited signal parameter estimation method and an evaluation of a singing-voice recognition. In: Proceedings of IEEE international conference on acoustics, speech, and signal processing (ICASSP), Philadelphia, Pennsylvania, USA, 18–23 March, pp 237–240

  137. Quillen C (2012) Autoregressive HMM speech synthesis. In: Proceedings of IEEE international conference on acoustics, speech and signal processing (ICASSP), Kyoto, Japan, 25–30 March, pp 4021–4024

  138. Ai B, Fan Z, Gao RX (2014) Occupancy estimation for smart buildings by an auto-regressive hidden Markov model. In: Proceedings of American control conference (ACC), Portland, Oregon, USA, 4–6 June, pp 2234–2239

  139. Dong M (2008) A novel approach to equipment health management based on auto-regressive hidden semi-Markov model (AR-HSMM). Sci China Ser F Inf Sci 51(9):1291–1304

    MathSciNet  MATH  Google Scholar 

  140. Bryan JD, Levinson SE (2015) Autoregressive hidden Markov model and the speech signal. Procedia Comput Sci 61:328–333

    Google Scholar 

  141. Sin B, Kim JH (1995) Nonstationary hidden Markov model. Signal Process 46(1):31–46

    MATH  Google Scholar 

  142. Chen X, Zhang H, MacKenzie AB, Matinmikko M (2014) Predicting spectrum occupancies using a non-stationary hidden Markov model. IEEE Wirel Commun Lett 3(4):333–336

    Google Scholar 

  143. Chatzis SP, Demiris Y (2012) A reservoir-driven non-stationary hidden Markov model. Pattern Recognit 45(11):3985–3996

    MATH  Google Scholar 

  144. Lin HP, Tseng MC (2009) Modelling fading properties for mobile satellite link channels using non-stationary hidden Markov model. IET Microw, Antennas Propag 3(1):171–180

    Google Scholar 

  145. JingHui X, BingQuan L, XiaoLong W (2005) Principles of non-stationary hidden Markov model and its applications to sequence labeling task. In: Proceedings of international conference on natural language processing, Kanpur, India, 18–20 December lecture notes in computer science, vol 3651. Springer, Berlin, pp 827–837

  146. Fine S, Singer Y, Tishby N (1998) The hierarchical hidden Markov model: analysis and applications. Mach Learn 32(1):41–62

    MATH  Google Scholar 

  147. Hierarchal hidden Markov model. https://wikivisually.com/wiki/Hierarchical_ hidden_Markov_model, Accessed on 5 May 5 2019

  148. Kerr R (2011) Melodic analysis using Hierarchical Hidden Markov models, Doctoral dissertation, School of Informatics, The University of Edinburgh, Scotland, 1st edn

  149. Weiland M, Smaill A, Nelson P (2005) Learning musical pitch structures with Hierarchical Hidden Markov model, 1st edn. University of Edinburgh, Scotland

    Google Scholar 

  150. Hoffman MD, Cook PR, Blei DM (2008) Data-driven recomposition using the Hierarchical Dirichlet process hidden Markov model. In: Proceedings of 32nd international computer music conference (ICMC), Belfast, Ireland, UK, 24–29 August, pp 1–7

  151. Patel M, Miro JV, Kragic D, Ek CH, Dissanayake G (2014) Learning object, grasping and manipulation activities using hierarchical HMMs. Auton Robots 37(3):317–331

    Google Scholar 

  152. Martindale CF, Hoenig F, Strohrmann C, Eskofier BM (2017) Smart annotation of cyclic data using hierarchical hidden Markov Models. Sensors 17(10):1–16

    Google Scholar 

  153. Marco E, Meuleman W, Huang J, Glass K, Pinello L, Wang J, Kellis M, Yuan GC (2017) Multi-scale chromatin state annotation using a hierarchical hidden Markov model. Nat Commun 8:1–9

    Google Scholar 

  154. Chen Y, Shen K, Shan SO, Kou SC (2016) Analyzing single-molecule protein transportation experiments via hierarchical hidden Markov models. J Am Stat Assoc 111(515):951–966

    MathSciNet  Google Scholar 

  155. Raman N, Maybank SJ (2016) Activity recognition using a supervised non-parametric hierarchical HMM. Neurocomputing 199:163–177

    Google Scholar 

  156. Karaman S, Benois-Pineau J, Dovgalecs V, Megret R, Pinquier J, Andre-Obrecht R, Gaestel Y, Dartigues JF (2014) Hierarchical Hidden Markov Model in detecting activities of daily living in wearable videos for studies of dementia. Multimed Tools Appl 69(3):743–771

    Google Scholar 

Download references

Acknowledgements

Bhavya Mor was supported under Senior Research Fellowship (SRF) by Human Resource Development (HRD) Group of Council of Scientific and Industrial Research (CSIR), Ministry of Science and Technology, Government of India.

Author information

Authors and Affiliations

  1. Computer Science and Engineering Department, Thapar Institute of Engineering and Technology, Patiala, India

    Bhavya Mor, Sunita Garhwal & Ajay Kumar

Authors
  1. Bhavya Mor
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sunita Garhwal
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ajay Kumar
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ajay Kumar.

Ethics declarations

Conflict of interest

The authors declare that they have no Conflict of interest.

Human and Animal Rights

This work doesn’t have any studies concerning to human or animal topics.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mor, B., Garhwal, S. & Kumar, A. A Systematic Review of Hidden Markov Models and Their Applications. Arch Computat Methods Eng 28, 1429–1448 (2021). https://doi.org/10.1007/s11831-020-09422-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11831-020-09422-4

Search

Navigation