Skip to main content
Log in

Using model’s temporal features and hierarchical structure for similar activity recognition

  • Original Research
  • Published:
Journal of Ambient Intelligence and Humanized Computing Aims and scope Submit manuscript

Abstract

Using Sensor-based approach in activity recognition usually requires the deployment of many ambient sensors to objects and environments. Each sensor can be triggered by more than one activity, e.g., a touch sensor of a cooker can be triggered by cooking, doing dish and so on. An activity consists of some sensor events. When the number of same sensors are in the majority of two activities, the two activities are defined as similar activities which are difficult to distinguish. To address the challenge of recognizing similar activities, this paper conceives a new activity recognition approach incorporating high-dimensional features of duration and time block characteristics to improve the inference performance. In a further step, we take advantage of these similar activities to build a hierarchical structure model which can improve capacities of expandability and standardization. We design experiments of similar activity in our daily life to evaluate this solution. The results show that high-dimensional temporal features improved similar activity inference accuracy on an average of 1.88 times, and the use of hierarchical structure can generalize specific rules to standard ones which decreases similar activity recognition computation time on an average of 0.36 times.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  • Brostow GJ, Shotton J, Fauqueur J, Cipolla R (2008) Segmentation and recognition using structure from motion point clouds. In: Forsyth D, Torr P, Zisserman A (eds) Computer vision—ECCV 2008. Springer, Berlin, pp 44–57

    Chapter  Google Scholar 

  • Chahuara P, Fleury A, Portet F, Vacher M (2012) Using markov logic network for on-line activity recognition from non-visual home automation sensors. In: Paternò F, de Ruyter B, Markopoulos P, Santoro C, van Loenen E, Luyten K (eds) Ambient intelligence. Springer, Berlin, pp 177–192

    Chapter  Google Scholar 

  • Chamroukhi F, Mohammed S, Trabelsi D, Oukhellou L, Amirat Y (2013) Joint segmentation of multivariate time series with hidden process regression for human activity recognition. Neurocomputing 120:633–644

    Article  Google Scholar 

  • Chen L, Nugent C (2009) Ontology based activity recognition in intelligent pervasive environments. Int J Web Inf Syst 5(4):410–430

    Article  Google Scholar 

  • Cook DJ, Crandall AS, Thomas BL, Krishnan NC (2013) Casas: a smart home in a box. Computer 46(7):62–69

    Article  Google Scholar 

  • Domingos P, Lowd D (2009) Markov logic: an interface layer for artificial intelligence. Synth Lect Artif Intell Mach Learn 3(1):1–155

    MATH  Google Scholar 

  • Domingos P, Kok S, Lowd D, Poon H, Richardson M, Singla P (2008) Markov logic. Probabilistic inductive logic programming. Springer, Berlin, pp 92–117

    Book  MATH  Google Scholar 

  • Duong TV, Phung DQ, Bui HH, Venkatesh S (2006) Human behavior recognition with generic exponential family duration modeling in the hidden semi-Markov model. In: 18th International Conference on Pattern Recognition (ICPR’06). IEEE, Hong Kong, China, pp 202–207

  • Duong T, Phung D, Bui H, Venkatesh S (2009) Efficient duration and hierarchical modeling for human activity recognition. Artif Intell 173(7):830–856

    Article  Google Scholar 

  • Gao L, Bourke A, Nelson J (2014) Evaluation of accelerometer based multi-sensor versus single-sensor activity recognition systems. Med Eng Phys 36(6):779–785

    Article  Google Scholar 

  • Gayathri KS, Elias S, Ravindran B (2015) Hierarchical activity recognition for dementia care using markov logic network. Person Ubiquitous Comput 19(2):271–285

    Article  Google Scholar 

  • Gayathri K, Easwarakumar K, Elias S (2017) Probabilistic ontology based activity recognition in smart homes using markov logic network. Knowl Based Syst 121:173–184

    Article  Google Scholar 

  • Helaoui R, Niepert M, Stuckenschmidt H (2011) Recognizing interleaved and concurrent activities using qualitative and quantitative temporal relationships. Perv Mob Comput 7(6):660–670

    Article  Google Scholar 

  • Hooda D, Rani R (2020) Ontology driven human activity recognition in heterogeneous sensor measurements. J Ambient Intell Humanized Comput. https://doi.org/10.1007/s12652-020-01835-0

    Article  Google Scholar 

  • Junhuai L, Ling T, Huaijun W, Yang A, Kan W, Lei Y (2019) Segmentation and recognition of basic and transitional activities for continuous physical human activity. IEEE Access 7:42565–42576

    Article  Google Scholar 

  • Liu L, Peng Y, Liu M, Huang Z (2015) Sensor-based human activity recognition system with a multilayered model using time series shapelets. Knowl Based Syst 90:138–152

    Article  Google Scholar 

  • Liu L, Cheng L, Liu Y, Jia Y, Rosenblum DS (2016) Recognizing complex activities by a probabilistic interval-based model. In: Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence, AAAI Press, AAAI’16, Phoenix, Arizona, USA, pp 1266–1272

  • Machot FA, Mayr HC, Ranasinghe S (2016) A windowing approach for activity recognition in sensor data streams. In: 2016 Eighth International Conference on Ubiquitous and Future Networks (ICUFN). IEEE, Vienna, Austria, pp 951–953

  • Meditskos G, Dasiopoulou S, Efstathiou V, Kompatsiaris I (2013) Sp-act: a hybrid framework for complex activity recognition combining owl and sparql rules. In: 2013 IEEE International Conference on Pervasive Computing and Communications Workshops (PERCOM Workshops). IEEE, San Diego, CA, USA, pp 25–30

  • Moutacalli T, Bouchard B, Bouzouane A (2015) The behavioral profiling based on times series forecasting for smart homes assistance. J Ambient Intell Hum Comput 6(5):647–659

    Article  Google Scholar 

  • Nazerfard E (2018) Temporal features and relations discovery of activities from sensor data. J  Ambient Intell Humanized Comput. https://doi.org/10.1007/s12652-018-0855-7

    Article  Google Scholar 

  • Okeyo G, Chen L, Wang H (2014a) Combining ontological and temporal formalisms for composite activity modelling and recognition in smart homes. Future Gen Comput Syst 39:29–43

    Article  Google Scholar 

  • Okeyo G, Chen L, Wang H, Sterritt R (2014b) Dynamic sensor data segmentation for real-time knowledge-driven activity recognition. Perv Mob Comput 10:155–172

    Article  Google Scholar 

  • Ordóñez FJ, De Toledo P, Sanchis A (2013) Activity recognition using hybrid generative/discriminative models on home environments using binary sensors. Sensors 13(5):5460–5477

    Article  Google Scholar 

  • Pansiot J, Stoyanov D, McIlwraith D, Lo BP, Yang GZ (2007) Ambient and wearable sensor fusion for activity recognition in healthcare monitoring systems. In: Leonhardt S, Falck T, Mähönen P (eds) 4th international workshop on wearable and implantable body sensor networks (BSN 2007). Springer, Berlin, pp 208–212

    Chapter  Google Scholar 

  • Riboni D, Bettini C (2011) Cosar: hybrid reasoning for context-aware activity recognition. Person Ubiquitous Comput 15(3):271–289

    Article  Google Scholar 

  • Ryoo MS, Aggarwal JK (2009) Semantic representation and recognition of continued and recursive human activities. Int J Comput Vis 82(1):1–24

    Article  Google Scholar 

  • Saguna S, Zaslavsky A, Chakraborty D (2013) Complex activity recognition using context-driven activity theory and activity signatures. ACM Trans Comput Hum Interact 20(6):1–34

    Article  Google Scholar 

  • Singla P, Domingos P (2005) Discriminative training of markov logic networks. In: Proceedings of the 20th National Conference on Artificial Intelligence, vol 2, AAAI Press, AAAI’05, Pittsburgh, Pennsylvania, USA, pp 868–873

  • Suryadevara NK, Mukhopadhyay SC (2014) Determining wellness through an ambient assisted living environment. IEEE Intell Syst 29(3):30–37

    Article  Google Scholar 

  • Tahir SF, Fahad L, Kifayat K (2019) Key feature identification for recognition of activities performed by a smart-home resident. J Ambient Intell Humanized Comput. https://doi.org/10.1007/s12652-019-01236-y

    Article  Google Scholar 

  • Tran SD, Davis LS (2008) Event modeling and recognition using markov logic networks. In: Forsyth D, Torr P, Zisserman A (eds) Computer vision—ECCV 2008. Springer, Berlin, pp 610–623

    Chapter  Google Scholar 

  • Yan S, Liao Y, Feng X, Liu Y (2016) Real time activity recognition on streaming sensor data for smart environments. In: 2016 International Conference on Progress in Informatics and Computing (PIC). IEEE, Shanghai, China, pp 51–55

  • Ye J, Stevenson G, Dobson S (2015) Kcar: a knowledge-driven approach for concurrent activity recognition. Perv Mob Comput 19:47–70

    Article  Google Scholar 

  • Zhang S, McClean S, Scotney B, Chaurasia P, Nugent C (2010) Using duration to learn activities of daily living in a smart home environment. In: 2010 4th International Conference on Pervasive Computing Technologies for Healthcare. IEEE, Munich, Germany, pp 1–8

  • Zhang Y, Zhang Y, Swears E, Larios N, Wang Z, Ji Q (2013) Modeling temporal interactions with interval temporal bayesian networks for complex activity recognition. IEEE Trans Pattern Anal Mach Intell 35(10):2468–2483

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Huansheng Ning.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

This work was supported by the National Natural Science Foundation of China (61872038 and 61811530335), and UK Royal Society-Newton Mobility Grant (No. IEC\(\backslash\)NSFC\(\backslash\)170067), and Civil Aviation Joint Funds of the National Natural Science Foundation of China (Grant No. U1633121)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Li, Q., Ning, H., Mao, L. et al. Using model’s temporal features and hierarchical structure for similar activity recognition. J Ambient Intell Human Comput 14, 5239–5248 (2023). https://doi.org/10.1007/s12652-020-02035-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12652-020-02035-6

Keywords

Navigation