Skip to main content
SpringerLink
Log in

Early classification of multivariate data by learning optimal decision rules

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Early classification on time series has emerged as an active research area in the field of machine learning. It covers a wide range of applications in agriculture, medical and multimedia systems, including drought prediction, health monitoring, event detection, and many more. The early classification aims to predict the class label of a time series as soon as possible without waiting for the complete series. A critical issue in early classification is the learning of decision policy that determines the adequacy of the collected data required for reliable class prediction. It is more challenging for Multivariate Time Series (MTS) data, where the decision depends on multiple variables to achieve a trade-off between earliness and accuracy. Therefore, this work proposes an optimization-based early classification model for MTS data based on optimal decision rule learning. The proposed model adopts a two-layered approach. The first layer employs the Gaussian process probabilistic classifiers for each variable in MTS that provides the class probabilities at the successive time steps in the series. The second layer defines Early Stopping Rule (ESR) that performs the class prediction task. The ESR learns its parameters through the particle swarm optimization by simultaneously minimizing the misclassification cost and delaying the decision cost. This work has utilized publicly available MTS datasets to validate the proposed early classification model. The experimental results show that the proposed model achieves promising results in terms of accuracy and earliness compared to existing methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Arzani MM, Fathy M, Azirani AA, Adeli E (2020) Skeleton-based structured early activity prediction. Multimedia Tools and Applications

  2. Bagnall A, Lines J, Bostrom A, Large J, Keogh E (2016) The great time series classification bake off: a review and experimental evaluation of recent algorithmic advances. Data Min Knowl Disc 31(3):606–660

    Article  MathSciNet  Google Scholar 

  3. Baydogan MG (2015) Multivariate time series classification datasets. http://www.mustafabaydogan.com

  4. Bendtsen C (2012) pso: Particle Swarm Optimization. R package version 1.0.3

  5. Bregón A, Simón MA, Rodríguez JJ, Alonso C, Pulido B, Moro I (2006) Early fault classification in dynamic systems using case-based reasoning. In: Current topics in artificial intelligence, Springer, Berlin pp 211–220

  6. Chen Y, Keogh E, Hu B, Begum N, Bagnall A, Mueen A, Batista G (2015) The ucr time series classification archive. www.cs.ucr.edu/eamonn/time_series_data/

  7. Dachraoui A, Bondu A, Cornuéjols A (2015) Early classification of time series as a non myopic sequential decision making problem. In: Machine learning and knowledge discovery in databases, Springer International Publishing, pp 433–447

  8. Dua D, Graff C (2017) UCI machine learning repository. http://archive.ics.uci.edu/ml

  9. Ghalwash MF, Radosavljevic V, Obradovic Z (2014) Utilizing temporal patterns for estimating uncertainty in interpretable early decision making. In: Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining - KDD ’14, ACM Press

  10. Ghalwash MF, Obradovic Z (2012) Early classification of multivariate temporal observations by extraction of interpretable shapelets. BMC Bioinforma 13 (1):195

    Article  Google Scholar 

  11. González CJA, Diez JJR (2004) boosting interval - based literals: variable length and early classification. In: Series in machine perception and artificial intelligence, WORLD SCIENTIFIC, pp 149–171

  12. Gupta A, Gupta HP, Biswas B, Dutta T (2020) An early classification approach for multivariate time series of on-vehicle sensors in transportation. IEEE Trans Intell Transp Syst, pp 1–12

  13. Hassan R, Cohanim B, de Weck O, Venter G (2005) A comparison of particle swarm optimization and the genetic algorithm. In: 46th AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics and Materials Conference, American Institute of Aeronautics and Astronautics

  14. He G, Duan Y, Peng R, Jing X, Qian T, Wang L (2015) Early classification on multivariate time series. Neurocomputing 149:777–787

    Article  Google Scholar 

  15. He G, Zhao W, Xia X, Peng R, Wu X (2018) An ensemble of shapelet-based classifiers on inter-class and intra-class imbalanced multivariate time series at the early stage. Soft Comput 23(15):6097–6114

    Article  Google Scholar 

  16. He G, Zhao W, Xia X (2019) Confidence-based early classification of multivariate time series with multiple interpretable rules. Pattern Analysis and Applications

  17. Hoai M, la Torre FD (2013) Max-margin early event detectors. Int J Comput Vis 107(2):191–202

    Article  MathSciNet  Google Scholar 

  18. Hsu EY, Liu CL, Tseng VS (2019) Multivariate time series early classification with interpretability using deep learning and attention mechanism. In: Advances in knowledge discovery and data mining, Springer International Publishing, pp 541–553

  19. Kate RJ (2015) Using dynamic time warping distances as features for improved time series classification. Data Min Knowl Disc 30(2):283–312

    Article  MathSciNet  Google Scholar 

  20. Lama N, Mark G (2016) vbmp: Variational Bayesian Multinomial Probit Regression, R package version 1.42.0

  21. Li S, Li K, Fu Y (2018) Early recognition of 3d human actions. ACM Transactions on Multimedia Computing, Communications, and Applications 14(1s):1–21

    Article  Google Scholar 

  22. Lin YF, Chen HH, Tseng VS, Pei J (2015) Reliable early classification on multivariate time series with numerical and categorical attributes. In: Advances in knowledge discovery and data mining, Springer International Publishing, pp 199–211

  23. Lv J, Hu X, Li L, Li P (2019) An effective confidence-based early classification of time series. IEEE Access 7:96,113–96,124

    Article  Google Scholar 

  24. Ma C, Weng X, Shan Z (2017) Early classification of multivariate time series based on piecewise aggregate approximation. In: Health information science, Springer International Publishing, pp 81–88

  25. Mori U, Mendiburu A, Keogh E, Lozano JA (2016) Reliable early classification of time series based on discriminating the classes over time. Data Min Knowl Disc 31(1):233–263

    Article  MathSciNet  Google Scholar 

  26. Mori U, Mendiburu A, Dasgupta S, Lozano JA (2018) Early classification of time series by simultaneously optimizing the accuracy and earliness. IEEE Transactions on Neural Networks and Learning Systems 29(10):4569–4578

    Article  Google Scholar 

  27. Ng AY (2004) Feature selection, l1 vs. l2 regularization, and rotational invariance. In: Twenty-first international conference on Machine learning - ICML’04, ACM Press

  28. Olszewski RT (2001) Generalized feature extraction for structural pattern recognition in time-series data. Tech. rep., CARNEGIE-MELLON UNIV PITTSBURGH PA SCHOOL OF COMPUTER SCIENCE

  29. Parsopoulos K, Vrahatis M (2002) Recent approaches to global optimization problems through particle swarm optimization. Nat Comput 1(2):235–306

    Article  MathSciNet  Google Scholar 

  30. Richhariya B, Tanveer M (2018) EEG Signal classification using universum support vector machine. Expert Syst Appl 106:169–182

    Article  Google Scholar 

  31. Rußwurm M, Tavenard R, Lefèvre S, Körner M (2019) Early classification for agricultural monitoring from satellite time series 1908.10283v1

  32. Santos T, Kern R (2016) A literature survey of early time series classification and deep learning. In: Sami@ iknow

  33. Sharma A, Singh SK (2019) Early classification of time series based on uncertainty measure. In: 2019 IEEE Conference on Information and Communication Technology, IEEE

  34. Sharma A, Singh SK (2020) A novel approach for early malware detection. Transactions on Emerging Telecommunications Technologies https://doi.org/10.1002/ett.3968

  35. Tavenard R, Malinowski S (2016) Cost-aware early classification of time series. In: Machine learning and knowledge discovery in databases, Springer International Publishing, pp 632–647

  36. Williams CK, Rasmussen CE (2006) Gaussian processes for machine learning 3. MIT Press, Cambridge

    MATH  Google Scholar 

  37. Xing Z, Pei J, Yu PS (2011) Early classification on time series. Knowl Inf Syst 31(1):105–127

    Article  Google Scholar 

  38. Xing Z, Pei J, Yu PS, Wang K (2011) Extracting interpretable features for early classification on time series. In: Proceedings of the 2011 SIAM international conference on data mining, SIAM, pp 247–258

  39. Yao L, Li Y, Li Y, Zhang H, Huai M, Gao J, Zhang A (2019) DTEC: Distance Transformation based early time series classification. In: Proceedings of the 2019 SIAM international conference on data mining, Society for Industrial and Applied Mathematics, pp 486–494

  40. Zhao L, Liang H, Yu D, Wang X, Zhao G (2019) Asynchronous Multivariate time series early prediction for ICU transfer. In: Proceedings of the 2019 International Conference on Intelligent Medicine and Health - ICIMH 2019, ACM Press

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, Indian Institute of Technology (BHU), Varanasi, 221005, Uttar Pradesh, India

    Anshul Sharma & Sanjay Kumar Singh

Authors
  1. Anshul Sharma
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sanjay Kumar Singh
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Anshul Sharma.

Ethics declarations

Conflict of interests

The authors declare that they have no conflict of interest.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sharma, A., Singh, S.K. Early classification of multivariate data by learning optimal decision rules. Multimed Tools Appl 80, 35081–35104 (2021). https://doi.org/10.1007/s11042-020-09366-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-09366-8

Keywords

Search

Navigation