Abstract
Anomaly detection in power consumption data can be very useful to building managers. It allows them to detect unexpected power consumption values, identify unusual behaviors, and foresee uncommon events. This paper proposes a novel unsupervised approach to detect anomalies in power consumption data. We combine the clustering-based methods with the prediction-based ones to learn typical behavior scenarios and to predict the power consumption of the next hour. These scenarios are explored by applying the K-means algorithm on 24 different K-means groups representing the 24 h of the day. This is based on the assumption that identical daily consumption behavior can appear repeatedly due to users’ living habits. In order to detect the anomaly 1 h before its occurrence, a Long Short-Term Memory (LSTM) has been trained to predict the next power consumption value. This predicted value with some earlier data values are concatenated into a vector then compared with the learned typical scenarios. We used Auto-Encoders to detect anomalous days in general and this novel method to specify at what time the anomaly has occurred. Our approach not only detectss anomalies in off-line mode but also allows real-time detection on live data streams.
This is a preview of subscription content, log in via an institution to check access.
References
Energy Renewable. (2010). Energy efficiency trends in residential and commercial buildings.
UNEP. (2017). UNEP, United Nations Environment Program. https://www.tandfonline.com/doi/full/10.1080/09613218.2017.1356127.
Abraham, B., & Box, G.E.P. (1979). Bayesian analysis of some outlier problems in time series. Biometrika, 66(2), 229–236. 10.1093/biomet/66.2.229.
Abraham, B., & Chuang, A. (1989). Outlier detection and time series modeling. Technometrics, 31(2), 241–248. https://doi.org/10.1080/00401706.1989.10488517. https://amstat.tandfonline.com/doi/abs/10.1080/00401706.1989.10488517.
Antmann, P. (2009). Reducing technical and non-technical losses in the power sector. World Bank. http://documents.worldbank.org/curated/en/829751468326689826.
Bengio, Y. (2009). Learning deep architectures for AI. Foundations and Trends® in Machine Learning, 2(1), 1–127. ISSN 1935-8237. https://doi.org/10.1561/2200000006.
Box, G.E., Jenkins, G.M., Reinsel, G.C., & Ljung, G.M. (2015). Time series analysis: forecasting and control. John Wiley & Sons.
Chandola, V., Banerjee, A., & Kumar, V. (2009). Anomaly detection: a survey. ACM Comput. Surv., 41(3), 15:1–15:58. ISSN 0360-0300. https://doi.org/10.1145/1541880.1541882.
Chou, J.-S., & Telaga, A.S. (2014). Real-time detection of anomalous power consumption. Renewable and Sustainable Energy Reviews, 33, 400–411. ISSN 1364-0321. https://doi.org/10.1016/j.rser.2014.01.088. http://www.sciencedirect.com/science/article/pii/S1364032114001142.
Frigge, M., Hoaglin, D.C., & Iglewicz, B. (1989). Some implementations of the boxplot. The American Statistician, 43(1), 50–54. https://doi.org/10.1080/00031305.1989.10475612. https://www.tandfonline.com/doi/abs/10.1080/00031305.1989.10475612.
Hochreiter, S., & Schmidhuber, J. (1997). Long short-term memory. Neural Computation, 9(8), 1735–1780. https://doi.org/10.1162/neco.1997.9.8.1735.
Jokar, P., Arianpoo, N., & Leung, V.C. (2015). Electricity theft detection in ami using customers’ consumption patterns. IEEE Transactions on Smart Grid, 7(1), 216–226.
Lee, W., Stolfo, S.J., Chan, P.K., Eskin, E., Fan, W., Miller, M., Hershkop, S., & Zhang, J. (2001). Real time data mining-based intrusion detection. In DARPA Information Survivability Conference & Exposition II, 2001. DISCEX ’01. Proceedings. https://doi.org/10.1109/DISCEX.2001.932195, (Vol. 1 pp. 89–100).
Liu, F., Jiang, H., Lee, Y.M., Snowdon, J.L., & Bobker, M. (2011). Statistical modeling for anomaly detection forecasting and root cause analysis of energy consumption for a portfolio of buildings.
Nadai, M.D., & van Someren, M. (2015). Short-term anomaly detection in gas consumption through ARIMA and artificial neural network forecast. In: 2015 IEEE Workshop on Environmental, Energy, and Structural Monitoring Systems (EESMS) Proceedings, pp 250–255. https://doi.org/10.1109/EESMS.2015.7175886.
Soheily-Khah, S., Douzal-Chouakria, A., & Gaussier, E. (2016). Generalized k-means-based clustering for temporal data under weighted and kernel time warp. Pattern Recognition Letters, 75, 63–69. ISSN 0167-8655. https://doi.org/10.1016/j.patrec.2016.03.007.
Zhang, Y., Chen, W., & Black, J. (2011). Anomaly detection in premise energy consumption data. In 2011 IEEE Power and Energy Society General Meeting. https://doi.org/10.1109/PES.2011.6039858 (pp. 1–8).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Chahla, C., Snoussi, H., Merghem, L. et al. A deep learning approach for anomaly detection and prediction in power consumption data. Energy Efficiency 13, 1633–1651 (2020). https://doi.org/10.1007/s12053-020-09884-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12053-020-09884-2