Abstract
Nowadays, with the emergence of new technologies such as smart grid and increasing the use of renewable energy in the grid, energy prediction has become more important in the electricity industry. Furthermore, with growing the integration of power generated from renewable energy sources into grids, an accurate forecasting tool for the reduction in undesirable effects of this scenario is essential. This study has developed a novel approach based on the hidden Markov model (HMM) for forecasting day-ahead solar power. The aim is to find a pattern of solar power changes at a given time in consecutive days. The proposed approach consists of two steps. In the first step, the cosine similarity is used to determine the similarity of solar power variations on consecutive days to a particular vector. In the second step, the obtained information from the first step is fed to HMM as a feature vector. These data are used for training and forecasting day-ahead solar power. After obtaining the preliminary results of the prediction, two known filters are utilized as post-processing to remove spikes and smooth the results. Finally, the performance of the proposed method is tested on real NREL data. No meteorological data (even solar radiation) are used; moreover, the model is fed only from the solar power of the past 23 days. To evaluate the proposed method, a feed-forward neural network and a simple HMM are examined with the same data and conditions. All three methods are tested with and without the post-processing. The results show that the proposed model is superior to other examined methods in terms of accuracy and computational time.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Akarslan E, Hocaoglu FO (2017) A novel method based on similarity for hourly solar irradiance forecasting. Renew Energy 112:337–346. https://doi.org/10.1016/j.renene.2017.05.058
Allouche M, Dahech K, Chaabane M (2018) Multiobjective maximum power tracking control of photovoltaic systems: T–S fuzzy model-based approach. Soft Comput 22:2121–2132. https://doi.org/10.1007/s00500-017-2691-7
Almeida MP, Perpiñán O, Narvarte L (2015) PV power forecast using a nonparametric PV model. Sol Energy 115:354–368. https://doi.org/10.1016/j.solener.2015.03.006
Baum L, Eagon JA (1966) An inequality with applications to statistical estimation for probabilistic functions of a markov process and to a model for ecology. Bull Am Math Soc 3:360–363
Bolturk E, Kahraman C (2018) A novel interval-valued neutrosophic AHP with cosine similarity measure. Soft Comput 22:4941–4958. https://doi.org/10.1007/s00500-018-3140-y
Chen C, Duan S, Cai T, Liu B (2011) Online 24-h solar power forecasting based on weather type classification using artificial neural network. Sol Energy 85:2856–2870. https://doi.org/10.1016/j.solener.2011.08.027
Chou EP, Hsu SM (2018) Cosine similarity as a sample size-free measure to quantify phase clustering within a single neurophysiological signal. J Neurosci Methods 295:111–120. https://doi.org/10.1016/j.jneumeth.2017.12.007
Das UK, Tey KS, Seyedmahmoudian M et al (2018) Forecasting of photovoltaic power generation and model optimization: a review. Renew Sustain Energy Rev 81:912–928. https://doi.org/10.1016/j.rser.2017.08.017
Dempster AP, Laird NM, Rubin DB (1977) Maximum likelihood from incomplete data via the EM algorithm. J R Stat Soc B Methdol 39:1–38
Dong Q, Sun Y, Li P (2017) A novel forecasting model based on a hybrid processing strategy and an optimized local linear fuzzy neural network to make wind power forecasting: a case study of wind farms in China. Renew Energy 102:241–257. https://doi.org/10.1016/j.renene.2016.10.030
Garcia E (2015) Cosine similarity tutorial. In: Inf. Retr. Intell. http://www.minerazzi.com/tutorials/cosine-similarity-tutorial.pdf
Hassan MR (2009) A combination of hidden Markov model and fuzzy model for stock market forecasting. Neurocomputing 72:3439–3446. https://doi.org/10.1016/j.neucom.2008.09.029
Hassan MR, Ramamohanarao K, Kamruzzaman J et al (2013) A HMM-based adaptive fuzzy inference system for stock market forecasting. Neurocomputing 104:10–25. https://doi.org/10.1016/j.neucom.2012.09.017
Hsu YY, Chen WJ, Chen SH, Kao HY (2014) Using hidden Markov models to predict DNA-binding proteins with sequence and structure information. Soft Comput 18:2365–2376. https://doi.org/10.1007/s00500-013-1210-8
Jahromi KG, Jahromi VG (2018) Using discrete hidden Markov model for modelling and forecasting the tourism demand in Isfahan. J Inf Syst Telecommun 6:112–118
Kalhori H, Alamdari MM, Ye L (2018) Automated algorithm for impact force identification using cosine similarity searching. Meas J Int Meas Confed 122:648–657. https://doi.org/10.1016/j.measurement.2018.01.016
Kang J, Feng C, Shao Q, Hu H (2007) Prediction of chatter in machining process based on hybrid SOM-DHMM architecture. In: ICIC 2007, LNAI 4682, pp 1004–1013
Kong X, Liu X, Shi R, Lee KY (2015) Wind speed prediction using reduced support vector machines with feature selection. Neurocomputing 169:449–456. https://doi.org/10.1016/j.neucom.2014.09.090
Larson DP, Nonnenmacher L, Coimbra CFM (2016) Day-ahead forecasting of solar power output from photovoltaic plants in the American Southwest. Renew Energy 91:11–20. https://doi.org/10.1016/j.renene.2016.01.039
Leva S, Dolara A, Grimaccia F et al (2017) Analysis and validation of 24 hours ahead neural network forecasting of photovoltaic output power. Math Comput Simul 131:88–100. https://doi.org/10.1016/j.matcom.2015.05.010
Li Y, He Y, Su Y, Shu L (2016) Forecasting the daily power output of a grid-connected photovoltaic system based on multivariate adaptive regression splines. Appl Energy 180:392–401. https://doi.org/10.1016/j.apenergy.2016.07.052
Liang H, Zhuang W (2014) Stochastic modeling and optimization in a microgrid: a survey. Energies 7:2027–2050. https://doi.org/10.3390/en7042027
Malvoni M, De Giorgi MG, Congedo PM (2016) Photovoltaic forecast based on hybrid PCA–LSSVM using dimensionality reducted data. Neurocomputing 211:72–83. https://doi.org/10.1016/j.neucom.2016.01.104
Massidda L, Marrocu M (2017) Use of multilinear adaptive regression splines and numerical weather prediction to forecast the power output of a PV plant in Borkum, Germany. Sol Energy 146:141–149. https://doi.org/10.1016/j.solener.2017.02.007
Murphy K (1998) Hidden Markov model (HMM) toolbox for matlab. In: MIT Licens. https://www.cs.ubc.ca/~murphyk/Software/HMM/hmm.html. Accessed 22 Dec 2017
NREL (2016) Solar power data for integration studies. In: NREL. https://www.nrel.gov/grid/solar-power-data.html. Accessed 20 Sep 2018
Paramonov P, Sutula N (2016) Simplified scoring methods for HMM-based speech recognition. Soft Comput 20:3455–3460. https://doi.org/10.1007/s00500-015-1831-1
Porkhial S, Kahrobaian A, Monfared M (2009) Development and experimental verification of a new more accurate wind forecasting model. In: European wind energy conference & exhibition 2009 (EWEC 2009). Marseille, France, pp 3946–3954
Prema V, Rao KU (2015) Development of statistical time series models for solar power prediction. Renew Energy 83:100–109. https://doi.org/10.1016/j.renene.2015.03.038
Quan H, Srinivasan D, Khosravi A (2014) Short-term load and wind power forecasting using neural network-based prediction intervals. IEEE Trans Neural Netw Learn Syst 25:303–315. https://doi.org/10.1109/TNNLS.2013.2276053
Rabiner LR (1989) A tutorial on hidden Markov models and selected applications in speech recognition. In: Proceedings of the IEEE
Ramsami P, Oree V (2015) A hybrid method for forecasting the energy output of photovoltaic systems. Energy Convers Manag 95:406–413. https://doi.org/10.1016/j.enconman.2015.02.052
Raza MQ, Nadarajah M, Ekanayake C (2016) On recent advances in PV output power forecast. Sol Energy 136:125–144. https://doi.org/10.1016/j.solener.2016.06.073
Rodriguez H, Flores JJ, Morales LA et al (2018) Forecasting from incomplete and chaotic wind speed data. Soft Comput. https://doi.org/10.1007/s00500-018-3566-2
Shi J, Lee W-J, Liu Y et al (2012) Forecasting power output of photovoltaic systems based on weather classification and support vector machines. IEEE Trans Ind Appl 48:1064–1069. https://doi.org/10.1109/TIA.2012.2190816
Shrivastava NA, Lohia K, Panigrahi BK (2016) A multiobjective framework for wind speed prediction interval forecasts. Renew Energy 87:903–910. https://doi.org/10.1016/j.renene.2015.08.038
Sobri S, Koohi-Kamali S, Rahim NA (2018) Solar photovoltaic generation forecasting methods: a review. Energy Convers Manag 156:459–497. https://doi.org/10.1016/j.enconman.2017.11.019
Tian C, Li C, Zhang G, Lv Y (2019) Data driven parallel prediction of building energy consumption using generative adversarial nets. Energy Build 186:230–243. https://doi.org/10.1016/J.ENBUILD.2019.01.034
Viterbi AJ (1967) Error bounds for convolutional codes and an asymptotically optimum decoding algorithm. IEEE Trans Inf Theory 13:260–269
Woodruff DL, Deride J, Staid A et al (2018) Constructing probabilistic scenarios for wide-area solar power generation. Sol Energy 160:153–167. https://doi.org/10.1016/j.solener.2017.11.067
Yang H-T, Huang C-M, Huang Y-C, Pai Y-S (2014) A weather-based hybrid method for 1-day ahead hourly forecasting of PV power output. IEEE Trans Sustain Energy 5:917–926. https://doi.org/10.1109/TSTE.2014.2313600
Yao X, Wang Z, Zhang H (2019) A novel photovoltaic power forecasting model based on echo state network. Neurocomputing 325:182–189. https://doi.org/10.1016/j.neucom.2018.10.022
Yona A, Senjyu T, Funabashi T, Kim CH (2013) Determination method of insolation prediction with fuzzy and applying neural network for long-term ahead PV power output correction. IEEE Trans Sustain Energy 4:527–533. https://doi.org/10.1109/TSTE.2013.2246591
Zadpoor AA, Golshan AH (2004) Development of a climate pattern for design and analysis of multiple-stage evaporative cooling systems. In: eSim 2004 building energy simulation conference. Vancouver, Canada, pp 111–118
Zeng J, Qiao W (2013) Short-term solar power prediction using a support vector machine. Renew Energy 52:118–127. https://doi.org/10.1016/j.renene.2012.10.009
Zhang Y, Beaudin M, Taheri R et al (2015) Day-ahead power output forecasting for small-scale solar photovoltaic electricity generators. IEEE Trans Smart Grid 6:2253–2262. https://doi.org/10.1109/TSG.2015.2397003
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Ethical approval
This article does not contain any studies with human participants or animals performed by any of the authors.
Additional information
Communicated by V. Loia.
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Ghasvarian Jahromi, K., Gharavian, D. & Mahdiani, H. A novel method for day-ahead solar power prediction based on hidden Markov model and cosine similarity. Soft Comput 24, 4991–5004 (2020). https://doi.org/10.1007/s00500-019-04249-z
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00500-019-04249-z