Skip to main content

Advertisement

SpringerLink
Log in

The Training of Pi-Sigma Artificial Neural Networks with Differential Evolution Algorithm for Forecasting

  • Published:
Computational Economics Aims and scope Submit manuscript

Abstract

Looking at the artificial neural networks’ literature, most of the studies started with feedforward artificial neural networks and the training of many feedforward artificial neural networks models are performed with derivative-based algorithms such as levenberg–marquardt and back-propagation learning algorithms in the first studies. In recent years, although many new heuristic algorithms have been proposed for different aims these heuristic algorithms are also frequently used in the training process of many different artificial neural network models. Pi-sigma artificial neural networks have different importance than many artificial neural network models with its higher-order network structure and superior forecasting performance. In this study, the training of Pi-Sigma artificial neural networks is performed by differential evolution algorithm uses DE/rand/1 mutation strategy. The performance of the proposed method is evaluated by two data sets and seen that the proposed method has a very effective performance compared with many artificial neural network models.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  • Akdeniz, E., Egrioglu, E., Bas, E., & Yolcu, U. (2018). An ARMA type pi-sigma artificial neural network for nonlinear time series forecasting. Journal of Artificial Intelligence and Soft Computing Research, 8(2), 121–132.

    Article  Google Scholar 

  • Akram, U., Ghazali, R., Ismail, L. H., Zulqarnain, M., Husaini, N. A., & Mushtaq, M. F. (2019). An improved pi-sigma neural network with error feedback for physical time series prediction. International Journal of Advanced Trends in Computer Science and Engineering, 8, 276–284.

    Article  Google Scholar 

  • Aladag, C. H., Yolcu, U., & Egrioglu, E. (2013). A new multiplicative seasonal neural network model based on particle swarm optimization. Neural Processing Letters, 37(3), 251–262.

    Article  Google Scholar 

  • Bas, E. (2016). The training of multiplicative neuron model based artificial neural networks with differential evolution algorithm for forecasting. Journal of Artificial Intelligence and Soft Computing Research, 6(1), 5–11.

    Article  Google Scholar 

  • Bas, E., Yolcu, U., Egrioglu, E., Cagcag Yolcu, O., & Dalar, A. Z. (2016). Single multiplicative neuron model artificial neuron network trained by bat algorithm for time series forecasting. American Journal of Intelligent Systems, 6(3), 74–77.

    Google Scholar 

  • Bas, E., Grosan, C., Egrioglu, E., & Yolcu, U. (2018). High order fuzzy time series method based on pi-sigma neural network. Engineering Applications of Artificial Intelligence, 72, 350–356.

    Article  Google Scholar 

  • Cagcag Yolcu, O., Bas, E., Egrioglu, E., & Yolcu, U. (2018). Single Multiplicative Neuron Model Artificial Neural Network with Autoregressive Coefficient for Time Series Modelling. Neural Processing Letters, 47, 1133–1147.

    Article  Google Scholar 

  • Dash, R., Routray, A., Rautray, R., & Dash, R. (2018). Gold price prediction using an evolutionary pi-sigma neural network. International Journal of Engineering & Technology, 7, 742–746.

    Article  Google Scholar 

  • Deepa, M., Rajalakshmi, M., & Nedunchezhian, R. (2018). Higher order neural networks based on bioinspired swarm intelligence optimization algorithm for multimodal tumor data analysis. Biomedical Research Special Issue, 29, 113–117.

    Google Scholar 

  • Egrioglu, E., Aladag, C.H., Yolcu, U., Bas, E., Dalar, A.Z.: A new neural network model with deterministic trend and seasonality components for time series forecasting. In: Advances in time series forecasting, Vol 2, Chapter 4, Bentham, 76–92. (2017)

  • Egrioglu, E., Aladag, C. H., Yolcu, U., & Bas, E. (2015). Recurrent multiplicative neuron model artificial neural network for non-linear time series forecasting. Neural Processing Letters, 41(2), 249–258.

    Article  Google Scholar 

  • Elman, J. L. (1990). Finding Structure in Time. Cognitive Science, 14(2), 179–211.

    Article  Google Scholar 

  • Ghazali, R., & Jumeily, D. A. (2009). Application of Pi-Sigma neural networks and ridge polynomial neural networks to financial time series prediction. Artificial Higher Order Neural Networks for Economics and Business, Chapter, 12, 271–293.

    Article  Google Scholar 

  • Giles, C. L., & Maxwell, T. (1987). Learning, invariance, and generalization in high-order neural networks. Applied Optics, 26, 4972–4978.

    Article  Google Scholar 

  • Giles, C. L., Griffin, R., & Maxwell, T. (1988). Application of Pi-Sigma neural networks and ridge polynomial neural networks to financial time series prediction (pp. 301–309). New York: American Institute of Physics.

    Google Scholar 

  • Guler, M., Sahin, E.: A binary-input supervised neural unit that forms input dependent higher-order synaptic correlations, Proceedings of world congress on neural networks III. pp 730–735. (1994)

  • Gundogdu, O., Egrioglu, E., Aladag, C. H., & Yolcu, U. (2015). Multiplicative neuron model artificial neural network based on gauss activation function. Neural Computing and Applications, 27(4), 927–935.

    Article  Google Scholar 

  • Husaini, N. A., Ghazali, R., Nawi, M. N., & Ismail, L. H. (2011). Pi-Sigma neural network for temperature forecasting in batu pahat. In J. M. Zain, W. M. Wan Mohd, & E. El-Qawasmeh (Eds.), Software Engineering and Computer Systems. Communications in Computer and Information Science. Berlin Heidelberg: Springer.

    Google Scholar 

  • Husaini, N. A., Ghazali, R., Nawi, M. N., & Ismail, L. H. (2012). The Effect of Network Parameters on Pi-Sigma Neural Network for Temperature Forecasting. International Journal of Modern Physics: Conference Series, 9, 440–447.

    Google Scholar 

  • Husaini, N. A., Ghazali, R., Nawi, M. N., Ismail, L. H., Deris, M. M., & Herawan, T. (2014). Pi-Sigma neural network for a one-step-ahead temperature forecasting. International Journal of Computational Intelligence and Applications, 13(4), 1450023.

    Article  Google Scholar 

  • Kelwade, J. P., & Salankar, S. S. (2017). Training of multilayer perceptrons with improved particle swarm optimization for the heart diseases prediction. International Journal of Swarm Intelligence and Evolutionary Computation, 6(2), 1–8.

    Google Scholar 

  • Kocak, C., Dalar, A. Z., Cagcag Yolcu, O., Bas, E., & Egrioglu, E. (2020). A new fuzzy time series method based on an ARMA-Type recurrent Pi-Sigma artificial neural network. Soft Computing, 24, 8243–8252.

    Article  Google Scholar 

  • Li, X. B. (2009). RBF neural network optimized by particle swarm optimization for forecasting urban traffic flow. In Proceedings of the third international symposium on intelligent technology application, (pp. 124–127).

  • McCulloch, W. S., & Pitts, W. A. (1943). A logical calculus of the ideas immanent in nervous activity. Buttetin of Mathematics and Biophysics, 5, 115–133.

    Article  Google Scholar 

  • Mohamed, K. S., Liu, Y., Wu, W., & Alemu, H. Z. (2016). Batch gradient method for training of Pi-Sigma neural network with penalty. International Journal of Artificial Intelligence & Applications (IJAIA), 7(1), 11–20.

    Article  Google Scholar 

  • Nayak, S. C. (2017). Development and performance evaluation of adaptive hybrid higher order neural networks for exchange rate prediction. International Journal of Intelligent Systems and Applications, 9(8), 71–85.

    Article  Google Scholar 

  • Nayak, S. C. (2020). A fireworks algorithm-based Pi-Sigma neural network (FWA-PSNN) for modelling and forecasting chaotic crude oil price time series. EAI Endorsed Transactions on Energy Web. https://doi.org/10.4108/eai.13-7-2018.162803.

    Article  Google Scholar 

  • Nayak, S. C., & Ansari, M. D. (2020). Cooperative optimization algorithm based higher order neural networks for stock forecasting. Recent Advances in Computer Science and Communications.. https://doi.org/10.2174/2213275912666190902121153.

    Article  Google Scholar 

  • Nayak, J., Naik, B., & Behera, H. S. (2015). A Novel Chemical Reaction Optimization Based Higher Order Neural Network (CRO-HONN) For nonlinear classification. Ain Shams Engineering Journal, 6, 1069–1091.

    Article  Google Scholar 

  • Ojha, V. K., Abraham, A., & Snášel, V. (2017). Metaheuristic design of feedforward neural networks: a review of two decades of research. Engineering Applications of Artificial Intelligence, 60, 97–116.

    Article  Google Scholar 

  • Panda, N., & Majhi, S. K. (2020). Improved spotted hyena optimizer with space transformational search for training Pi-Sigma higher order neural network. Computational Intelligence, 36(1), 320–350.

    Article  Google Scholar 

  • Pattanayak, RM., Behera, HS., Panigrahi, S.: A multi-step-ahead fuzzy time series forecasting by using hybrid chemical reaction optimization with Pi-Sigma higher-order Neural Network. Computational Intelligence in Pattern Recognition, 1029–1041. (2020)

  • Rumelhart, E., Hinton, G. E., & Williams, R. J. (1986). Learning Internal Representations by Error Propagation, Chapter 8 (pp. 318–362). Cambridge: The M.I.T. Press.

    Google Scholar 

  • Shin, Y., Gosh, J.: The sigma network: an efficient higher order neural network for pattern classification and function approximation. In Proceedings of the International Joint Conference on Neural Networks. (1991)

  • Storn, R., & Price, K. (1995). Differential evolution: a simple and efficient adaptive scheme for global optimization over continuous spaces, technical report TR-95-012. Berkeley: International Computer Science Institute.

    Google Scholar 

  • Yadav, R. N., Kalra, P. K., & John, J. (2007). Time series prediction with single multiplicative neuron model. Applied Soft Computing, 7, 1157–1163.

    Article  Google Scholar 

  • Yolcu, U., Egrioglu, E., Aladag, C.H. A New Linear & Nonlinear artificial neural network model for time series forecasting. Decision Support Systems, 1340–134. (2013)

  • Zhao, L., & Yang, Y. (2009). PSO-based single multiplicative neuron model for time series prediction. Expert Systems with Applications, 36, 2805–2812.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Statistics, Faculty of Arts and Science, Giresun University, 28200, Giresun, Turkey

    Oguzhan Yılmaz, Eren Bas & Erol Egrioglu

Authors
  1. Oguzhan Yılmaz
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Eren Bas
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Erol Egrioglu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Eren Bas.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yılmaz, O., Bas, E. & Egrioglu, E. The Training of Pi-Sigma Artificial Neural Networks with Differential Evolution Algorithm for Forecasting. Comput Econ 59, 1699–1711 (2022). https://doi.org/10.1007/s10614-020-10086-2

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10614-020-10086-2

Keywords

Search

Navigation