Skip to main content
SpringerLink
Log in

Nonlinear system modeling using self-organizing fuzzy neural networks for industrial applications

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

In this paper, a novel self-organizing fuzzy neural network with an adaptive learning algorithm (SOFNN-ALA) for nonlinear system modeling and identification in industrial processes is proposed. To efficiently enhance the generalization capability, the proposed SOFNN-ALA is designed by using both structure identification and parameter estimation simultaneously in the learning process. In the structure identification phase, the rule neuron with the highest neuronal activity will be split into two new rule neurons. Meanwhile, the redundant rule neurons with small singular values will be removed to simplify the network structure. In the parameter estimation phase, an adaptive learning algorithm (ALA), which is designed based on the widely used Levenberg-Marquardt (LM) optimization algorithm, is adopted to optimize the network parameters. The ALA-based learning algorithm can not only speed up the convergence speed but also enhance the modeling performance. Moreover, we carefully analyze the convergence of the proposed SOFNN-ALA to guarantee its successful practical application. Finally, the effectiveness and efficiency of the proposed SOFNN-ALA is validated by several examples. The experimental results demonstrate that the proposed SOFNN-ALA exhibits a better comprehensive performance than some other state-of-the-art SOFNNs for nonlinear system modeling in industrial applications. The source code can be downloaded from https://github.com/hyitzhb/SOFNN-ALA.git.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

Similar content being viewed by others

References

  1. Adeniran AA, Ferik SE (2017) Modeling and identification of nonlinear systems: a review of the multimodel approach–part 1. IEEE Trans Syst Man Cy-S 47(7):1149–1159

    Google Scholar 

  2. Moayedi H, Hayati S (2018) Modelling and optimization of ultimate bearing capacity of strip footing near a slope by soft computing methods. Appl Soft Comput 66:208–219

    Google Scholar 

  3. He W, Dong Y (2018) Adaptive fuzzy neural network control for a constrained robot using impedance learning. IEEE Transactions on Neural Networks and Learning Systems 29(4):1174–1186

    Google Scholar 

  4. Li DP, Liu YJ, Tong S, Chen CP, Li DJ (2019) Neural networks-based adaptive control for nonlinear state constrained systems with input delay. IEEE Transactions on Cybernetics 49(4):1249–1258

    Google Scholar 

  5. Tan KH, Lin FJ, Shih CM, Kuo CN (2019) Intelligent control of microgrid with virtual inertia using recurrent probabilistic wavelet fuzzy neural network. IEEE Trans Power Electron. https://doi.org/10.1109/TPEL.2019.2954740

  6. Lin QB, Chen SC, Lin CM (2019) Parametric fault diagnosis based on fuzzy cerebellar model neural networks. IEEE Trans Ind Electron 66(10):8104–8115

    Google Scholar 

  7. Al Sayaydeh ON, Mohammed MF, Alhroob E, Tao H, Lim CP (2019) A refined fuzzy min-max neural network with new learning procedures for pattern classification. IEEE Trans Fuzzy Syst

  8. Lai GY, Zhang Y, Liu Z, Chen CP (2019) Indirect adaptive fuzzy control design with guaranteed tracking error performance for uncertain canonical nonlinear systems. IEEE Trans Fuzzy Syst 27(6):1139–1150

    Google Scholar 

  9. Xie SW, Xie YF, Ying H, Jiang ZH, Gui WH (2020) Neuro-fuzzy-based plant-wide hierarchical coordinating optimization and control: an application to zinc hydrometallurgy plant. IEEE Trans Ind Electron 67(3):2207–2218

    Google Scholar 

  10. Teixeira BOS, Castro WS, Teixeira AF, Aguirre LA (2014) Data-driven soft sensor of downhole pressure for a gas-lift oil well. Control Eng Pract 22:34–43

    Google Scholar 

  11. Zhang RD, Tao JL (2017) Data-driven modeling using improved multi-objective optimization based neural network for coke furnace system. IEEE Trans Ind Electron 64(4):3147–3155

    MathSciNet  Google Scholar 

  12. Pedrycz W, Izakian H (2014) Cluster-centric fuzzy modeling. IEEE Trans Fuzzy Syst 22(6):1585–1597

    Google Scholar 

  13. Wei YL, Qiu JB, Karimi HR (2018) Fuzzy-affine-model-based memory filter design of nonlinear systems with time-varying delay. IEEE Trans Fuzzy Syst 26(2):504–517

    Google Scholar 

  14. Xu P, Deng ZH, Cui C, Zhang T, Choi KS, Suhang GSH, Wang J, Wang ST (2019) Concise Fuzzy System Modeling Integrating Soft Subspace Clustering and Sparse Learning. IEEE Trans Fuzzy Syst 27(11):2176–2188

    Google Scholar 

  15. Alghamdi M, Angelov P, Gimenez R, Rufino M, Soares E (2019) Self-organising and self-learning model for soybean yield prediction. In: 2019 sixth international conference on social networks analysis, management and security (SNAMS 2019). IEEE, pp 441–446

  16. Liu J, Vitelli V, Zio E, Seraoui R (2015) A novel dynamic-weighted probabilistic support vector regression-based ensemble for prognostics of time series data. IEEE Trans Reliab 64(4):1203–1213

    Google Scholar 

  17. Cao LL, Xu LH, Goodman ED, Bao CT, Zhu SW (2019) Evolutionary dynamic multiobjective optimization assisted by a support vector regression predictor. IEEE Trans Evol Comput

  18. Liu SD, Hou ZS, Yin CK (2016) Data-driven modeling for. UGI gasification processes via an enhanced genetic BP neural network with link switches IEEE Trans Neur Net Lear 27(12):2718–2729

    Google Scholar 

  19. Kumar R, Srivastava S, Gupta JRP, Mohindru A (2019) Comparative study of neural networks for dynamic nonlinear systems identification. Soft Comput 23(1):101–114

    MATH  Google Scholar 

  20. Nunez F, Langarica S, Diaz P, Torres M, Salas JC (2019) Neural Network-Based Model Predictive Control of a Paste Thickener over an Industrial Internet Platform. IEEE Transactions on Industrial Informatics

  21. Lin YY, Chang JY, Lin CT (2013) Identification and prediction of dynamic systems using an interactively recurrent self-evolving fuzzy neural network. IEEE Transactions on Neural Networks and Learning Systems 24(2):310–321

    Google Scholar 

  22. Zhang ZJ, Yan ZY (2019) An adaptive fuzzy recurrent neural network for solving non-repetitive motion problem of redundant robot manipulators. IEEE Trans Fuzzy Syst

  23. Wu SQ, Er MJ (2000) Dynamic fuzzy neural networks-a novel approach to function approximation. IEEE Trans Cybernetics 30(2):358–364

    Google Scholar 

  24. Wu SQ, Er MJ, Gao Y (2001) A fast approach for automatic generation of fuzzy rules by generalized dynamic fuzzy neural networks. IEEE Trans Fuzzy Syst 9(4):578–594

    Google Scholar 

  25. Wang N, Er MJ, Meng XY (2009) A fast and accurate online self-organizing scheme for parsimonious fuzzy neural networks. Neurocomputing 72(16):3818–3829

    Google Scholar 

  26. Wang N (2011) A generalized ellipsoidal basis function based online self-constructing fuzzy neural network. Neural Process Lett 34(1):13–37

    Google Scholar 

  27. Rubio JJ (2009) SOFMLS: online self-organizing fuzzy modified least-squares network. IEEE Trans Fuzzy Syst 17(6):1296–1309

    Google Scholar 

  28. Han HG, Qiao JF (2010) A self-organizing fuzzy neural network based on a growing-and-pruning algorithm. IEEE Trans Fuzzy Syst 18(6):1129–1143

    Google Scholar 

  29. Han HG, Wu XL, Qiao JF (2014) Nonlinear systems modeling based on self-organizing fuzzy-neural-network with adaptive computation algorithm. IEEE Trans Cybernetics 44(4):554–564

    Google Scholar 

  30. de Campos Souza PV, Nunes CFG, Guimares AJ, Rezende TS, Araujo VS, Arajuo VJS (2019) Self-organized direction aware for regularized fuzzy neural networks. Evolving Systems. Available: https://doi.org/10.1007/s12530-019-09278-5

  31. de Campos Souza PV, Guimaraes AJ, Araujo VS, Rezende TS, Araujo VJS (2019) Incremental regularized data density-based clustering neural networks to aid in the construction of effort forecasting systems in software development. Appl Intell 49:3221–3234

    Google Scholar 

  32. Gu XW, Angelov P, Rong HJ (2019) Local optimality of self-organising neuro-fuzzy inference systems. Inf Sci 503:351–380

    Google Scholar 

  33. Zhao J, Lin CM (2019) Wavelet-TSK-type fuzzy cerebellar model neural network for uncertain nonlinear systems. IEEE Trans Fuzzy Syst 27(3):549–558

    Google Scholar 

  34. de Campos Souza PV, Guimaraes AJ, Araújo VS, Rezende TS, Araújo VJS (2018) Fuzzy neural networks based on fuzzy logic neurons regularized by resampling techniques and regularization theory for regression problems. Intel Artif 21(62):114–133

    Google Scholar 

  35. Han HG, Wu XL, Liu Z, Qiao JF (2019) Data-knowledge-based fuzzy neural network for nonlinear system identification. IEEE Trans Fuzzy Syst

  36. Soto J, Melin P, Castillo O (2014) Time series prediction using ensembles of ANFIS models with genetic optimization of interval type-2 and type-1 fuzzy integrators. Int J Hybrid Intell Syst 11:211–226

    Google Scholar 

  37. Rubio-Solis A, Melin P, Martinez-Hernandez U, Panoutsos G (2018) General type-2 radial basis function neural network: a data-driven fuzzy model. IEEE Trans Fuzzy Syst 27(2):333–347

    Google Scholar 

  38. Soto J, Melin P, Castillo O (2018) A new approach for time series prediction using ensembles of IT2FNN models with optimization of fuzzy integrators. International Journal of Fuzzy Systems 20(3):701–728

    MathSciNet  Google Scholar 

  39. Soto J, Castillo O, Melin P, Pedrycz W (2019) A new approach to multiple time series prediction using MIMO fuzzy aggregation models with modular neural networks. International Journal of Fuzzy Systems 21(5):1629–1648

    Google Scholar 

  40. Khater AA, El-Nagar AM, El-Bardini M, El-Rabaie N (2019) A novel structure of actor-critic learning based on an interval type-2 TSK fuzzy neural network. IEEE Trans Fuzzy Syst. https://doi.org/10.1109/TFUZZ.2019.2949554

  41. Tang JJ, Liu F, Zou YJ, Zhang WB, Wang YH (2017) An improved fuzzy neural network for traffic speed prediction considering periodic characteristic. IEEE Trans Intell Transp Syst 18(9):2340–2349

    Google Scholar 

  42. Huang W, Oh SK, Pedrycz W (2017) Hybrid fuzzy wavelet neural networks architecture based on polynomial neural networks and fuzzy set/relation inference-based wavelet neurons. IEEE Transactions on Neural Networks and Learning Systems 29(8):3452–3462

    Google Scholar 

  43. Qiao JF, Zhou HB (2018) Modeling of energy consumption and effluent quality using density peaks-based adaptive fuzzy neural network. IEEE/CAA Journal of Automatica Sinica 5(5):968–976

    MathSciNet  Google Scholar 

  44. Lin CJ, Chen CH, Lin CT (2009) A hybrid of cooperative particle swarm optimization and cultural algorithm for neural fuzzy networks and its prediction applications. IEEE Trans Syst Man Cybern Part C Appl Rev 39(1):55–68

    Google Scholar 

  45. Leng G, McGinnity TM, Prasad G (2006) Design for self-organizing fuzzy neural networks based on genetic algorithms. IEEE Trans Fuzzy Syst 14(6):755–766

    Google Scholar 

  46. Zhang RD, Tao JL (2018) A nonlinear fuzzy neural network modeling approach using an improved genetic algorithm. IEEE Trans Ind Electron 65(7):5882–5892

    Google Scholar 

  47. Yu W (2009) A novel fuzzy-neural-network modeling approach to crude-oil blending. IEEE Trans Control Syst Technol 17(6):1424–1431

    Google Scholar 

  48. Wilamowski BM, Yu H (2010) Neural network learning without backpropagation. IEEE Trans Neur Net Lear 21(11):1793–1803

    Google Scholar 

  49. Davanipoor M, Zekri M, Sheikholeslam F (2012) Fuzzy wavelet neural network with an accelerated hybrid learning algorithm. IEEE Trans Fuzzy Syst 20(3):463–470

    Google Scholar 

  50. Zhao WQ, Li K, Irwin GW (2013) A new gradient descent approach for local learning of fuzzy neural models. IEEE Trans Fuzzy Syst 21(1):30–44

    Google Scholar 

  51. Lv C, Xiang Y, Zhang JZ, Na XX, Li YT, Liu T, Cao DP, Wang FY (2018) Levenberg–Marquardt backpropagation training of multilayer neural networks for state estimation of a safety-critical cyber-physical system. IEEE Transactions on Industrial Informatics 14(8):3436–3446

    Google Scholar 

  52. Han HG, Ge LM, Qiao JF (2016) An adaptive second order fuzzy neural network for nonlinear system modeling. Neurocomputing 214(19):837–847

    Google Scholar 

  53. Zhou HB, Qiao JF (2019) Soft sensing of effluent ammonia nitrogen using rule automatic formation-based adaptive fuzzy neural network. Desalin Water Treat 140:132–142

    Google Scholar 

  54. Ebadzadeh MM, Salimi-Badr A (2018) IC-FNN: a novel fuzzy neural network with interpretable, intuitive, and correlated-contours fuzzy rules for function approximation. IEEE Trans Fuzzy Syst 26(3):1288–1302

    Google Scholar 

  55. Lin FJ, Teng LT, Lin JW, Chen SY (2009) Recurrent functional-link-based fuzzy-neural-network-controlled induction-generator system using improved particle swarm optimization. IEEE Trans Ind Electron 56(5):1557–1577

    Google Scholar 

  56. Kuo RJ, Hung SY, Cheng WC (2014) Application of an optimization artificial immune network and particle swarm optimization-based fuzzy neural network to an RFID-based positioning system. Inf Sci 262:78–98

    Google Scholar 

  57. Malek H, Ebadzadeh MM, Rahmati M (2012) Three new fuzzy neural networks learning algorithms based on clustering, training error and genetic algorithm. Appl Intell 37(2):280–289

    Google Scholar 

  58. Spitzer NC (2006) Electrical activity in early neuronal development. Nature 444(7120):707–712

    Google Scholar 

  59. García NVDM, Karayannis T, Fishell G (2011) Neuronal activity is required for the development of specific cortical interneuron subtypes. Nature 472(7343):351–356

    Google Scholar 

  60. Qiao JF, Meng X, Li WJ (2018) An incremental neuronal-activity-based RBF neural network for nonlinear system modeling. Neurocomputing 302:1–11

    Google Scholar 

  61. Liu J, Liu XQ, Ma X (2008) First-order perturbation analysis of singular vectors in singular value decomposition. IEEE Trans Signal Proces 56(7):3044–3049

    MathSciNet  MATH  Google Scholar 

  62. Drmač Z, Veselić K (2008) New fast and accurate Jacobi SVD algorithm. I SIAM J Matrix Anal A 29(4):1322–1342

    MathSciNet  MATH  Google Scholar 

  63. Wilamowski BM, Yu H (2010) Improved computation for Levenberg–Marquardt training. IEEE Trans Neur Net Lear 21(6):930–937

    Google Scholar 

  64. Li CS, Zhou JZ, Fu B, Kou PG, Xiao J (2012) T–S fuzzy model identification with a gravitational search-based hyperplane clustering algorithm. IEEE Trans Fuzzy Syst 20(2):305–317

    Google Scholar 

  65. Abiyev RH, Kaynak O (2008) Fuzzy wavelet neural networks for identification and control of dynamic plants—a novel structure and a comparative study. IEEE Trans Ind Electron 55(8):3133–3140

    Google Scholar 

  66. Lee E, Han S, Kim H (2013) Development of software sensors for determining total phosphorus and total nitrogen in waters. Int J Environ Res Public Health 10(1):219–236

    Google Scholar 

  67. Wang Z, Chu JS, Song Y, Cui YJ, Zhang H, Zhao XQ, Li ZH, Yao JM (2009) Influence of operating conditions on the efficiency of domestic wastewater treatment in membrane bioreactors. Desalination 245:73–81

    Google Scholar 

  68. Chang FJ, Tsai YH, Chen PA, Coynel AG (2015) Modeling water quality in an urban river using hydrological factors–data driven approaches. J Environ Manag 151(1–3):87–96

    Google Scholar 

Download references

Acknowledgements

This study was supported in part by the General Program of National Natural Science of China under Grant 61873107 and the “333” Project in Jiangsu Province under Grant BRA2019285.

Author information

Authors and Affiliations

  1. Faculty of Automation, Huaiyin Institute of Technology, Huai’an, 223003, China

    Hongbiao Zhou, Zhao Huanyu & Zhang Yu

Authors
  1. Hongbiao Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zhao Huanyu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Zhang Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hongbiao Zhou.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhou, H., Zhao, H. & Zhang, Y. Nonlinear system modeling using self-organizing fuzzy neural networks for industrial applications. Appl Intell 50, 1657–1672 (2020). https://doi.org/10.1007/s10489-020-01645-z

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-020-01645-z

Keywords

Search

Navigation