Abstract
Cyber-physical systems integrate computing, network and physical environments to make the systems more efficient and cooperative, and have important and extensive application prospects, such as the Internet of things. This paper studies the control problem of nonlinear cyber-physical systems with unknown dynamics and communication delays. A networked learning predictive control scheme is proposed for unknown nonlinear cyber-physical systems. This scheme recursively learns unknown system dynamics, actively compensates for communication delays and accurately tracks a desired reference. Learning multi-step predictors are presented to predict various step ahead outputs of the unknown nonlinear cyber-physical systems. The optimal design of controllers minimises a performance cost function which measures the tracking error predictions and control input increment predictions. The system analysis leads to the stability criteria of closed-loop nonlinear cyber-physical systems employing the networked learning predictive control scheme. An example illustrates the outcomes of the proposed scheme.
Similar content being viewed by others
References
Xu H, Yu W, Griffith D, et al., A survey on industrial internet of things: A cyber-physical systems perspective, IEEE Access, 2018, 6: 78238–78259.
Baillieul J and Antsaklis P J, Control and communication challenges in networked real-time systems, IEEE Proceedings, 2007, 95(1): 9–28.
Lin C, Wang Z, and Yang F, Observer-based networked control for continuous-time systems with random sensor delays, Automatica, 2009, 45(2): 578–584.
Donkers M, Heemels W, Bernardini D, et al., Stability analysis of stochastic networked control systems, Automatica, 2012, 48(5): 917–925.
Imer O C, Yuksel S, and Basar T, Optimal control of LTI systems over unreliable communication links, Automatica, 2006, 42(9): 1429–1439.
Kruszewski A, Jiang W, Fridman E, et al., A switched system approach to exponential stabilization through communication network, IEEE Trans. Control Syst. Technol., 2012, 20(4): 887–900.
Wen G, Yu W, Yu X, et al., Complex cyber-physical networks: From cybersecurity to security control, Journal of Systems Science and Complexity, 2017, 30(1): 46–67.
Gupta R and Chow M Y, Networked control system: Overview and research trends, IEEE Trans. Ind. Electron., 2010, 57(7): 2527–2535.
Liu G P, Mu J, and Rees D, Networked predictive control of systems with random communication delay, Proceedings of the UKACC International Conference on Control, Bath, UK, 2004.
Liu G P, Mu J X, Rees D, et al., Design and stability analysis of networked control systems with random communication time delay using the modified MPC, International Journal of Control, 2006, 79(4): 287–296.
Wang R, Liu G P, Wang W, et al., H-inf control for networked predictive control systems based on the switched Lyapunov function method, IEEE Transactions on Industrial Electronics, 2010, 57(10): 3565–3571.
Pang Z H, Liu G P, Zhou D, et al., Data-based predictive control for networked nonlinear systems with packet dropout and measurement noise, Journal of Systems Science and Complexity, 2017, 30(5): 1072–1083.
Pang Z H and Liu G P, Design and practical implementation of secure networked predictive control systems, IEEE Transactions on Control Systems Technology, 2012, 20(5): 1334–1342.
Pang Z H, Liu G P, Zhou D, et al., Two-channel false data injection attacks against output tracking control of networked systems, IEEE Transactions on Industrial Electronics, 2016, 63(5): 3242–3251.
Kim W J, Ji K, and Ambike A, Real-time operating environment for networked control systems, IEEE Transactions on Automation Science and Engineering, 2006, 3(3): 287–296.
Tang P L and de Silva C W, Compensation for transmission delays in an Ethernet based control network using variable-horizon predictive control, IEEE Transactions on Control Systems Technology, 2006, 14(4): 707–718.
Yin X X, Yue D, Hu S L, et al., Distributedadaptive model-based event-triggered predictive control for consensus of multiagent systems, International Journal of Robust and Nonlinear Control, 2018, 28(18): 6180–6201.
Yang R N and Zheng W X, Output-based event-triggered predictive control for networked control systems, IEEE Transactions on Industrial Electronics, 2020, 67(12): 10631–10640.
Sun J and Chen J, Networked predictive control for systems with unknown or partially known delay, IET Control Theory and Applications, 2014, 8(18): 2282–2288.
Li M and Chen Y, Wide-area stabiliser on sliding mode control for cross-area power systems with random delay and packet dropouts, Asian Journal of Control, 2018, 20(6): 2130–2142.
Zhao Y B and Liu G P, A predictive control-based approach to networked Hammerstein systems: Design and stability analysis, IEEE Transactions on Systems, Man, and Cybernetics, B: Cybernetics, 2008, Man, 38(3): 700–708.
Pin G and Parisini T, Networked predictive control of uncertain constrained nonlinear systems: Recursive feasibility and input-to-state stability analysis, IEEE Transactions on Automatic Control, 2011, 56(1): 72–87.
Liu G P, Design and analysis of networked nonlinear predictive control systems, IET Control Theory and Applications, 2015, 9(11): 1740–1745.
Yang H J, Xu Y, Xia Y Q, et al., Networked predictive control for nonlinear systems with arbitrary region quantizers, IEEE Transactions on Cybernetics, 2017, 47(8): 2244–2255.
Poveda J I, Benosman M, and Teel A R, Hybrid online learning control in networked multiagent systems: A survey, International Journal of Adaptive Control and Signal Processing, 2019, 33(2): 228–261.
B. Piot B, Geist M, and Pietquin O, Bridging the gap between imitation learning and inverse reinforcement learning, IEEE Transactions on Neural Networks and Learning Systems, 2016, 28(8): 1814–1826.
Buini H M, Peter S, and Givargis T, Adaptive embedded control of cyber-physical systems using reinforcement learning, IET Cyber-Physical Systems: Theory and Applications, 2017, 2(3): 127–135.
Zhou Y, Vamvoudakis K G, Haddad W M, et al., A secure control learning framework for cyberphysical systems under sensor and actuator attacks, IEEE Transactions on Cybernetics, 2020, https://doi.org/10.1109/TCYB.2020.3006871.
Hou Z and Jin S, Model Free Adaptive Control-Theory and Applications, CRC Press, Boca Raton, 2014.
Liu G P, Nonlinear Identification and Control: A Neural Network Approach, Springer-Verlag, Berlin, 2001.
Liu G P, Predictive control of networked nonlinear multi-agent systems with communication constraints, IEEE Trans. on Systems, Man, and Cybernetics: Systems, 2020, 50(11): 4447–4457.
Author information
Authors and Affiliations
Corresponding author
Additional information
This paper was supported in part by the National Natural Science Foundation of China under Grant No. 61773144.
This paper was recommended for publication by Editor SUN Jian.
Rights and permissions
About this article
Cite this article
Liu, GP. Networked Learning Predictive Control of Nonlinear Cyber-Physical Systems. J Syst Sci Complex 33, 1719–1732 (2020). https://doi.org/10.1007/s11424-020-0243-1
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11424-020-0243-1