To read this content please select one of the options below:

A new path plan method based on hybrid algorithm of reinforcement learning and particle swarm optimization

Xiaohuan Liu (Tianjin University of Technology, Tianjin, China)
Degan Zhang (Tianjin University of Technology, Tianjin, China)
Ting Zhang (Tianjin University of Technology, Tianjin, China)
Jie Zhang (Tianjin University of Technology, Tianjin, China)
Jiaxu Wang (Tianjin University of Technology, Tianjin, China)

Engineering Computations

ISSN: 0264-4401

Article publication date: 27 July 2021

Issue publication date: 4 March 2022

656

Abstract

Purpose

To solve the path planning problem of the intelligent driving vehicular, this paper designs a hybrid path planning algorithm based on optimized reinforcement learning (RL) and improved particle swarm optimization (PSO).

Design/methodology/approach

First, the authors optimized the hyper-parameters of RL to make it converge quickly and learn more efficiently. Then the authors designed a pre-set operation for PSO to reduce the calculation of invalid particles. Finally, the authors proposed a correction variable that can be obtained from the cumulative reward of RL; this revises the fitness of the individual optimal particle and global optimal position of PSO to achieve an efficient path planning result. The authors also designed a selection parameter system to help to select the optimal path.

Findings

Simulation analysis and experimental test results proved that the proposed algorithm has advantages in terms of practicability and efficiency. This research also foreshadows the research prospects of RL in path planning, which is also the authors’ next research direction.

Originality/value

The authors designed a pre-set operation to reduce the participation of invalid particles in the calculation in PSO. And then, the authors designed a method to optimize hyper-parameters to improve learning efficiency of RL. And then they used RL trained PSO to plan path. The authors also proposed an optimal path evaluation system. This research also foreshadows the research prospects of RL in path planning, which is also the authors’ next research direction.

Keywords

Acknowledgements

Funding: This study was funded by the following funds, and the authors would like to express their gratitude: National Natural Science Foundation of China (61571328); Tianjin Key Natural Science Foundation Project (18JCZDJC96800); Tianjin Science and Technology Major Project (15ZXDSGX 00050); Tianjin Science and Technology Innovation Team Fund Projects (TD12-5016, TD13-5025, TD2015-23); Tianjin Science and Technology Service Industry Major Science and Technology Project (16ZXFWGX00010, 17YFZCGX00360).

Ethical approval: This article does not contain any studies with human participants performed by the authors.

Informed consent: Informed consent was obtained from all individual participants included in the study.

Conflict of Interest: The authors declare that there is no conflict of interest regarding the publication of this paper.

Citation

Liu, X., Zhang, D., Zhang, T., Zhang, J. and Wang, J. (2022), "A new path plan method based on hybrid algorithm of reinforcement learning and particle swarm optimization", Engineering Computations, Vol. 39 No. 3, pp. 993-1019. https://doi.org/10.1108/EC-09-2020-0500

Publisher

:

Emerald Publishing Limited

Copyright © 2021, Emerald Publishing Limited

Related articles