A hierarchical framework for improving ride comfort of autonomous vehicles via deep reinforcement learning with external knowledge,Computer-Aided Civil and Infrastructure Engineering

当前位置： X-MOL 学术 › Comput. Aided Civ. Infrastruct. Eng. › 论文详情

Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)

A hierarchical framework for improving ride comfort of autonomous vehicles via deep reinforcement learning with external knowledge
Computer-Aided Civil and Infrastructure Engineering ( IF 8.5 ) Pub Date : 2022-11-21 , DOI: 10.1111/mice.12934
Yuchuan Du ₁ , Jing Chen ₁ , Cong Zhao ₁ , Feixiong Liao ₂ , Meixin Zhu ₃

Affiliation

Ride comfort plays an important role in determining the public acceptance of autonomous vehicles (AVs). Many factors, such as road profile, driving speed, and suspension system, influence the ride comfort of AVs. This study proposes a hierarchical framework for improving ride comfort by integrating speed planning and suspension control in a vehicle-to-everything environment. Based on safe, comfortable, and efficient speed planning via dynamic programming, a deep reinforcement learning-based suspension control is proposed to adapt to the changing pavement conditions. Specifically, a deep deterministic policy gradient with external knowledge (EK-DDPG) algorithm is designed for the efficient self-adaptation of suspension control strategies. The external knowledge of action selection and value estimation from other AVs are combined into the loss functions of the DDPG algorithm. In numerical experiments, real-world pavements detected in 11 districts of Shanghai, China, are applied to verify the proposed method. Experimental results demonstrate that the EK-DDPG-based suspension control improves ride comfort on untrained rough pavements by 27.95% and 3.32%, compared to a model predictive control (MPC) baseline and a DDPG baseline, respectively. Meanwhile, the EK-DDPG-based suspension control improves computational efficiency by 22.97%, compared to the MPC baseline, and performs at the same level as the DDPD baseline. This study provides a generalized and computationally efficient approach for improving the ride comfort of AVs.

更新日期：2022-11-21

点击分享查看原文

点击收藏

阅读更多本刊最新论文本刊介绍/投稿指南11