Research on Intelligent Merging Decision-making of Unmanned Vehicles Based on Reinforcement Learning

Xue Mei Chen*, Qiang Zhang, Zhen Hua Zhang, Ge Meng Liu, Jian Wei Gong, Ching Yao Chan

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

10 Citations (Scopus)

Abstract

The decision-making model of merging behavior is one of the key technologies of unmanned vehicles. In order to solve the problem of unmanned vehicles' merging decision making, this paper presents a merging strategy based on Least squares Policy Iteration (LSPI) algorithm, and selects the basis function which includes reciprocal of TTC, relative distance and relative speed to represent state space and discretizes action space. This study synthetically takes consideration o safety, the success of the task, the merging efficiency and comfort in setting reward function, compares the Q-learning with LSPI algorithm, and verifies its adaptability by using NGSIM data. The algorithm can ultimately achieve a success rate of 86%. This research can provide theoretic support and technical basis for the merging decision-making of unmanned vehicles.

Original languageEnglish
Title of host publication2018 IEEE Intelligent Vehicles Symposium, IV 2018
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages91-96
Number of pages6
ISBN (Electronic)9781538644522
DOIs
Publication statusPublished - 18 Oct 2018
Event2018 IEEE Intelligent Vehicles Symposium, IV 2018 - Changshu, Suzhou, China
Duration: 26 Sept 201830 Sept 2018

Publication series

NameIEEE Intelligent Vehicles Symposium, Proceedings
Volume2018-June

Conference

Conference2018 IEEE Intelligent Vehicles Symposium, IV 2018
Country/TerritoryChina
CityChangshu, Suzhou
Period26/09/1830/09/18

Fingerprint

Dive into the research topics of 'Research on Intelligent Merging Decision-making of Unmanned Vehicles Based on Reinforcement Learning'. Together they form a unique fingerprint.

Cite this