TY - JOUR
T1 - Learning Driver-Specific Behavior for Overtaking
T2 - A Combined Learning Framework
AU - Lu, Chao
AU - Wang, Huaji
AU - Lv, Chen
AU - Gong, Jianwei
AU - Xi, Junqiang
AU - Cao, Dongpu
N1 - Publisher Copyright:
© 1967-2012 IEEE.
PY - 2018/8
Y1 - 2018/8
N2 - Learning-based methods have gained increasing attention in the intelligent vehicle community for developing highly autonomous vehicles and advanced driving assistance systems (ADAS). However, traditional offline learning methods lack the ability to adapt to individual driving behavior. To overcome this limitation, a combined learning framework (CLF) based on the Natural Actor Critic (NAC) learning and general regression neural network (GRNN) is developed in this paper. GRNN can be trained offline based on the historical data, while NAC is carried out online. In this way, the general behavior learned by the offline module can be reused and adjusted by the online module to capture the driver-specific behavior. Driving data collected from human drivers through a driving simulator are used to test the proposed learning framework. The complex overtaking behavior is selected to formulate the learning problem and test scenarios. Experimental results show that the proposed system performs well on learning driver-specific behavior for overtaking, and compared with the Gaussian mixture model-maximum-a-posterior method, CLF shows a more flexible performance when newly-involved drivers are considered.
AB - Learning-based methods have gained increasing attention in the intelligent vehicle community for developing highly autonomous vehicles and advanced driving assistance systems (ADAS). However, traditional offline learning methods lack the ability to adapt to individual driving behavior. To overcome this limitation, a combined learning framework (CLF) based on the Natural Actor Critic (NAC) learning and general regression neural network (GRNN) is developed in this paper. GRNN can be trained offline based on the historical data, while NAC is carried out online. In this way, the general behavior learned by the offline module can be reused and adjusted by the online module to capture the driver-specific behavior. Driving data collected from human drivers through a driving simulator are used to test the proposed learning framework. The complex overtaking behavior is selected to formulate the learning problem and test scenarios. Experimental results show that the proposed system performs well on learning driver-specific behavior for overtaking, and compared with the Gaussian mixture model-maximum-a-posterior method, CLF shows a more flexible performance when newly-involved drivers are considered.
KW - Driving behaviour
KW - natural actor critic
KW - neural network
KW - overtaking
KW - reinforcement learning
UR - http://www.scopus.com/inward/record.url?scp=85044846242&partnerID=8YFLogxK
U2 - 10.1109/TVT.2018.2820002
DO - 10.1109/TVT.2018.2820002
M3 - Article
AN - SCOPUS:85044846242
SN - 0018-9545
VL - 67
SP - 6788
EP - 6802
JO - IEEE Transactions on Vehicular Technology
JF - IEEE Transactions on Vehicular Technology
IS - 8
M1 - 8326507
ER -