Linguistics

Engineering

Philosophy

Social psychology

Computer security

Computer science

Physics

Reinforcement learning

SAFER

Psychology

Optics

Feature (linguistics)

Focus (optics)

Artificial intelligence

Structural engineering

Deep learning

Human–computer interaction

Reinforcement

Performing safe and efficient lane changes is a crucial feature for creating fully autonomous vehicles. Recent advances have demonstrated successful lane following behavior using deep reinforcement learning, yet the interactions with other vehicles on road for lane changes are rarely considered. In this paper, we design a hierarchical Deep Reinforcement Learning (DRL) algorithm to learn lane change behaviors in dense traffic. By breaking down overall behavior to sub-policies, faster and safer lane change actions can be learned. We also apply temporal and spatial attention to the DRL architecture, which helps the vehicle focus more on surrounding vehicles and leads to smoother lane change behavior. We conduct our experiments in the TORCS simulator and the results outperform the state-of-art deep reinforcement learning algorithm in various lane change scenarios.

Attention-Based Hierarchical Deep Reinforcement Learning for Lane Change Behaviors in Autonomous Driving