Driving Style Alignment for LLM-powered Driver Agent
Ruoxuan Yang, Xinyue Zhang, Anais Fernandez-Laaksonen, Xin Ding, Jiangtao Gong
TL;DR
The paper addresses the challenge of aligning LL-powered driver agents with human driving styles by introducing a multi-alignment framework that leverages human demonstrations and Coach-driven feedback. A natural-language driving-behavior dataset is collected from real driving and post-drive interviews to train and evaluate alignments. The authors validate their approach in CARLA with a $3\times3$ design, showing that multi-alignment, particularly with cautious driving demonstrations, yields safer and more human-like behavior, and they corroborate these findings with extensive human evaluations. The work advances human-centric autonomous driving by enabling diverse, interpretable driving styles and highlighting the role of high-quality linguistic demonstrations in aligning embodied agents with human norms.
Abstract
Recently, LLM-powered driver agents have demonstrated considerable potential in the field of autonomous driving, showcasing human-like reasoning and decision-making abilities.However, current research on aligning driver agent behaviors with human driving styles remains limited, partly due to the scarcity of high-quality natural language data from human driving behaviors.To address this research gap, we propose a multi-alignment framework designed to align driver agents with human driving styles through demonstrations and feedback. Notably, we construct a natural language dataset of human driver behaviors through naturalistic driving experiments and post-driving interviews, offering high-quality human demonstrations for LLM alignment. The framework's effectiveness is validated through simulation experiments in the CARLA urban traffic simulator and further corroborated by human evaluations. Our research offers valuable insights into designing driving agents with diverse driving styles.The implementation of the framework and details of the dataset can be found at the link.
