Alpamayo-R1: Bridging Reasoning and Action Prediction for Generalizable Autonomous Driving in the Long Tail

TL;DR

The paper tackles safety-critical long-tail autonomous driving where supervision is sparse and causal understanding is limited, proposing Alpamayo-R1 (AR1), a vision-language-action model that grounds decisions in structured Chain of Causation reasoning to improve generalization. AR1 combines a Cosmos-Reason backbone with a diffusion-based trajectory decoder, predicting the entire 6-second future trajectory sequence of 64 waypoints at 10 Hz, conditioned on reasoning traces. To enable interpretable reasoning, the Chain of Causation (CoC) dataset provides decision-grounded, causally linked traces through a hybrid human-auto labeling pipeline, and a three-stage training strategy (Action Modality Injection, Eliciting Reasoning via supervised fine-tuning on CoC, and RL-based post-training with GRPO) aligns reasoning and actions. Empirical results show up to 12% improvement in planning accuracy, a 35% reduction in off-road rate and 25% fewer close encounters in closed-loop simulation; RL post-training yields 45% gains in reasoning quality and 37% in reasoning–action consistency, with real-time 99 ms latency on urban road tests, demonstrating a practical path toward Level 4 driving.

Abstract

End-to-end architectures trained via imitation learning have advanced autonomous driving by scaling model size and data, yet performance remains brittle in safety-critical long-tail scenarios where supervision is sparse and causal understanding is limited. To address this, we introduce Alpamayo-R1 (AR1), a vision-language-action model (VLA) that integrates Chain of Causation reasoning with trajectory planning to enhance decision-making in complex driving scenarios. Our approach features three key innovations: (1) the Chain of Causation (CoC) dataset, built through a hybrid auto-labeling and human-in-the-loop pipeline producing decision-grounded, causally linked reasoning traces aligned with driving behaviors; (2) a modular VLA architecture combining Cosmos-Reason, a Vision-Language Model pre-trained for Physical AI applications, with a diffusion-based trajectory decoder that generates dynamically feasible plans in real time; (3) a multi-stage training strategy using supervised fine-tuning to elicit reasoning and reinforcement learning (RL) to optimize reasoning quality via large reasoning model feedback and enforce reasoning-action consistency. Evaluation shows AR1 achieves up to a 12% improvement in planning accuracy on challenging cases compared to a trajectory-only baseline, with a 35% reduction in off-road rate and 25% reduction in close encounter rate in closed-loop simulation. RL post-training improves reasoning quality by 45% as measured by a large reasoning model critic and reasoning-action consistency by 37%. Model scaling from 0.5B to 7B parameters shows consistent improvements. On-vehicle road tests confirm real-time performance (99 ms latency) and successful urban deployment. By bridging interpretable reasoning with precise control, AR1 demonstrates a practical path towards Level 4 autonomous driving. We plan to release AR1 models and a subset of the CoC in a future update.

Figures (14)

• Figure 1: Overview of Alpamayo-R1 architecture. Multi-camera images and egomotion are processed by a vision encoder to produce visual tokens, which are fed into a VLM backbone (Cosmos-Reason) along with textual inputs. The model autoregressively generates chain-of-thought reasoning and discrete trajectory tokens. At inference, an action-expert decoder using flow matching converts the discrete trajectory tokens into continuous, kinematically feasible waypoints conditioned on the reasoning output.
• Figure 2: Examples of reasoning traces exhibiting common issues in existing datasets malla2023dramachi2025impromptuarai2025covla. Text highlighted in yellow indicates vague behavior descriptions that fail to specify concrete driving decisions correlated with the trajectories. Text highlighted in blue denotes superficial reasoning, such as contextual observations that do not directly inform the ego vehicle’s decision. Red highlights indicate incorrect or causally inconsistent reasoning that contradicts the actual behavior of the ego vehicle.
• Figure 3: Overview of the proposed structured CoC labeling pipeline, composed of five steps: (1) Clip Selection, where clips containing explicit driving decisions are selected, filtering out low-signal clips that offer limited causal information; (2) Keyframe Labeling, where the decision-making moment within each video clip is identified, minimizing potential causal confusion; (3-5) Structured CoC Labeling, to construct the final CoC and further mitigate causal confusion, we first annotate critical components from the observation while avoiding referring to causal factors in future frames, and then label the corresponding driving decision. We then compose a reasoning trace from driving decisions and causal factors in natural language.
• Figure 4: Examples of our labeled CoC reasoning traces, where driving decisions and critical components are organized into CoC and highlighted correspondingly.
• Figure 5: Overview of the Alpamayo-R1 model training pipeline, consisting of three key stages: (1) Action Modality Injection (\ref{['sec:traj_inject']}), (2) Eliciting Reasoning (\ref{['sec:elicit_reasoning']}), and (3) RL-Based Post-Training (\ref{['sec:rl_alignment']}).