Table of Contents
Fetching ...

Modeling and Scheduling of Fusion Patterns in Autonomous Driving Systems (Extended Version)

Hoora Sobhani, Hyoseung Kim

TL;DR

The paper addresses the problem that state-of-the-art ADS DAG scheduling often oversimplifies data fusion by assuming fixed triggering patterns. It introduces an ILP-based framework that models five fusion patterns (sen, sub, t-fus, w-fus, i-fus) and branch-then-fusion paths, generating deterministic offline schedules across multi-core platforms using producer and predecessor structures with binary coupling variables. The framework optimizes multiple real-time metrics, including $MRT$, $MTD$, $PAoI$, $WCRT$, and $MS$, by formulating fusion-specific constraints and end-to-end mappings between sensor and actuator instances, with analysis performed over a horizon $\Delta = 3\cdot HP$. Evaluation against the state-of-the-art and on randomly generated DAGs demonstrates improved handling of diverse fusion patterns and meaningful gains in timing performance, with practical validation on a Raspberry Pi and broad applicability to ADS software stacks. This work provides a configurable tool for ADS designers to compare fusion strategies, quantify trade-offs, and derive offline schedules that can be deployed on real platforms, potentially influencing sensor fusion design and scheduling policies in safety-critical autonomous driving systems.

Abstract

In Autonomous Driving Systems (ADS), Directed Acyclic Graphs (DAGs) are widely used to model complex data dependencies and inter-task communication. However, existing DAG scheduling approaches oversimplify data fusion tasks by assuming fixed triggering mechanisms, failing to capture the diverse fusion patterns found in real-world ADS software stacks. In this paper, we propose a systematic framework for analyzing various fusion patterns and their performance implications in ADS. Our framework models three distinct fusion task types: timer-triggered, wait-for-all, and immediate fusion, which comprehensively represent real-world fusion behaviors. Our Integer Linear Programming (ILP)-based approach enables an optimization of multiple real-time performance metrics, including reaction time, time disparity, age of information, and response time, while generating deterministic offline schedules directly applicable to real platforms. Evaluation using real-world ADS case studies, Raspberry Pi implementation, and randomly generated DAGs demonstrates that our framework handles diverse fusion patterns beyond the scope of existing work, and achieves substantial performance improvements in comparable scenarios.

Modeling and Scheduling of Fusion Patterns in Autonomous Driving Systems (Extended Version)

TL;DR

The paper addresses the problem that state-of-the-art ADS DAG scheduling often oversimplifies data fusion by assuming fixed triggering patterns. It introduces an ILP-based framework that models five fusion patterns (sen, sub, t-fus, w-fus, i-fus) and branch-then-fusion paths, generating deterministic offline schedules across multi-core platforms using producer and predecessor structures with binary coupling variables. The framework optimizes multiple real-time metrics, including , , , , and , by formulating fusion-specific constraints and end-to-end mappings between sensor and actuator instances, with analysis performed over a horizon . Evaluation against the state-of-the-art and on randomly generated DAGs demonstrates improved handling of diverse fusion patterns and meaningful gains in timing performance, with practical validation on a Raspberry Pi and broad applicability to ADS software stacks. This work provides a configurable tool for ADS designers to compare fusion strategies, quantify trade-offs, and derive offline schedules that can be deployed on real platforms, potentially influencing sensor fusion design and scheduling policies in safety-critical autonomous driving systems.

Abstract

In Autonomous Driving Systems (ADS), Directed Acyclic Graphs (DAGs) are widely used to model complex data dependencies and inter-task communication. However, existing DAG scheduling approaches oversimplify data fusion tasks by assuming fixed triggering mechanisms, failing to capture the diverse fusion patterns found in real-world ADS software stacks. In this paper, we propose a systematic framework for analyzing various fusion patterns and their performance implications in ADS. Our framework models three distinct fusion task types: timer-triggered, wait-for-all, and immediate fusion, which comprehensively represent real-world fusion behaviors. Our Integer Linear Programming (ILP)-based approach enables an optimization of multiple real-time performance metrics, including reaction time, time disparity, age of information, and response time, while generating deterministic offline schedules directly applicable to real platforms. Evaluation using real-world ADS case studies, Raspberry Pi implementation, and randomly generated DAGs demonstrates that our framework handles diverse fusion patterns beyond the scope of existing work, and achieves substantial performance improvements in comparable scenarios.

Paper Structure

This paper contains 22 sections, 8 theorems, 27 equations, 14 figures, 3 tables, 1 algorithm.

Key Result

lemma thmcounterlemma

The start time of a fusion task instance $\tau_{i,j}$, i.e., $\theta_i \in \{\text{"t-fus", "w-fus", "i-fus"}\}$, should satisfy the following condition:

Figures (14)

  • Figure 1: Holistic overview of the ADS software stack, inspired by xu2022aoikuhse2024sync.
  • Figure 2: Task types in a DAG
  • Figure 3: Illustrative examples on fusion nodes
  • Figure 4: DAG structure
  • Figure 5: Task configurations
  • ...and 9 more figures

Theorems & Definitions (17)

  • definition thmcounterdefinition
  • lemma thmcounterlemma: Constraint: start time of fusion nodes
  • proof
  • lemma thmcounterlemma: Constraint: used only once by an instance
  • proof
  • lemma thmcounterlemma: Constraint: most recent instance is used
  • proof
  • lemma thmcounterlemma: Constraint: used once by "w-fus"
  • proof
  • lemma thmcounterlemma: Constraint: at least one new instance for "i-fus"
  • ...and 7 more