Table of Contents
Fetching ...

Radar-Inertial Odometry For Computationally Constrained Aerial Navigation

Jan Michalczyk

TL;DR

This work addresses UAV localization in GNSS-denied and visually challenging environments by fusing a lightweight FMCW radar with an IMU. It develops multiple Radar-Inertial Odometry (RIO) approaches, including tightly-coupled Extended Kalman Filters with distance, Doppler, and measurement trails, a multi-state EKF with persistent landmarks, and a sliding-window factor-graph Rio, all capable of real-time operation on embedded hardware. A key contribution is the integration of online extrinsic calibration and, in parallel, a learning-based framework to predict robust radar 3D point correspondences, enabling improved data association in sparse, noisy radar scans. The methods demonstrate strong performance in indoor and foggy conditions, including closed-loop flights, and show competitive accuracy with vision-based systems while maintaining resilience to environmental degradation. The work also provides open-source implementations and datasets, highlighting practical viability for small-UAV autonomy under compute and sensing constraints.

Abstract

Recently, the progress in the radar sensing technology consisting in the miniaturization of the packages and increase in measuring precision has drawn the interest of the robotics research community. Indeed, a crucial task enabling autonomy in robotics is to precisely determine the pose of the robot in space. To fulfill this task sensor fusion algorithms are often used, in which data from one or several exteroceptive sensors like, for example, LiDAR, camera, laser ranging sensor or GNSS are fused together with the Inertial Measurement Unit (IMU) measurements to obtain an estimate of the navigation states of the robot. Nonetheless, owing to their particular sensing principles, some exteroceptive sensors are often incapacitated in extreme environmental conditions, like extreme illumination or presence of fine particles in the environment like smoke or fog. Radars are largely immune to aforementioned factors thanks to the characteristics of electromagnetic waves they use. In this thesis, we present Radar-Inertial Odometry (RIO) algorithms to fuse the information from IMU and radar in order to estimate the navigation states of a (Uncrewed Aerial Vehicle) UAV capable of running on a portable resource-constrained embedded computer in real-time and making use of inexpensive, consumer-grade sensors. We present novel RIO approaches relying on the multi-state tightly-coupled Extended Kalman Filter (EKF) and Factor Graphs (FG) fusing instantaneous velocities of and distances to 3D points delivered by a lightweight, low-cost, off-the-shelf Frequency Modulated Continuous Wave (FMCW) radar with IMU readings. We also show a novel way to exploit advances in deep learning to retrieve 3D point correspondences in sparse and noisy radar point clouds.

Radar-Inertial Odometry For Computationally Constrained Aerial Navigation

TL;DR

This work addresses UAV localization in GNSS-denied and visually challenging environments by fusing a lightweight FMCW radar with an IMU. It develops multiple Radar-Inertial Odometry (RIO) approaches, including tightly-coupled Extended Kalman Filters with distance, Doppler, and measurement trails, a multi-state EKF with persistent landmarks, and a sliding-window factor-graph Rio, all capable of real-time operation on embedded hardware. A key contribution is the integration of online extrinsic calibration and, in parallel, a learning-based framework to predict robust radar 3D point correspondences, enabling improved data association in sparse, noisy radar scans. The methods demonstrate strong performance in indoor and foggy conditions, including closed-loop flights, and show competitive accuracy with vision-based systems while maintaining resilience to environmental degradation. The work also provides open-source implementations and datasets, highlighting practical viability for small-UAV autonomy under compute and sensing constraints.

Abstract

Recently, the progress in the radar sensing technology consisting in the miniaturization of the packages and increase in measuring precision has drawn the interest of the robotics research community. Indeed, a crucial task enabling autonomy in robotics is to precisely determine the pose of the robot in space. To fulfill this task sensor fusion algorithms are often used, in which data from one or several exteroceptive sensors like, for example, LiDAR, camera, laser ranging sensor or GNSS are fused together with the Inertial Measurement Unit (IMU) measurements to obtain an estimate of the navigation states of the robot. Nonetheless, owing to their particular sensing principles, some exteroceptive sensors are often incapacitated in extreme environmental conditions, like extreme illumination or presence of fine particles in the environment like smoke or fog. Radars are largely immune to aforementioned factors thanks to the characteristics of electromagnetic waves they use. In this thesis, we present Radar-Inertial Odometry (RIO) algorithms to fuse the information from IMU and radar in order to estimate the navigation states of a (Uncrewed Aerial Vehicle) UAV capable of running on a portable resource-constrained embedded computer in real-time and making use of inexpensive, consumer-grade sensors. We present novel RIO approaches relying on the multi-state tightly-coupled Extended Kalman Filter (EKF) and Factor Graphs (FG) fusing instantaneous velocities of and distances to 3D points delivered by a lightweight, low-cost, off-the-shelf Frequency Modulated Continuous Wave (FMCW) radar with IMU readings. We also show a novel way to exploit advances in deep learning to retrieve 3D point correspondences in sparse and noisy radar point clouds.
Paper Structure (69 sections, 63 equations, 59 figures, 9 tables)

This paper contains 69 sections, 63 equations, 59 figures, 9 tables.

Figures (59)

  • Figure 1: Examples of a spinning (left) and soc (right) radar sensors mentioned in the following sections. The depicted soc radar is a high-end automotive radar (Continental ARS548) used in poin_uncertlessismore. For an example of consumer-grade radar sensors (used in this work) see \ref{['fig:platform']} and \ref{['fig:ekf_rio_single_platform']}. (Spinning radar example is taken from URL
  • Figure 2: Single chirp generated by fmcw radar.
  • Figure 3: Within a single cycle multiple chirps are generated and sent out. Difference between $f_r$ and $f_c$ allows determining the $t_r$ which is the time needed to travel back and forth between the transmitter and the reflected object. Using the phase difference between the chirps we can determine the Doppler velocity of the reflected objects.
  • Figure 4: Measuring the reflections from multiple chirps at multiple receivers forms the radar data cube. The entries are complex samples of mixed chirps.
  • Figure 5: Target detection using cfar proceeds by shifting a 2D window through the range-Doppler map built from averaged values from range-Doppler maps from all the antennas. Values in the green entries within the window are averaged and used to for the comparison threshold. Values in the blue entries are so called guard cells and do not participate in the threshold calculation. CUT stands for Cell-Under-Test.
  • ...and 54 more figures