Table of Contents
Fetching ...

Exploring the usage of Probabilistic Neural Networks for Ionospheric electron density estimation

Miquel Garcia-Fernandez

TL;DR

This work tackles the lack of uncertainty quantification in ionospheric $VTEC$ predictions for GNSS-based positioning by employing Probabilistic Neural Networks (PNNs) to deliver both point estimates and uncertainty. It compares fully probabilistic (BNN) and hybrid (HBNN) architectures with Gaussian priors/posteriors using 2009 IONEX data and a 100-run ensemble approach to produce mean $VTEC$ and accompanying uncertainty. A key finding is that the PNN-provided uncertainty tends to be systematically underestimated, especially at low latitudes and during solar maximum, indicating a need for calibration to produce reliable confidence estimates. Overall, the study demonstrates a feasible path toward uncertainty-aware ionospheric corrections, with implications for improving PPP convergence and safety-critical warning systems, albeit pending calibration and broader data coverage.

Abstract

A fundamental limitation of traditional Neural Networks (NN) in predictive modelling is their inability to quantify uncertainty in their outputs. In critical applications like positioning systems, understanding the reliability of predictions is critical for constructing confidence intervals, early warning systems, and effectively propagating results. For instance, Precise Point Positioning in satellite navigation heavily relies on accurate error models for ancillary data (orbits, clocks, ionosphere, and troposphere) to compute precise error estimates. In addition, these uncertainty estimates are needed to establish robust protection levels in safety critical applications. To address this challenge, the main objectives of this paper aims at exploring a potential framework capable of providing both point estimates and associated uncertainty measures of ionospheric Vertical Total Electron Content (VTEC). In this context, Probabilistic Neural Networks (PNNs) offer a promising approach to achieve this goal. However, constructing an effective PNN requires meticulous design of hidden and output layers, as well as careful definition of prior and posterior probability distributions for network weights and biases. A key finding of this study is that the uncertainty provided by the PNN model in VTEC estimates may be systematically underestimated. In low-latitude areas, the actual error was observed to be as much as twice the model's estimate. This underestimation is expected to be more pronounced during solar maximum, correlating with increased VTEC values.

Exploring the usage of Probabilistic Neural Networks for Ionospheric electron density estimation

TL;DR

This work tackles the lack of uncertainty quantification in ionospheric predictions for GNSS-based positioning by employing Probabilistic Neural Networks (PNNs) to deliver both point estimates and uncertainty. It compares fully probabilistic (BNN) and hybrid (HBNN) architectures with Gaussian priors/posteriors using 2009 IONEX data and a 100-run ensemble approach to produce mean and accompanying uncertainty. A key finding is that the PNN-provided uncertainty tends to be systematically underestimated, especially at low latitudes and during solar maximum, indicating a need for calibration to produce reliable confidence estimates. Overall, the study demonstrates a feasible path toward uncertainty-aware ionospheric corrections, with implications for improving PPP convergence and safety-critical warning systems, albeit pending calibration and broader data coverage.

Abstract

A fundamental limitation of traditional Neural Networks (NN) in predictive modelling is their inability to quantify uncertainty in their outputs. In critical applications like positioning systems, understanding the reliability of predictions is critical for constructing confidence intervals, early warning systems, and effectively propagating results. For instance, Precise Point Positioning in satellite navigation heavily relies on accurate error models for ancillary data (orbits, clocks, ionosphere, and troposphere) to compute precise error estimates. In addition, these uncertainty estimates are needed to establish robust protection levels in safety critical applications. To address this challenge, the main objectives of this paper aims at exploring a potential framework capable of providing both point estimates and associated uncertainty measures of ionospheric Vertical Total Electron Content (VTEC). In this context, Probabilistic Neural Networks (PNNs) offer a promising approach to achieve this goal. However, constructing an effective PNN requires meticulous design of hidden and output layers, as well as careful definition of prior and posterior probability distributions for network weights and biases. A key finding of this study is that the uncertainty provided by the PNN model in VTEC estimates may be systematically underestimated. In low-latitude areas, the actual error was observed to be as much as twice the model's estimate. This underestimation is expected to be more pronounced during solar maximum, correlating with increased VTEC values.

Paper Structure

This paper contains 7 sections, 5 figures.

Figures (5)

  • Figure 1: Different types of probabilistic neural network concepts: (a) point estimate neural network (i.e. non-probabilistic neural network), (b) neuron activation driven through a stochastic distribution of probability and (c) neuron weights and biases driven through a stochastic distribution of probability. Source: Figure 3 of jospin2022hands
  • Figure 4: Examples of performance using different network architectures, with different distributions of probabilistic and non-probabilistic layers. Top panel shows the reference VTEC for comparison, extracted from a single-layer IONEX map computed by IGS. Middle shows a full Bayesian Neural Network (all layers probabilistic, based on architecture V64-V32-V16-V1). Bottom shows a hybrid BNN (HBNN), based on architecture V64-D32-D16-D1 where the first layer is probabilistic (i.e. “V”)
  • Figure 5: Impact of the batch size in the training stage in a HBNN with 2 hidden layers (the first one being probabilistic). A large batch size (e.g. 1024, top panel) might lead to incorrect results, while reducing them too much will show very similar results (middle and bottom panels, for batch sizes 128 and 32)
  • Figure 6: (Top) Example of VTEC uncertainty give by one of the HBNN networks under examination (details on the subtitle) and (bottom) actual VTEC difference (error) as compared with the reference VTEC from IONEX map.
  • Figure 7: Comparison between the true VTEC error (red) and the BNN uncertainty (blue) vs latitude for (left) day and (right) night periods. Note: MAE stands for Maximum Absolute Error