Table of Contents
Fetching ...

Approximation properties relative to continuous scale space for hybrid discretizations of Gaussian derivative operators

Tony Lindeberg

TL;DR

This work analyzes two hybrid discretisations for Gaussian derivative operators—one using a normalised sampled Gaussian kernel and the other using an integrated Gaussian kernel—paired with central differences, and compares them against fully continuous and genuinely discrete discretisations. It introduces quantitative metrics for spatial smoothing (via $\sqrt{V(|T_{x^{\alpha}}(\cdot;s)|)}$) and scale-estimation accuracy (via $O_{\alpha}(s)$ and $E_{\text{scaleest,rel}}(\sigma)$) to assess how well discretised operators preserve scale-space properties, especially at very small scales where discrepancies arise. The methodology extends scale-space analysis to 2-D with separable implementations and evaluates scale-selection detectors (Laplacian, Hessian, gradient magnitude, and ridge) under automatic scale selection, revealing trade-offs: hybrids offer computational efficiency but can diverge from continuous theory at fine scales, while the discrete analogue kernel generally aligns best with continuous expectations. The findings guide discretisation choices for multi-scale Gaussian-derivative tasks, including deep-learning contexts where primitive kernels like modified Bessel functions may be unavailable, and provide practical code in the pyscsp package for reproducibility and integration into scale-space or deep learning pipelines.

Abstract

This paper presents an analysis of properties of two hybrid discretization methods for Gaussian derivatives, based on convolutions with either the normalized sampled Gaussian kernel or the integrated Gaussian kernel followed by central differences. The motivation for studying these discretization methods is that in situations when multiple spatial derivatives of different order are needed at the same scale level, they can be computed significantly more efficiently compared to more direct derivative approximations based on explicit convolutions with either sampled Gaussian kernels or integrated Gaussian kernels. While these computational benefits do also hold for the genuinely discrete approach for computing discrete analogues of Gaussian derivatives, based on convolution with the discrete analogue of the Gaussian kernel followed by central differences, the underlying mathematical primitives for the discrete analogue of the Gaussian kernel, in terms of modified Bessel functions of integer order, may not be available in certain frameworks for image processing, such as when performing deep learning based on scale-parameterized filters in terms of Gaussian derivatives, with learning of the scale levels. In this paper, we present a characterization of the properties of these hybrid discretization methods, in terms of quantitative performance measures concerning the amount of spatial smoothing that they imply, as well as the relative consistency of scale estimates obtained from scale-invariant feature detectors with automatic scale selection, with an emphasis on the behaviour for very small values of the scale parameter, which may differ significantly from corresponding results obtained from the fully continuous scale-space theory, as well as between different types of discretization methods.

Approximation properties relative to continuous scale space for hybrid discretizations of Gaussian derivative operators

TL;DR

This work analyzes two hybrid discretisations for Gaussian derivative operators—one using a normalised sampled Gaussian kernel and the other using an integrated Gaussian kernel—paired with central differences, and compares them against fully continuous and genuinely discrete discretisations. It introduces quantitative metrics for spatial smoothing (via ) and scale-estimation accuracy (via and ) to assess how well discretised operators preserve scale-space properties, especially at very small scales where discrepancies arise. The methodology extends scale-space analysis to 2-D with separable implementations and evaluates scale-selection detectors (Laplacian, Hessian, gradient magnitude, and ridge) under automatic scale selection, revealing trade-offs: hybrids offer computational efficiency but can diverge from continuous theory at fine scales, while the discrete analogue kernel generally aligns best with continuous expectations. The findings guide discretisation choices for multi-scale Gaussian-derivative tasks, including deep-learning contexts where primitive kernels like modified Bessel functions may be unavailable, and provide practical code in the pyscsp package for reproducibility and integration into scale-space or deep learning pipelines.

Abstract

This paper presents an analysis of properties of two hybrid discretization methods for Gaussian derivatives, based on convolutions with either the normalized sampled Gaussian kernel or the integrated Gaussian kernel followed by central differences. The motivation for studying these discretization methods is that in situations when multiple spatial derivatives of different order are needed at the same scale level, they can be computed significantly more efficiently compared to more direct derivative approximations based on explicit convolutions with either sampled Gaussian kernels or integrated Gaussian kernels. While these computational benefits do also hold for the genuinely discrete approach for computing discrete analogues of Gaussian derivatives, based on convolution with the discrete analogue of the Gaussian kernel followed by central differences, the underlying mathematical primitives for the discrete analogue of the Gaussian kernel, in terms of modified Bessel functions of integer order, may not be available in certain frameworks for image processing, such as when performing deep learning based on scale-parameterized filters in terms of Gaussian derivatives, with learning of the scale levels. In this paper, we present a characterization of the properties of these hybrid discretization methods, in terms of quantitative performance measures concerning the amount of spatial smoothing that they imply, as well as the relative consistency of scale estimates obtained from scale-invariant feature detectors with automatic scale selection, with an emphasis on the behaviour for very small values of the scale parameter, which may differ significantly from corresponding results obtained from the fully continuous scale-space theory, as well as between different types of discretization methods.
Paper Structure (32 sections, 49 equations, 9 figures)

This paper contains 32 sections, 49 equations, 9 figures.

Figures (9)

  • Figure 1: Graphs of the main types of Gaussian smoothing kernels as well as of the equivalent convolution kernels for the hybrid discretisations of Gaussian derivative operators considered specially in this paper, here at the scale $\sigma = 1$, with the raw smoothing kernels in the top row and the order of spatial differentiation increasing downwards up to order 4: (left column) continuous Gaussian kernel and continuous Gaussian derivatives, (middle column) normalised sampled Gaussian kernel and central differences applied to the normalised sampled Gaussian kernel, (right column) integrated Gaussian kernel and central differences applied to the integrated Gaussian kernel. Note that the scaling of the vertical axis may vary between the different subfigures. ( Horizontal axes: the 1-D spatial coordinate $x \in [-5, 5]$.) (Graphs of the regular sampled Gaussian derivative kernels, the regular integrated Gaussian derivative kernels and the discrete analogues of Gaussian derivatives up to order 4 are shown in Figure 1 in (Lindeberg Lin24-JMIV).)
  • Figure 2: Graphs of the spatial spread measure$\sqrt{V(|T_{x^{\alpha}}(\cdot;\; s)|)}$ according to (\ref{['eq-def-rel-scale-err-gauss-ders']}) for different discrete approximations of Gaussian derivative kernels of order $\alpha$: (i) for either discrete analogues of Gaussian derivative kernels $T_{\scriptsize\hbox{disc},x^{\alpha}}(n;\; s)$ according to (\ref{['eq-disc-der-gauss']}), corresponding to convolutions with the discrete analogue of the Gaussian kernel $T_{\scriptsize\hbox{disc}}(n;\; s)$ according to (\ref{['eq-disc-gauss']}) followed by central differences according to (\ref{['eq-def-cent-diff-op-arb-order']}), (ii) sampled Gaussian derivative kernels $T_{\scriptsize\hbox{sampl},x^{\alpha}}(n;\, s)$ according to (\ref{['eq-sampl-gauss-der']}), (iii) integrated Gaussian derivative kernels $T_{\scriptsize\hbox{int},x^{\alpha}}(n;\, s)$ according to (\ref{['eq-def-int-gauss-der']}), (iv) the hybrid discretisation kernel $T_{\scriptsize\hbox{hybr-sampl},x^{\alpha}}(n;\; s)$ according to (\ref{['eq-hybr-normsampl-disc-der']}), corresponding to convolution with the normalised sampled Gaussian kernel $T_{\scriptsize\hbox{normsampl}}(n;\; s)$ according to (\ref{['eq-def-norm-sampl-gauss']}) followed by central differences according to (\ref{['eq-def-cent-diff-op-arb-order']}), and (v) the hybrid discretisation kernel $T_{\scriptsize\hbox{hybr-int},x^{\alpha}}(n;\; s)$ according to (\ref{['eq-hybr-int-disc-der']}), corresponding to convolution with the integrated Gaussian kernel $T_{\scriptsize\hbox{int}}(n;\; s)$ according to (\ref{['eq-def-int-gauss-kern']}) followed by central differences according to (\ref{['eq-def-cent-diff-op-arb-order']}). ( Horizontal axes: Scale parameter in units of $\sigma = \sqrt{s} \in [0.1, 2]$.)
  • Figure 3: Graphs of the spatial spread measure offset$O_{\alpha}(s)$, relative to the spatial spread of a continuous Gaussian kernel, according to (\ref{['eq-spat-spread-meas-offset']}), for different discrete approximations of Gaussian derivative kernels of order $\alpha$: (i) for either discrete analogues of Gaussian derivative kernels $T_{\scriptsize\hbox{disc},x^{\alpha}}(n;\; s)$ according to (\ref{['eq-disc-der-gauss']}), corresponding to convolutions with the discrete analogue of the Gaussian kernel $T_{\scriptsize\hbox{disc}}(n;\; s)$ according to (\ref{['eq-disc-gauss']}) followed by central differences according to (\ref{['eq-def-cent-diff-op-arb-order']}), (ii) sampled Gaussian derivative kernels $T_{\scriptsize\hbox{sampl},x^{\alpha}}(n;\, s)$ according to (\ref{['eq-sampl-gauss-der']}), (iii) integrated Gaussian derivative kernels $T_{\scriptsize\hbox{int},x^{\alpha}}(n;\, s)$ according to (\ref{['eq-def-int-gauss-der']}), (iv) the hybrid discretisation kernel $T_{\scriptsize\hbox{hybr-sampl},x^{\alpha}}(n;\; s)$ according to (\ref{['eq-hybr-normsampl-disc-der']}), corresponding to convolution with the normalised sampled Gaussian kernel $T_{\scriptsize\hbox{normsampl}}(n;\; s)$ according to (\ref{['eq-def-norm-sampl-gauss']}) followed by central differences according to (\ref{['eq-def-cent-diff-op-arb-order']}), and (v) the hybrid discretisation kernel $T_{\scriptsize\hbox{hybr-int},x^{\alpha}}(n;\; s)$ according to (\ref{['eq-hybr-int-disc-der']}), corresponding to convolution with the integrated Gaussian kernel $T_{\scriptsize\hbox{int}}(n;\; s)$ according to (\ref{['eq-def-int-gauss-kern']}) followed by central differences according to (\ref{['eq-def-cent-diff-op-arb-order']}). ( Horizontal axes: Scale parameter in units of $\sigma = \sqrt{s} \in [0.1, 2]$.)
  • Figure 4: Graphs of the selected scales$\hat{\sigma} = \sqrt{\hat{s}}$ as well as the relative scale estimation error$E_{\scriptsize\hbox{scaleest,rel}}(\sigma)$, according to (\ref{['eq-def-sc-sel-rel-sc-err']}), when (left column) applying scale selection from local extrema over scale of the scale-normalised Laplacian response according to (\ref{['eq-sc-norm-lapl']}) to a set of Gaussian blobs of different size $\sigma_{\scriptsize\hbox{ref}} = \sigma_0$, for different discrete approximations of the Gaussian derivative kernels or (right column) when applying scale selection from local extrema over scale of the scale-normalised gradient magnitude response according to (\ref{['eq-sc-norm-grad-magn']}) to a set of diffuse step edges of different width $\sigma_{\scriptsize\hbox{ref}} = \sigma_0$, for either (i) discrete analogues of Gaussian derivative kernels $T_{\scriptsize\hbox{disc},x^{\alpha}}(n;\; s)$ according to (\ref{['eq-disc-der-gauss']}), (ii) sampled Gaussian derivative kernels $T_{\scriptsize\hbox{sampl},x^{\alpha}}(n;\, s)$ according to (\ref{['eq-sampl-gauss-der']}), (iii) integrated Gaussian derivative kernels $T_{\scriptsize\hbox{int},x^{\alpha}}(n;\, s)$ according to (\ref{['eq-def-int-gauss-der']}), (iv) the hybrid discretisation method corresponding the equivalent convolution kernels $T_{\scriptsize\hbox{hybr-sampl},x^{\alpha}}(n;\; s)$ according to (\ref{['eq-hybr-normsampl-disc-der']}) or (v) the hybrid discretisation method corresponding the equivalent convolution kernels $T_{\scriptsize\hbox{hybr-int},x^{\alpha}}(n;\; s)$ according to (\ref{['eq-hybr-int-disc-der']}). ( Horizontal axes: Reference scale $\sigma_{\scriptsize\hbox{ref}} = \sigma_0 \in [1/3, 3]$.)
  • Figure 5: Graphs of the selected scales$\hat{\sigma} = \sqrt{\hat{s}}$ as well as the relative scale estimation error$E_{\scriptsize\hbox{scaleest,rel}}(\sigma)$, according to (34) when (left column) applying scale selection from local extrema over scale of the scale-normalised determinant of Hessian response according to (22) to a set of Gaussian blobs of different size $\sigma_{\scriptsize\hbox{ref}} = \sigma_0$, for different discrete approximations of the Gaussian derivative kernels or (right column) when applying scale selection from local extrema over scale of the scale-normalised principal curvature response according to (30) to a set of Gaussian ridges of different width $\sigma_{\scriptsize\hbox{ref}} = \sigma_0$, for either (i) discrete analogues of Gaussian derivative kernels $T_{\scriptsize\hbox{disc},x^{\alpha}}(n;\; s)$ according to (10), (ii) sampled Gaussian derivative kernels $T_{\scriptsize\hbox{sampl},x^{\alpha}}(n;\, s)$ according to (8), (iii) integrated Gaussian derivative kernels $T_{\scriptsize\hbox{int},x^{\alpha}}(n;\, s)$ according to (9), (iv) the hybrid discretisation method corresponding the equivalent convolution kernels $T_{\scriptsize\hbox{hybr-sampl},x^{\alpha}}(n;\; s)$ according to (16) or (v) the hybrid discretisation method corresponding the equivalent convolution kernels $T_{\scriptsize\hbox{hybr-int},x^{\alpha}}(n;\; s)$ according to (17). ( Horizontal axes: Reference scale $\sigma_{\scriptsize\hbox{ref}} = \sigma_0 \in [1/3, 3]$.)
  • ...and 4 more figures