Simultaneous approximation by neural network operators with applications to Voronovskaja formulas
Marco Cantarini, Danilo Costarelli
TL;DR
This work addresses the simultaneous approximation of a function $f$ and its derivatives using neural network operators activated by sigmoidal functions. It develops a constructive framework, establishing uniform convergence of derivatives up to order $m$ on a subinterval $I_\delta$ and providing quantitative estimates via the modulus of continuity, together with Voronovskaja-type formulas that capture the exact high-order convergence through density-moment constants. The analysis hinges on truncated algebraic moments and Strang–Fix type conditions for the sigmoidal density $\,\phi_{\sigma}$, yielding explicit moment identities and enabling high-order results. Practical implications include precise derivative reconstruction from sampled data and potential applications in signal and image processing, with concrete examples (e.g., logistic activation) illustrating the theory.
Abstract
In this paper, we considered the problem of the simultaneous approximation of a function and its derivatives by means of the well-known neural network (NN) operators activated by sigmoidal function. Other than a uniform convergence theorem for the derivatives of NN operators, we also provide a quantitative estimate for the order of approximation based on the modulus of continuity of the approximated derivative. Furthermore, a qualitative and quantitative Voronovskaja-type formula is established, which provides information about the high order of approximation that can be achieved by NN operators. To prove the above theorems, several auxiliary results involving sigmoidal functions have been established. At the end of the paper, noteworthy examples have been discussed in detail.
