On the accumulation of separatrices by invariant circles
Anatole Katok, Raphaël Krikorian
TL;DR
The paper analyzes accumulation of invariant circles near a non-split separatrix for smooth symplectic diffeomorphisms of ${\mathbb R}^2$. By combining Birkhoff and Symplectic Sternberg normal forms with a careful renormalization via fundamental domains and first-return maps, the authors prove that, for small perturbations that arise as time-1 maps of autonomous Hamiltonians, the separatrix is accumulated by a positive-measure set of $C^r$ invariant circles, which are KAM circles when regularity allows. A central tool is the Translated Curve Theorem, applied to a rescaled renormalized map $\mathring{f}_{\varepsilon,n}$, yielding invariant translated graphs that lift to invariant curves for the original map $f_{\varepsilon}$. The construction also exhibits non-perturbative examples where the separatrix is Lyapunov unstable and not accumulated by invariant circles, illustrating the necessity of smallness in the perturbative setting. Together, these results connect Herman’s geometric intuition with modern renormalization and twist-map techniques, deepening understanding of instability zones and the persistence of invariant structures near separatrices.
Abstract
Let $f$ be a smooth symplectic diffeomorphism of $\mathbb{R}^2$ admitting a (non-split) separatrix associated to a hyperbolic fixed point. We prove that if $f$ is a perturbation of the time-1 map of a symplectic autonomous vector field, this separatrix is accumulated by a positive measure set of invariant circles. On the other hand, we provide examples of smooth symplectic diffeomorphisms with a Lyapunov unstable non-split separatrix that are not accumulated by invariant circles.
