Lens Distortion Encoding System Version 1.0
Jakub Maksymilian Fober
TL;DR
LDES introduces a distortion-accurate workflow that unifies lens distortion handling across sources by encoding absolute pixel positions in a spherical image model using two STMap textures per lens profile (View Map and Footage Map). It supports animated transitions between distortion profiles (e.g., anamorphic to spherical), integrates with standard STMap plug-ins, and enables direct ray-tracing and camera-motion workflows, effectively decoupling lens hardware from creative outcomes. The system rests on a cartographic fisheye foundation with multiple extensions (anamorphic, aximorphic, Brown-Conrady variants) to model real-world distortions, plus calibration methods and practical workflow guidelines for compositing scenes with CGI and real footage. Together, these contributions offer precise artistic control, cost-efficient look-control via synthetic lenses, and broad applicability in post-production and rendering pipelines, advancing both practical production workflows and distortion modeling research.
Abstract
Lens Distortion Encoding System (LDES) allows for a distortion-accurate workflow, with a seamless interchange of high quality motion picture images regardless of the lens source. This system is similar in a concept to the Academy Color Encoding System (ACES), but for distortion. Presented solution is fully compatible with existing software/plug-in tools for STMapping found in popular production software like Adobe After Effects or DaVinci Resolve. LDES utilizes common distortion space and produces single high-quality, animatable STMap used for direct transformation of one view to another, neglecting the need of lens-swapping for each shoot. The LDES profile of a lens consist of two elements; View Map texture, and Footage Map texture, each labeled with the FOV value. Direct distortion mapping is produced by sampling of the Footage Map through the View Map. The result; animatable mapping texture, is then used to sample the footage to a desired distortion. While the Footage Map is specific to a footage, View Maps can be freely combined/transitioned and animated, allowing for effects like smooth shift from anamorphic to spherical distortion, previously impossible to achieve in practice. Presented LDES Version 1.0 uses common 32-bit STMap format for encoding, supported by most compositing software, directly or via plug-ins. The difference between standard STMap workflow and LDES is that it encodes absolute pixel position in the spherical image model. The main benefit of this approach is the ability to achieve a similar look of a highly expensive lens using some less expensive equipment in terms of distortion. It also provides greater artistic control and never seen before manipulation of footage.