Claycode: Stylable and Deformable 2D Scannable Codes

TL;DR

Claycode presents a topological encoding framework for 2D scannable codes that enables extensive styling and deformation tolerance. Messages are encoded into a topology tree and rendered as nested color regions inside a target polygon, with real-time decoding from camera streams. The approach combines a Squares-based bit-tree encoding, a packing algorithm (packer) with padding and partitioning, and a topology-aware scanner using CRC validation and a redundancy scheme. Empirical results show Claycodes outperform traditional QR and Code128 codes under heavy deformation, occlusion, and styling, enabling robust use on shaped media and fabrics.

Abstract

This paper introduces Claycode, a novel 2D scannable code designed for extensive stylization and deformation. Unlike traditional matrix-based codes (e.g., QR codes), Claycodes encode their message in a tree structure. During the encoding process, bits are mapped into a topology tree, which is then depicted as a nesting of color regions drawn within the boundaries of a target polygon shape. When decoding, Claycodes are extracted and interpreted in real-time from a camera stream. We detail the end-to-end pipeline and show that Claycodes allow for extensive stylization without compromising their functionality. We then empirically demonstrate Claycode's high tolerance to heavy deformations, outperforming traditional 2D scannable codes in scenarios where they typically fail.

Figures (17)

• Figure 1: The encoding and decoding pipeline of Claycodes.
• Figure 2: Isomorphic trees map to the same Claycode.
• Figure 3: Shallow trees are more space-efficient.
• Figure 4: The Squares bit-tree encoding.
• Figure 5: The total footprint of the Squares, Cubes, and Abe's encoding.