GlyphWeaver: Unlocking Glyph Design Creativity with Uniform Glyph DSL and AI
Can Liu, Shiwei Chen, Zhibang Jiang, Yong Wang
TL;DR
Problem: expressive glyphs are powerful but hard to implement due to the gap between design creativity and technical tooling. The paper proposes GlyphWeaver, an interactive system that combines a glyph DSL (GDSL) with composable containers (basic, repeater, compositor), an operation-management layer built on five atomic operations, and a multimodal interface plus a translator LLM to convert inputs into GDSL edits. The main contributions are (i) the GDSL as a hierarchical, composable representation for diverse glyphs, (ii) an atomic-operation management mechanism that enables non-programmers to construct complex glyphs, and (iii) a multimodal interaction workflow that integrates natural language and direct manipulation via an MLLM translator. The authors validate by analyzing 50 Information is Beautiful glyphs, showing all structures can be expressed with the container types, and demonstrate a workflow that reduces development effort while preserving design agency. The work advances practical, designer-friendly generation of expressive multivariate glyphs and lays groundwork for end-to-end visualization pipelines with data transformations.
Abstract
Expressive glyph visualizations provide a powerful and versatile means to represent complex multivariate data through compact visual encodings, but creating custom glyphs remains challenging due to the gap between design creativity and technical implementation. We present GlyphWeaver, a novel interactive system to enable an easy creation of expressive glyph visualizations. Our system comprises three key components: a glyph domain-specific language (GDSL), a GDSL operation management mechanism, and a multimodal interaction interface. The GDSL is a hierarchical container model, where each container is independent and composable, providing a rigorous yet practical foundation for complex glyph visualizations. The operation management mechanism restricts modifications of the GDSL to atomic operations, making it accessible without requiring direct coding. The multimodal interaction interface enables direct manipulation, natural language commands, and parameter adjustments. A multimodal large language model acts as a translator, converting these inputs into GDSL operations. GlyphWeaver significantly lowers the barrier for designers, who often do not have extensive programming skills, to create sophisticated glyph visualizations.