FabricGen: Microstructure-Aware Woven Fabric Generation

TL;DR

FabricGen, an end-to-end framework for generating high-quality woven fabric materials from textual descriptions that decomposition of macro-scale textures and micro-scale weaving patterns, and produces materials with significantly richer detail and realism compared to prior generative models.

Abstract

Woven fabric materials are widely used in rendering applications, yet designing realistic examples typically involves multiple stages, requiring expertise in weaving principles and texture authoring. Recent advances have explored diffusion models to streamline this process; however, pre-trained diffusion models often struggle to generate intricate yarn-level details that conform to weaving rules. To address this, we present FabricGen, an end-to-end framework for generating high-quality woven fabric materials from textual descriptions. A key insight of our method is the decomposition of macro-scale textures and micro-scale weaving patterns. To generate macro-scale textures free from microstructures, we fine-tune pre-trained diffusion models on a collected dataset of microstructure-free fabrics. As for micro-scale weaving patterns, we develop an enhanced procedural geometric model capable of synthesizing natural yarn-level geometry with yarn sliding and flyaway fibers. The procedural model is driven by a specialized large language model, WeavingLLM, which is fine-tuned on an annotated dataset of formatted weaving drafts, and prompt-tuned with domain-specific fabric expertise. Through fine-tuning and prompt tuning, WeavingLLM learns to design weaving drafts and fabric parameters from textual prompts, enabling the procedural model to produce diverse weaving patterns that stick to weaving principles. The generated macro-scale texture, along with the micro-scale geometry, can be used for fabric rendering. Consequently, our framework produces materials with significantly richer detail and realism compared to prior generative models.

Figures (11)

• Figure 1: We present FabricGen, an end-to-end material generation framework that generates woven fabric materials with fine details, enabling non-expert users to create diverse and highly detailed fabric materials for photorealistic rendering.
• Figure 2: Overview of FabricGen. Our fabric material creation framework consists of two main components: (a) an LLM-driven procedural microstructure generator that generates yarn-level microstructures along with fabric parameters, and (b) a texture generator that generates tileable, macro-scale textures from a text prompt (and optional image). Note that the two components require distinct prompts.
• Figure 3: Woven fabrics are typically constructed by interlacing weft and warp yarns following specific patterns (b), which can be represented via a binary matrix, named weaving draft (a). Each yarn may consist of multiple plies, and each ply can be further divided into a number of fibers. Some fibers escape from the surface, resulting in irregular flyaway fibers (c).
• Figure 4: Curved helix model for multi-ply yarns. The model achieves analytical normal/orientation formulation, where the yarn space arc parameters $u, v$ are linear mapped from UV space.
• Figure 5: Visualization of the normal, orientation and height maps of a 3-ply basket weave. The parameters of this case are provided in the supplementary material.