Table of Contents
Fetching ...

Copying style, Extracting value: Illustrators' Perception of AI Style Transfer and its Impact on Creative Labor

Julien Porquet, Sitong Wang, Lydia B. Chilton

TL;DR

Understanding the results of style transfer as “boundary objects” is analyzed, demonstrating that style transfer should also be understood as a supply chain optimization one and connecting the findings to critical HCI frameworks.

Abstract

Generative text-to-image models are disrupting the lives of creative professionals. Specifically, illustrators are threatened by models that claim to extract and reproduce their style. Yet, research on style transfer has rarely focused on their perspectives. We provided four illustrators with a model fine-tuned to their style and conducted semi-structured interviews about the model's successes, limitations, and potential uses. Evaluating their output, artists reported that style transfer successfully copies aesthetic fragments but is limited by content-style disentanglement and lacks the crucial emergent quality of their style. They also deemed the others' copies more successful. Understanding the results of style transfer as "boundary objects," we analyze how they can simultaneously be considered unsuccessful by artists and poised to replace their work by others. We connect our findings to critical HCI frameworks, demonstrating that style transfer, rather than merely a Creativity Support Tool, should also be understood as a supply chain optimization one.

Copying style, Extracting value: Illustrators' Perception of AI Style Transfer and its Impact on Creative Labor

TL;DR

Understanding the results of style transfer as “boundary objects” is analyzed, demonstrating that style transfer should also be understood as a supply chain optimization one and connecting the findings to critical HCI frameworks.

Abstract

Generative text-to-image models are disrupting the lives of creative professionals. Specifically, illustrators are threatened by models that claim to extract and reproduce their style. Yet, research on style transfer has rarely focused on their perspectives. We provided four illustrators with a model fine-tuned to their style and conducted semi-structured interviews about the model's successes, limitations, and potential uses. Evaluating their output, artists reported that style transfer successfully copies aesthetic fragments but is limited by content-style disentanglement and lacks the crucial emergent quality of their style. They also deemed the others' copies more successful. Understanding the results of style transfer as "boundary objects," we analyze how they can simultaneously be considered unsuccessful by artists and poised to replace their work by others. We connect our findings to critical HCI frameworks, demonstrating that style transfer, rather than merely a Creativity Support Tool, should also be understood as a supply chain optimization one.
Paper Structure (36 sections, 7 figures, 1 table)

This paper contains 36 sections, 7 figures, 1 table.

Figures (7)

  • Figure 1: Side by side of participant's work (Pn) and style transfer results (Pn')
  • Figure 2: Stable Diffusion Web User Interface used by participants
  • Figure 3: Textures evaluated as successfully copied
  • Figure 4: Shading evaluated as successfully copied
  • Figure 5: Two style transfer outputs from the prompt "Zoo animals and circus" by [P2]
  • ...and 2 more figures