Table of Contents
Fetching ...

Evolutionary Computation as Natural Generative AI

Yaxin Shi, Abhishek Gupta, Ying Wu, Melvin Wong, Ivor Tsang, Thiago Rios, Stefan Menzel, Bernhard Sendhoff, Yaqing Hou, Yew-Soon Ong

TL;DR

This paper reframes Evolutionary Computation (EC) as Natural Generative AI (NatGenAI), arguing that EC can surpass conventional GenAI by using exploratory search under natural selection to produce out of distribution artifacts. It establishes formal links between classical EC and GenAI through probabilistic formalisms like Information-Geometric Optimization (IGO) and Estimation of Distribution Algorithms (EDAs), and shows how GenAI methods can be embedded into EC as probabilistic variation. The work introduces multitask evolutionary computation (MTEC) and disruptive operators to enable cross domain feature fusion and major creative leaps, demonstrated with car and airplane design tasks under LLM guided crossover. The results suggest that NatGenAI can drive sustained innovation by combining structured disruption with moderated selection pressure, enabling open ended design and discovery across scientific and engineering domains.

Abstract

Generative AI (GenAI) has achieved remarkable success across a range of domains, but its capabilities remain constrained to statistical models of finite training sets and learning based on local gradient signals. This often results in artifacts that are more derivative than genuinely generative. In contrast, Evolutionary Computation (EC) offers a search-driven pathway to greater diversity and creativity, expanding generative capabilities by exploring uncharted solution spaces beyond the limits of available data. This work establishes a fundamental connection between EC and GenAI, redefining EC as Natural Generative AI (NatGenAI) -- a generative paradigm governed by exploratory search under natural selection. We demonstrate that classical EC with parent-centric operators mirrors conventional GenAI, while disruptive operators enable structured evolutionary leaps, often within just a few generations, to generate out-of-distribution artifacts. Moreover, the methods of evolutionary multitasking provide an unparalleled means of integrating disruptive EC (with cross-domain recombination of evolved features) and moderated selection mechanisms (allowing novel solutions to survive), thereby fostering sustained innovation. By reframing EC as NatGenAI, we emphasize structured disruption and selection pressure moderation as essential drivers of creativity. This perspective extends the generative paradigm beyond conventional boundaries and positions EC as crucial to advancing exploratory design, innovation, scientific discovery, and open-ended generation in the GenAI era.

Evolutionary Computation as Natural Generative AI

TL;DR

This paper reframes Evolutionary Computation (EC) as Natural Generative AI (NatGenAI), arguing that EC can surpass conventional GenAI by using exploratory search under natural selection to produce out of distribution artifacts. It establishes formal links between classical EC and GenAI through probabilistic formalisms like Information-Geometric Optimization (IGO) and Estimation of Distribution Algorithms (EDAs), and shows how GenAI methods can be embedded into EC as probabilistic variation. The work introduces multitask evolutionary computation (MTEC) and disruptive operators to enable cross domain feature fusion and major creative leaps, demonstrated with car and airplane design tasks under LLM guided crossover. The results suggest that NatGenAI can drive sustained innovation by combining structured disruption with moderated selection pressure, enabling open ended design and discovery across scientific and engineering domains.

Abstract

Generative AI (GenAI) has achieved remarkable success across a range of domains, but its capabilities remain constrained to statistical models of finite training sets and learning based on local gradient signals. This often results in artifacts that are more derivative than genuinely generative. In contrast, Evolutionary Computation (EC) offers a search-driven pathway to greater diversity and creativity, expanding generative capabilities by exploring uncharted solution spaces beyond the limits of available data. This work establishes a fundamental connection between EC and GenAI, redefining EC as Natural Generative AI (NatGenAI) -- a generative paradigm governed by exploratory search under natural selection. We demonstrate that classical EC with parent-centric operators mirrors conventional GenAI, while disruptive operators enable structured evolutionary leaps, often within just a few generations, to generate out-of-distribution artifacts. Moreover, the methods of evolutionary multitasking provide an unparalleled means of integrating disruptive EC (with cross-domain recombination of evolved features) and moderated selection mechanisms (allowing novel solutions to survive), thereby fostering sustained innovation. By reframing EC as NatGenAI, we emphasize structured disruption and selection pressure moderation as essential drivers of creativity. This perspective extends the generative paradigm beyond conventional boundaries and positions EC as crucial to advancing exploratory design, innovation, scientific discovery, and open-ended generation in the GenAI era.

Paper Structure

This paper contains 20 sections, 19 equations, 7 figures.

Figures (7)

  • Figure 1: Illustration of the GenAI-EDA workflow where modern GenAI algorithms may be used for probabilistic modeling and solution sampling.
  • Figure 2: A comparison of offspring produced by EC with the parent-centric SBX operator versus GenAI-EDA with explicit population modeling. Complex parental distributions are intentionally used to visualize generated outcomes in a general setting. Note that the SBX operator is gradient-free and does not require training of a statistical model.
  • Figure 3: A comparison of offspring produced by multitask EC with parent-centric genetic operators versus population sampling from a mixture of generative models. $Pop^{s}_A(t)$ and $Pop^{s}_B(t)$ represent parent populations for Tasks A and B at generation $t$, while $Pop_A(t+1)$ and $Pop_B(t+1)$ represent the offspring populations for these tasks.
  • Figure 4: A comparison of offspring produced by MTEC with disruptive genetic operators versus population sampling from a product of generative models. The red circle marks an evolutionary leap outside the parent convex hulls due to the structured disruption of the variation operator.
  • Figure 5: Illustration of MTEC with LLM-guided disruptive operators for creative design. Adapting the methodology from wong2024llm2fea, parent chromosomes from distinct tasks—car and aircraft design—are recombined by the LLM (which is conjectured to have an effect akin to OB-Scan). The resulting offspring inherits dominant features from both domains (e.g., jet-inspired car body), enabling out-of-distribution design synthesis. Evolution progressively refines such hybrids under MTEC's moderated selection pressure, with the final solution integrating features from multiple conceptual domains (e.g., car, jet, and yacht).
  • ...and 2 more figures