Logo
ScienceStack
Table of Contents
Fetching ...
Sign In

Opportunities for Large Language Models and Discourse in Engineering Design

Jan Göpfert, Jann M. Weinand, Patrick Kuckertz, Detlef Stolten

TL;DR

This paper argues that engineering design should be reframed as a goal-oriented, argumentative discourse and that foundation models, including large language models, can participate as interlocutors within a machine-actionable digital artifact of the design process. It surveys current NLP and computational engineering-design advances, and outlines a conceptual framework where simulations, topology optimizations, and experiments are integrated into discourse-driven workflows. The authors propose a research agenda focused on formalizing the discourse, building machine-actionable interfaces for engineering tools, learning representations aligned with engineering skills, and establishing domain-specific evaluation metrics and datasets. If realized, this discourse-centric approach could enhance documentation, traceability, collaboration, and automated support for complex engineering tasks.

Abstract

In recent years, large language models have achieved breakthroughs on a wide range of benchmarks in natural language processing and continue to increase in performance. Recently, the advances of large language models have raised interest outside the natural language processing community and could have a large impact on daily life. In this paper, we pose the question: How will large language models and other foundation models shape the future product development process? We provide the reader with an overview of the subject by summarizing both recent advances in natural language processing and the use of information technology in the engineering design process. We argue that discourse should be regarded as the core of engineering design processes, and therefore should be represented in a digital artifact. On this basis, we describe how foundation models such as large language models could contribute to the design discourse by automating parts thereof that involve creativity and reasoning, and were previously reserved for humans. We describe how simulations, experiments, topology optimizations, and other process steps can be integrated into a machine-actionable, discourse-centric design process. Finally, we outline the future research that will be necessary for the implementation of the conceptualized framework.

Opportunities for Large Language Models and Discourse in Engineering Design

TL;DR

This paper argues that engineering design should be reframed as a goal-oriented, argumentative discourse and that foundation models, including large language models, can participate as interlocutors within a machine-actionable digital artifact of the design process. It surveys current NLP and computational engineering-design advances, and outlines a conceptual framework where simulations, topology optimizations, and experiments are integrated into discourse-driven workflows. The authors propose a research agenda focused on formalizing the discourse, building machine-actionable interfaces for engineering tools, learning representations aligned with engineering skills, and establishing domain-specific evaluation metrics and datasets. If realized, this discourse-centric approach could enhance documentation, traceability, collaboration, and automated support for complex engineering tasks.

Abstract

In recent years, large language models have achieved breakthroughs on a wide range of benchmarks in natural language processing and continue to increase in performance. Recently, the advances of large language models have raised interest outside the natural language processing community and could have a large impact on daily life. In this paper, we pose the question: How will large language models and other foundation models shape the future product development process? We provide the reader with an overview of the subject by summarizing both recent advances in natural language processing and the use of information technology in the engineering design process. We argue that discourse should be regarded as the core of engineering design processes, and therefore should be represented in a digital artifact. On this basis, we describe how foundation models such as large language models could contribute to the design discourse by automating parts thereof that involve creativity and reasoning, and were previously reserved for humans. We describe how simulations, experiments, topology optimizations, and other process steps can be integrated into a machine-actionable, discourse-centric design process. Finally, we outline the future research that will be necessary for the implementation of the conceptualized framework.
Paper Structure (12 sections, 2 figures)

This paper contains 12 sections, 2 figures.

Table of Contents

  1. Introduction
  2. Background
  3. LLMs and foundation models
  4. Computational engineering design
  5. Depicting the design process as a goal-oriented, argumentative discourse
  6. Foundation models as interlocutors in the design discourse
  7. Recommendations for future research
  8. Formalizing the engineering design discourse within a framework of stages and components.
  9. Creating machine-actionable interfaces for engineering software.
  10. Learning representations better corresponding to skills required for engineering.
  11. Specifying evaluation metrics and datasets.
  12. Conclusion

Figures (2)

  • Figure 1: The engineering design process depicted as a goal-oriented, argumentative discourse formed by inter- and intrapersonal communication in which machines can participate. As part of this discourse, external actions are invoked that in turn inform it.
  • Figure 2: An example of a design discourse. Note that the system outputs should clarify the ideas presented here and are not real outputs.