Table of Contents
Fetching ...

Cutting Through the Confusion and Hype: Understanding the True Potential of Generative AI

Ante Prodan, Jo-An Occhipinti, Rehez Ahlip, Goran Ujdur, Harris A. Eyre, Kyle Goosen, Luke Penza, Mark Heffernan

TL;DR

This work seeks to provide a balanced examination of genAI's capabilities, limitations, and the profound impact it may have on societal functions and personal interactions, and highlights the need for significant investment to understand the implications of recent advancements.

Abstract

This paper explores the nuanced landscape of generative AI (genAI), particularly focusing on neural network-based models like Large Language Models (LLMs). While genAI garners both optimistic enthusiasm and sceptical criticism, this work seeks to provide a balanced examination of its capabilities, limitations, and the profound impact it may have on societal functions and personal interactions. The first section demystifies language-based genAI through detailed discussions on how LLMs learn, their computational needs, distinguishing features from supporting technologies, and the inherent limitations in their accuracy and reliability. Real-world examples illustrate the practical applications and implications of these technologies. The latter part of the paper adopts a systems perspective, evaluating how the integration of LLMs with existing technologies can enhance productivity and address emerging concerns. It highlights the need for significant investment to understand the implications of recent advancements, advocating for a well-informed dialogue to ethically and responsibly integrate genAI into diverse sectors. The paper concludes with prospective developments and recommendations, emphasizing a forward-looking approach to harnessing genAI`s potential while mitigating its risks.

Cutting Through the Confusion and Hype: Understanding the True Potential of Generative AI

TL;DR

This work seeks to provide a balanced examination of genAI's capabilities, limitations, and the profound impact it may have on societal functions and personal interactions, and highlights the need for significant investment to understand the implications of recent advancements.

Abstract

This paper explores the nuanced landscape of generative AI (genAI), particularly focusing on neural network-based models like Large Language Models (LLMs). While genAI garners both optimistic enthusiasm and sceptical criticism, this work seeks to provide a balanced examination of its capabilities, limitations, and the profound impact it may have on societal functions and personal interactions. The first section demystifies language-based genAI through detailed discussions on how LLMs learn, their computational needs, distinguishing features from supporting technologies, and the inherent limitations in their accuracy and reliability. Real-world examples illustrate the practical applications and implications of these technologies. The latter part of the paper adopts a systems perspective, evaluating how the integration of LLMs with existing technologies can enhance productivity and address emerging concerns. It highlights the need for significant investment to understand the implications of recent advancements, advocating for a well-informed dialogue to ethically and responsibly integrate genAI into diverse sectors. The paper concludes with prospective developments and recommendations, emphasizing a forward-looking approach to harnessing genAI`s potential while mitigating its risks.

Paper Structure

This paper contains 14 sections, 3 figures.

Figures (3)

  • Figure 1: LLM development cycle. Each of the steps requires careful planning, a team of experts in machine learning, data engineering, and domain-specific knowledge to successfully develop and deploy a model like GPT-3. Training requires large computational resources.
  • Figure 2: Evolution of Artificial Neural Networks that enabled creation of LLMs
  • Figure 3: Architecture of an AI application (e.g. chatbot).