Logo
ScienceStack
Table of Contents
Fetching ...
Sign In

One Small Step for Generative AI, One Giant Leap for AGI: A Complete Survey on ChatGPT in AIGC Era

Chaoning Zhang, Chenshuang Zhang, Chenghao Li, Yu Qiao, Sheng Zheng, Sumit Kumar Dam, Mengchun Zhang, Jung Uk Kim, Seong Tae Kim, Jinwoo Choi, Gyeong-Moon Park, Sung-Ho Bae, Lik-Hang Lee, Pan Hui, In So Kweon, Choong Seon Hong

TL;DR

This survey consolidates current understanding of ChatGPT within the AIGC era, detailing the Transformer-based autoregressive technology, RLHF-based alignment, and the GPT lineage up to GPT-4. It maps ChatGPT’s wide-ranging applications across scientific writing, education, and medicine while articulating critical challenges such as factual reliability, ethics, and regulation. The authors propose two roadmaps to bridge toward general-purpose AIGC and discuss broader societal implications, including potential job disruption and governance needs. Overall, the paper provides a timely, structured assessment of ChatGPT’s capabilities, limitations, and path toward AGI, offering guidance for researchers, policymakers, and practitioners.

Abstract

OpenAI has recently released GPT-4 (a.k.a. ChatGPT plus), which is demonstrated to be one small step for generative AI (GAI), but one giant leap for artificial general intelligence (AGI). Since its official release in November 2022, ChatGPT has quickly attracted numerous users with extensive media coverage. Such unprecedented attention has also motivated numerous researchers to investigate ChatGPT from various aspects. According to Google scholar, there are more than 500 articles with ChatGPT in their titles or mentioning it in their abstracts. Considering this, a review is urgently needed, and our work fills this gap. Overall, this work is the first to survey ChatGPT with a comprehensive review of its underlying technology, applications, and challenges. Moreover, we present an outlook on how ChatGPT might evolve to realize general-purpose AIGC (a.k.a. AI-generated content), which will be a significant milestone for the development of AGI.

One Small Step for Generative AI, One Giant Leap for AGI: A Complete Survey on ChatGPT in AIGC Era

TL;DR

This survey consolidates current understanding of ChatGPT within the AIGC era, detailing the Transformer-based autoregressive technology, RLHF-based alignment, and the GPT lineage up to GPT-4. It maps ChatGPT’s wide-ranging applications across scientific writing, education, and medicine while articulating critical challenges such as factual reliability, ethics, and regulation. The authors propose two roadmaps to bridge toward general-purpose AIGC and discuss broader societal implications, including potential job disruption and governance needs. Overall, the paper provides a timely, structured assessment of ChatGPT’s capabilities, limitations, and path toward AGI, offering guidance for researchers, policymakers, and practitioners.

Abstract

OpenAI has recently released GPT-4 (a.k.a. ChatGPT plus), which is demonstrated to be one small step for generative AI (GAI), but one giant leap for artificial general intelligence (AGI). Since its official release in November 2022, ChatGPT has quickly attracted numerous users with extensive media coverage. Such unprecedented attention has also motivated numerous researchers to investigate ChatGPT from various aspects. According to Google scholar, there are more than 500 articles with ChatGPT in their titles or mentioning it in their abstracts. Considering this, a review is urgently needed, and our work fills this gap. Overall, this work is the first to survey ChatGPT with a comprehensive review of its underlying technology, applications, and challenges. Moreover, we present an outlook on how ChatGPT might evolve to realize general-purpose AIGC (a.k.a. AI-generated content), which will be a significant milestone for the development of AGI.
Paper Structure (21 sections, 2 equations, 6 figures, 2 tables)

This paper contains 21 sections, 2 equations, 6 figures, 2 tables.

Table of Contents

  1. Introduction
  2. Overview of ChatGPT
  3. OpenAI
  4. Capabilities
  5. Technology behind ChatGPT
  6. Two core techniques
  7. Technology path
  8. Applications of ChatGPT
  9. Scientific writing
  10. Education field
  11. Medical field
  12. Other fields
  13. Challenges
  14. Technical limitations
  15. Misuse cases
  16. ...and 6 more sections

Figures (6)

  • Figure 1: Structure overview of this survey.
  • Figure 2: OpenAI products timeline.
  • Figure 3: Timeline of GPT model families.
  • Figure 4: (left) Transformer architecture and training objectives used in GPT-1. (right) Input transformations for fine-tuning on different tasks (figure obtained from radford2018improving).
  • Figure 5: How GPT-3.5 is trained. Image obtained from ouyang2022training).
  • ...and 1 more figures