Table of Contents
Fetching ...

AI and 6G into the Metaverse: Fundamentals, Challenges and Future Research Trends

Muhammad Zawish, Fayaz Ali Dharejo, Sunder Ali Khowaja, Kapal Dev, Steven Davy, Nawab Muhammad Faseeh Qureshi, Paolo Bellavista

TL;DR

This survey analyzes how artificial intelligence and 6G (and beyond) jointly enable immersive Metaverse experiences, spanning XR technologies, spatial computing, and AI-driven edge intelligence. It dissects AI foundations (deep learning, computer vision, edge AI) and 6G capabilities (THz, holography, uRLLC, IoE) to extract the technical requirements for Metaverse services. It then articulates the AI-6G nexus through pervasive AI, autonomous networks, tactile Internet, and holographic telepresence while addressing sustainability, applications, ongoing projects, and key challenges. The work provides a structured, comprehensive roadmap with concrete directions for researchers and practitioners to realize scalable, privacy-preserving, and energy-efficient Metaverse systems.

Abstract

Since Facebook was renamed Meta, a lot of attention, debate, and exploration have intensified about what the Metaverse is, how it works, and the possible ways to exploit it. It is anticipated that Metaverse will be a continuum of rapidly emerging technologies, usecases, capabilities, and experiences that will make it up for the next evolution of the Internet. Several researchers have already surveyed the literature on artificial intelligence (AI) and wireless communications in realizing the Metaverse. However, due to the rapid emergence and continuous evolution of technologies, there is a need for a comprehensive and in-depth survey of the role of AI, 6G, and the nexus of both in realizing the immersive experiences of Metaverse. Therefore, in this survey, we first introduce the background and ongoing progress in augmented reality (AR), virtual reality (VR), mixed reality (MR) and spatial computing, followed by the technical aspects of AI and 6G. Then, we survey the role of AI in the Metaverse by reviewing the state-of-the-art in deep learning, computer vision, and Edge AI to extract the requirements of 6G in Metaverse. Next, we investigate the promising services of B5G/6G towards Metaverse, followed by identifying the role of AI in 6G networks and 6G networks for AI in support of Metaverse applications, and the need for sustainability in Metaverse. Finally, we enlist the existing and potential applications, usecases, and projects to highlight the importance of progress in the Metaverse. Moreover, in order to provide potential research directions to researchers, we underline the challenges, research gaps, and lessons learned identified from the literature review of the aforementioned technologies.

AI and 6G into the Metaverse: Fundamentals, Challenges and Future Research Trends

TL;DR

This survey analyzes how artificial intelligence and 6G (and beyond) jointly enable immersive Metaverse experiences, spanning XR technologies, spatial computing, and AI-driven edge intelligence. It dissects AI foundations (deep learning, computer vision, edge AI) and 6G capabilities (THz, holography, uRLLC, IoE) to extract the technical requirements for Metaverse services. It then articulates the AI-6G nexus through pervasive AI, autonomous networks, tactile Internet, and holographic telepresence while addressing sustainability, applications, ongoing projects, and key challenges. The work provides a structured, comprehensive roadmap with concrete directions for researchers and practitioners to realize scalable, privacy-preserving, and energy-efficient Metaverse systems.

Abstract

Since Facebook was renamed Meta, a lot of attention, debate, and exploration have intensified about what the Metaverse is, how it works, and the possible ways to exploit it. It is anticipated that Metaverse will be a continuum of rapidly emerging technologies, usecases, capabilities, and experiences that will make it up for the next evolution of the Internet. Several researchers have already surveyed the literature on artificial intelligence (AI) and wireless communications in realizing the Metaverse. However, due to the rapid emergence and continuous evolution of technologies, there is a need for a comprehensive and in-depth survey of the role of AI, 6G, and the nexus of both in realizing the immersive experiences of Metaverse. Therefore, in this survey, we first introduce the background and ongoing progress in augmented reality (AR), virtual reality (VR), mixed reality (MR) and spatial computing, followed by the technical aspects of AI and 6G. Then, we survey the role of AI in the Metaverse by reviewing the state-of-the-art in deep learning, computer vision, and Edge AI to extract the requirements of 6G in Metaverse. Next, we investigate the promising services of B5G/6G towards Metaverse, followed by identifying the role of AI in 6G networks and 6G networks for AI in support of Metaverse applications, and the need for sustainability in Metaverse. Finally, we enlist the existing and potential applications, usecases, and projects to highlight the importance of progress in the Metaverse. Moreover, in order to provide potential research directions to researchers, we underline the challenges, research gaps, and lessons learned identified from the literature review of the aforementioned technologies.
Paper Structure (95 sections, 16 figures, 7 tables)

This paper contains 95 sections, 16 figures, 7 tables.

Figures (16)

  • Figure 1: Structure of this survey
  • Figure 2: Growth of Deep Learning Transformers from 2018 to 2021
  • Figure 3: Application and infrastructure-level machine learning and deep learning techniques for 6G.
  • Figure 4: Metaverse refers to tranformation of physical reality into the digital realm, so it could be a mix of physical reality and digital realm such as AR, VR, and MR.
  • Figure 5: Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR), explored in depth.
  • ...and 11 more figures