Logo
ScienceStack
Table of Contents
Fetching ...
Sign In

Exploring the Integration of Extended Reality and Artificial Intelligence (AI) for Remote STEM Education and Assessment

Shadeeb Hossain, Natalie Sommer, Neda Adib

Abstract

This paper presents a dynamic gamification architecture for an Extended Reality Artificial Intelligence virtual training environment designed to enhance STEM education through immersive adaptive, and kinesthetic learning. The proposed system can be introduced in four phases: Introduction Phase, Component Development Phase, Fault Introduction and Correction Phase and Generative AI XR scenarios Phase. Security and privacy are discussed via a defense-in-depth approach spanning client, middleware, and backend layers, incorporating AES 256 encryption, multi-factor authentication, role-based access control and GDPR or FERPA compliance. Risks such as sensor exploitation, perceptual manipulation, and virtual physical harm are identified, with mitigation strategies embedded at the design stage. Potential barriers to large scale adoption-including technical complexity, cost of deployment, and need for cybersecurity expertise are discussed.

Exploring the Integration of Extended Reality and Artificial Intelligence (AI) for Remote STEM Education and Assessment

Abstract

This paper presents a dynamic gamification architecture for an Extended Reality Artificial Intelligence virtual training environment designed to enhance STEM education through immersive adaptive, and kinesthetic learning. The proposed system can be introduced in four phases: Introduction Phase, Component Development Phase, Fault Introduction and Correction Phase and Generative AI XR scenarios Phase. Security and privacy are discussed via a defense-in-depth approach spanning client, middleware, and backend layers, incorporating AES 256 encryption, multi-factor authentication, role-based access control and GDPR or FERPA compliance. Risks such as sensor exploitation, perceptual manipulation, and virtual physical harm are identified, with mitigation strategies embedded at the design stage. Potential barriers to large scale adoption-including technical complexity, cost of deployment, and need for cybersecurity expertise are discussed.

Paper Structure

This paper contains 10 sections, 5 figures, 1 table.

Table of Contents

  1. Introduction
  2. Gamification in Extended Reality (XR)
  3. Proposed Architecture for XR Gamification in Engineering Course at DeVry University
  4. Introduction Phase
  5. Component Development Phase
  6. Fault Introduction and Correction Phase
  7. Generative AI – XR Scenarios
  8. System Architecture for Proposed XR-AI Unity Platform
  9. Privacy and Security Framework in XR Gamification
  10. Summary and Future Directions

Figures (5)

  • Figure 1: Schematic illustrating the differences between (a) static and (b) dynamic gamification process.
  • Figure 2: Unity XR environment elements used in simulating the virtual classroom for DeVry University : (a) virtual campus imported from “Unity Assets”; (b) virtual table and chair setup; (c) virtual green board; (d) virtual laptop; (e) assets listed used to create a realistic and interactive XR classroom environment
  • Figure 3: Schematic of the Component Development phase with a detailed process overview.
  • Figure 4: The system architecture for the XR gamification platform in engineering courses is composed of three layers: (i) Client layer, (ii) Middleware layer, and (iii) Backend layer.
  • Figure 5: Illustration of client-middleware-backend interaction and their risk mitigation strategies.