MetaGadget: An Accessible Framework for IoT Integration into Commercial Metaverse Platforms

TL;DR

MetaGadget introduces an accessible framework that connects IoT devices to commercial metaverse platforms via HTTP-based event triggers, enabling cross-space, multi-user interactions without requiring persistent server connections. Implemented on Cluster and distributed as a Python library, it decouples metaverse events from device control while supporting both commercial devices (e.g., SwitchBot) and custom hardware (Raspberry Pi). Through two workshops with participants of varying technical backgrounds, the paper demonstrates that novices can implement basic IoT control and that experienced developers can build richer, multi-user digital-twin interactions, validating the framework’s usability and expressive potential. The work advances IoT-metaverse integration by lowering barriers, enabling educational, prototyping, and creative practices that link physical spaces with multi-user VR environments, and lays groundwork for future cross-platform, real-time extensions and broader device ecosystems.

Abstract

While the integration of IoT devices in virtual spaces is becoming increasingly common, technical barriers to controlling custom devices in multi-user Virtual Reality (VR) environments remain high, particularly limiting new applications in educational and prototyping settings. We propose MetaGadget, a framework for connecting IoT devices to commercial metaverse platforms that implements device control through HTTP-based event triggers without requiring persistent client connections. Through two workshops focused on smart home control and custom device integration, we explored the potential application of IoT connectivity in multi-user metaverse environments. Participants successfully implemented new interactions unique to the metaverse, such as environmental sensing and remote control systems that support simultaneous operation by multiple users, and reported positive feedback on the ease of system development. We verified that our framework provides a new approach to controlling IoT devices in the metaverse while reducing technical requirements, and provides a foundation for creative practice that connects multi-user VR environments and physical spaces.

Figures (4)

• Figure 1: MetaGadget System Overview
• Figure 2: (a)An electronic fan device controlled from metaverse space. (b) A speaker device built as a doorbell. Both devices are connected to control units running MetaGadget.
• Figure 3: Some examples of systems connected to the metaverse created by the participants. (a) A grave in the metaverse space is connected to a real-life religious object, allowing people to pray with a sense of realism. (b) From the metaverse space, where it is possible to communicate with the elderly, it is possible to operate a real-life home appliances in response to the needs of the elderly. (c) When people gather in the green dome in the metaverse space, the lights in the real world become brighter, indicating the number of people in the real world.
• Figure 4: Applications developed in the workshop. (a) A virtual piano system with frequency-controlled sound output (P1). Each key press triggers a corresponding audio frequency ranging from 110Hz to 1396.91Hz. (b) A traffic signal system with integrated LED and servo motor control (P2). The system enables pedestrian crossings synchronized with virtual space interactions. (c) A color-based game interface that translates virtual color commands into physical LED outputs (P3), extending the participant's previous metaverse world. (d) An interactive waste management system (P4) that facilitates collaboration between physical and virtual space users through synchronized bin operations. (e) A game enhancement system featuring audio feedback mechanisms (P5), building upon an existing game environment to provide sound-based player interaction cues.