A Conceptual Model of Intelligent Multimedia Data Rendered using Flying Light Specks

TL;DR

The paper tackles rendering and interacting with complex 3D multimedia data using Flying Light Specks (FLS) by introducing a semantic, extensible conceptual data model that supports end-to-end data flow from raw device data to information and knowledge. The core model is an Entity-Relationship (ER) framework that links FLSs, Flight Paths, 3D Coordinates ($L$, $H$, $D$), Colors, Acoustics, and Algorithms, enabling content-based queries and annotations that enrich the multimedia repository. It demonstrates domain-specific extensions for Entertainment (3D authoring tools) and Healthcare (MRI scans) by reconfiguring entities (e.g., Subject to Scene/Patient, Objects to Organs) and adding domain-specific attributes and algorithms. Future work includes building a Blender-compatible logical/physical pipeline with Motill as a starting point, assessing scalability, and leveraging content-based queries to realize intelligent, knowledge-rich 3D multimedia rendering.

Abstract

A Flying Light Speck, FLS, is a miniature sized drone configured with light sources to illuminate 3D multimedia objects in a fixed volume, an FLS display. A swarm of FLSs may provide haptic interactions by exerting force back at a user's touch. This paper presents a conceptual model for the multimedia data to enable content-based queries. The model empowers users of an FLS display to annotate the illuminations by adding semantics to the data, extending a multimedia repository with information and knowledge. We present a core conceptual model and demonstrate its extensions for two diverse applications, authoring tools with entertainment and MRI scans with healthcare.

Figures (5)

• Figure 1: An eco-system for devices and authoring tools, and 3D FLS displays.
• Figure 2: An extensible core conceptual data model.
• Figure 3: Blender.
• Figure 4: ER Model for Animation Tools
• Figure 5: ER Model for MRI Data