ABSTRACT VIEW
REAL-TIME 4D VOLUMETRIC STREAMING FOR INTERACTIVE VIRTUAL CLASSROOMS ENABLING IMMERSIVE LEARNING THROUGH GAME ENGINE INTEGRATION
K. Maye, P. Foley, S. Morrissey Tucker, J. Walsh
Munster Technological University (IRELAND)
One of the most promising applications for 4D volumetric video is the field of education. As classrooms increasingly shift to online and hybrid formats, traditional media tools are struggling to maintain student engagement. This challenge is amplified by shorter attention spans and the expectation among younger generations that technology be integrated into all aspects of their lives. While 2D video is limited in spatial presence, more immersive technologies often require expensive hardware, advanced technical skills, and high computational power. These barriers make it difficult for educators to adopt cutting-edge digital tools that bring presence and interactivity into remote learning environments.

To address this, our research explores the use of Intel RealSense depth cameras and custom-built software to stream 4D volumetric video in real time. When you capture that 3D data frame by frame, adding a temporal sequence, it becomes 4D: 3D space (x, y, z) + time (t). These cameras allow for dynamic 3D capture using just two devices, removing the need for a large and complex studio setup. The captured depth and color data is streamed through a custom TCP (Transmission Control Protocol), which ensures reliable and ordered delivery of data directly into a game engine.

This method enables rich interactive features and allows volumetric video to be delivered across multiple platforms, including virtual reality. In educational contexts, it creates engaging 3D classroom simulations where teachers appear as if physically present, offering students a more immersive and impactful learning experience than traditional media can provide.

Keywords: Technology, education, Virtual Reality, Volumetric Video, Live Streaming, Game Engine.

Event: EDULEARN25
Track: Innovative Educational Technologies
Session: Technology Enhanced Learning
Session type: VIRTUAL