LIVE-FIT: LED-based Immersive Virtual Environment with Fusion, Interaction, and Transmission

Cave Automatic Virtual Environment (CAVE) is widely used for immersive visualization and interaction but faces challenges such as limited data formats, restricted interaction, and high costs. To overcome these difficulties, this paper proposes an immersive virtual environment (IVE) based on LEDs, which is a CAVE-based system that integrates panoramic video, 3D point cloud, and real-time sensor data in a unified platform. Unlike conventional CAVE systems, the proposed IVE eliminates reliance on wearable devices—a critical advancement for enhancing user experience and broadening the adoption of immersive technologies. Furthermore, in contrast to the high costs of traditional systems (e.g., CAVE2 at $926K), our approach leverages immersive data fusion and real-time multi-modal interactions to deliver a seamless virtual-real fusion environment at a significantly reduced cost. Practical use cases, such as online museum tours and campus tour, highlight the system’s ability to deliver a visually rich, immersive and interactive user experience.