Hybrid User Interface for Audience Feedback Guided Asymmetric Immersive Presentation of Financial Data

This paper presents the design of a system for giving engaging, immersive presentations based on financial data in an immersive environment. The system consists of a presenter controlling the presentation flow through a tablet interface and an audience experiencing the presentation content through an augmented reality (AR) head-worn display (HWD). The system leverages various sensors on the HWD to detect the audience’s cognitive state and provide actionable and context-aware suggestions to the presenter about how to adjust their presentation delivery. We discuss the user scenario motivating our system design, its associated design considerations, the features of our system, and how our system can be extended to other presentation contexts.