Transforming Medical Research with Immersive 3D Visualization and Augmented Reality for Cancer and Beyond

To address complexity of cancer progression, we propose a novel approach using 3D data visualization with brain tumors, the leading cause of cancer related death in both children and adults worldwide. Standard methods for studying cancer development produce incomplete or oversimplified models that can't capture the complex dynamics of tumor cells. In contrast, advanced data science and a new generation of 3D visualization technologies simultaneously bring about the opportunity to explore the dynamical landscape of tumorous cells. With 3D visualization tools we create high level illustrations that go beyond basic renderings and deliver more sophisticated, actionable insights that take advantage of analysis of advanced data analytics and feature analysis at the cluster and genomic level. A new methodology is introduced in this paper, based the use of the Unity game development platform, that enables transitions smoothly from 2D to 3D to better describe the various stages of cancer progression. Furthermore, we propose an innovative way for the reconstruction of 3D models right in Unity using the AR platforms such as the specialized augmented reality AR SDK toolkit Vuforia. Not only does our approach extend current understanding of brain tumor dynamics, but more importantly, gives a flexible framework to see tumor behaviour with real time visualization that could substantially change therapeutic development. Ultimately, this work can serve as a stepping stone for such integration of immersive visualization techniques into clinical practice and to ultimately facilitate more effective, personalized treatments and precision medicine approaches.