3D Model Generation of Human Musculoskeletal System Based on Image Processing: An Intermediary Step while Developing a Learning Solution Using Virtual and Augmented Reality

The aim of this paper is to describe the methods used for obtaining the 3D models of the human musculoskeletal system based on image processing. The resulted models are integrated into a system based on emerging technologies, such as VR (Virtual Reality) and AR (Augmented Reality), aimed to aid the learning process in the study of the human movement biomechanics. The constructed system is designed to be more interactive to capture the users' attention and, to achieve this, the avatar of the musculoskeletal system is animated using full body skeletal tracking of an observed user. We are presenting the software solutions used in the model generation pipeline and the benefits and drawbacks of the selected methods. Also, the early results of the system implementation are showcased along the described pipeline.