Augmented Exer-Learning Tool Using Ultrasonic Depth Visualization of Movement

In this paper, a self-learning tool for children belonging to age group 2-4 years is proposed where the subject can learn different educational content along with exercise. Our system is inspired by the traditional way to teach different elementary educational contents for example alphabets and digits, where the subject imitates the guide's movements and listen to the guide's voice to recognize alphabets or digits. Similarly the children learn by themselves several game rules and steps of games with spontaneous interest. A prototype of our proposed system is implemented, in which a subject can imitate the pose and instruction set of the virtual avatar (form) shown on the screen and the movement of the subject is recorded and analyzed in reverse using depth sensor. Depending on the analyzed data an audio visual feedback is given which is induced with game pleasure and reward function. If the participant can reproduce correct postures displayed by the avatar during training, the relevant reward function is displayed as an educational content. The children along with their guardian agreed that the system is interesting and can motivate the subject to do exercise along with learning i.e. Exer-learning. This system will also help the children having developmental delay to learn educational content in significant way.