vBeats: A Framework for Converting Gestures into Bass Strokes from Indian Tabla using Smartphones

Human gestures while playing instruments are highly critical. A small incorrect gesture can result in undesirable noise, disturbing the overall synchronization of the orchestra. Certainly, the most obvious way of honing the skills in playing instruments can be accomplished with dedicated practice, albeit the learner must always possess the instrument. In this paper, we propose an initial version of the framework vBeats that allows learners to use the COTS smartphones to practice sophisticated percussion-based instruments like tabla without physically having it. Preliminary results on an in-house dataset, with offline inferencing, show that vBeats can be used to generate similar waveforms; however, it may need accurate fine-tuning, which we discuss as a part of future work.