Joystick Controlled Autonomous Robotic Arm Using Inverse Kinematics with Object Detection

In 2019, the Novel Coronavirus Disease (COVID-19) was categorized as a pandemic. This disease can be transmitted via droplets on items or surfaces within several hours. Therefore, the researchers aimed to develop a wirelessly controlled robot arm and platform capable of picking up objects detected via object detection. Robot arm movements are done via the use of inverse kinematics. Meanwhile, a custom object detection model that can detect objects of interest will be trained and implemented in this project. To achieve this, the researchers utilize various open-source libraries, microcontrollers, and readily available materials to construct and program the entire system. At the end of this research, the prototype could reliably detect objects of interest, along with a grab-and-dispose success rate of 88%. Instruction data can be properly sent and received, and dual web cam image transfer reaches up to 1.72 frames per second.