Robotic Arm-Based Face Recognition Software Test Automation

Facial recognition is a feature that uses facial detection algorithms to detect a face and then invokes facial recognition algorithms to try to match the person's face. First, a person's face needs to be enrolled; during enrollment, the person's facial details are saved in a database-in this case, a mobile phone. The facial recognition algorithm uses this database to match the currently presented face with the faces saved in the database. The efficiency of a facial recognition algorithm depends upon the speed at which it can detect and recognize faces. The problem we address in this paper is that a reliable, automated method for testing facial recognition features in mobile phones. Because the multimedia capabilities of smartphones have expanded phenomenally, the need for thoroughly testing facial recognition algorithms has become crucial. The uses of facial recognition can range from facial authentication for unlocking phones to security for a number of other applications. To meet these needs, a reliable, automated test for validating the facial recognition algorithms must be developed. The challenge for the software test team was to automate the test cases, which involve tilting the phone at specific angles from the test subject. The permissible angular movements of the phone are determined by the algorithmic specifications of the facial recognition algorithm. We tested scenarios involving multiple faces, motion blur, panning the phone in front of the test subject faces at various speeds, and so on. We adopted a robotic arm to perform the facial recognition test cases and developed software to program the robotic arm to test the phone's facial recognition software for functionality, performance, and stability as well as adversarial tests. This paper discusses the computer vision use case for facial recognition and describes how we developed an automated facial recognition test suite using a robotic arm.