Two-Factor Authentication Using Face and Number-Plate Recognition for a Secure Campus Entry System

As a public educational institution, the Universitas Andalas campus is accessed by anyone with different objectives. They have problems securing campus assets from irresponsible parties by limiting access to the campus environment. Pass cards are a physical verification for those entering and leaving the campus environment. Its card is given when entering and returning when leaving campus. However, it can still be manipulated and even cheated by irresponsible individuals. Therefore, it is necessary to develop a layered authentication system to verify every campus visitor. The face and number-plate of the vehicle used are essential parameters that can be used to validate visitor identity. This research proposes verifying faces and vehicle number-plate to improve campus security. The verification system was developed with a web-based application using the Face Recognition and EasyOCR methods supported by the Haar Cascade Classifier model as an object detection algorithm. The development method adopted is the Prototype method. The implementation consists of analysis stages, prototype design, prototype design evaluation, implementation, testing, and system evaluation. The results obtained are a web-based application prototype equipped with 2-factor authentication consisting of face and number-plate recognition as a solution offered on the Universitas Andalas. Testing was conducted on eight different visitors with different role identities, and it found that 5 of the eight facial recognition and number-plate tested did not match.