Malaysia Traffic Sign Recognition for Autonomous Vehicles with Textual Information Using Computer Vision

Traffic sign recognition is crucial for the safe and efficient operation of autonomous vehicles. While previous research has primarily focused on traffic sign recognition in foreign countries, these studies often face limitations such as differing traffic sign designs, language barriers in textual information, and varying environmental conditions. In this paper, we propose a traffic sign detection and recognition system tailored for Malaysia, utilizing Convolutional Neural Networks (CNNs) and Optical Character Recognition (OCR). In this paper, we propose a traffic sign detection and recognition system utilizing You Only Look Once (YOLO) V8 for object detection and EasyOCR to process textual information on selected traffic signs. Our system achieves a mean Average Precision (mAP) of 0.824 and an average processing time of 1.2 seconds per frame, which is comparable to existing literature. Furthermore, the complexity of our method is significantly reduced, enhancing its potential for real-time processing applications, as evidenced by its efficient processing time.