Real-time genetic lips region detection and tracking in natural video scenes

In this paper, real-time detection and tracking of lips region of a talking person in natural scenes is addressed. In particular, we try to acquirc numerical parameters to rcprcsent the lips information. Because, this information is very important for many applications, such as audio-visual speech recognition, rubot perception, and interface of mobile devices. The difficulty lies in deformations and geometric change of lips, by speech and frec camera work. Our proposed system is based an template matching with genetic algorithms (GAS). In our previous system, there is a trade-off between accuracy and a processing time. However, we can overcome this by two new methods: (a) a flexible control of a search domain, (b) inheritance of genetic information between video frames. We demonstrated the effectiveness of our proposed system by using some 5 seconds vidco sequences. The average results are that thc accuracy is 94,44% and the processing time is 4.50 seconds.