Facial expression analysis robust to 3D head pose motion

Most face expression algorithms assume a front or 'near-to-front' head position. This assumption becomes an important limitation when studying input from real systems. We present a new approach to robustly determine face expressions independently of the head pose. Our analysis-synthesis cooperation, possible thanks to the use of a highly realistic 3D head model and the application of Kalman filtering to predict the user pose, permits us to correctly track the interesting face features. Adapting 'near-to-front' analysis techniques based on the predicted pose enables us to use such algorithms with moving speakers.