Sensors fusion paradigm for smart interactions between driver and vehicle

The system described in this article has been developed within the project FANCI (Face and body Analysis Natural Computer Interaction) project. One of the main goal of the project is to give a better support to the driver, using some of the most advanced technologies in the field of intelligent user sensing methods, including eye tracking, face analysis, emotion recognition, voice tone analysis, hand gesture recognition. All these sensor technologies are integrated in a unique platform which is always-on, real time, low consumption and low cost. The information collected by this platform will be used as input of smart user intention or distraction estimation and system reaction methods, supplying visual (HUD, etc.), voice and haptic feedback as well as autonomous system actions.