Extraction of facial sketch images and expression transformation based on FACS

This paper proposes a new method that can be used to extract facial sketch image automatically and to transform facial expression. The extraction of facial features is performed by the following three processing steps: segmentation using color characteristics, detection of feature points of each part of the face, and their approximation using polynomials. They are called feature curves and they constitute a facial sketch image. Expression transformation of the sketch image based on the facial action coding system (FACS) is carried out easily by adjusting the locations of the feature points. The control scheme of the feature point locations is based on the FACS. Experimental results on the extraction of the facial sketch image and their expression transformations are provided.