Investigation of system-driven talking approaches using depth and color image information for digital signage with speech user interface

In recent decades, digital signages have been widely used. Specifically, digital signages that have a purpose of either providing information or advertising, it is important to direct people’s attention toward that information. Conventionally, some approaches to attract viewer’s attention include using animation and audible information such as playing background music or a flashing a catchphrase. However, language information has not been implemented in these approaches. In this study, we propose a method to call out a specific person to the front of a digital signage by using color images and depth information. By calling out a specific person by using this method, it is expected for this person to have an awareness that they are a target intended by a digital signage. In this study, we conducted experiments that use utterances based on a person’s position, distance from a digital signage, clothing colors, or a pair of two features. Based on the study results, we confirm that a pair of features, that is, clothing color and depth, is the most effective to call out a specific person to the front of a digital signage