Smart Audio/Video Playback Control Based on Presence Detection and User Localization in Home Environment

This paper presents the design and implementation of a simple software-based home control platform used for the automatic control of audio/video devices. The system facilitates integration of various residential sensors, with an accent on users' localization and presence detection. For the presence detection and localization we utilize three, the most frequently used technologies: visual (3D camera), audio (Microphone array) and passive infrared (PIR sensors). The home controller interprets information about user's position as a command issued to a list of UPnP/DLNA rendering devices (PC, TV or Audio system). Current distance and user's position can activate, abort or change video presentation, pause and continue playback, amplify sound or silence it automatically with regard to information retrieved from sensors and actions described in a so-called ambient behavior patterns. The way the system automatically responds to detected positions is controllable and changeable, and it is defined by executing XML documents which represent the behavior patterns - scripts. By using the easily accessible user interface, users are able to choose one of the available scripts or to prepare a new one, and to set up different audio/video modes in a room, similarly to switching profiles on mobile phones. The system is not limited to presence detection and audio/video control. Performing simple modifications of behavior scripts, the controller can interpret data from different kinds of sensors in an unobtrusive way of controlling various home appliances.