Automatic Testing and Measurement of QoE in IPTV Using Image and Video Comparison

Orange Labs Spain, has developed a proof ofconcept aimed at exploring the possibility of automating the testsrequired by new evolutions of the IPTV service, and thusshortening the lifecycle and reducing the overall developmentcosts. It‘s based on an automaton that interacts with the set-top boxjust by emulating a human being (or tester): sending IR remotecontrol commands and analyzing the video output, as a set ofimage comparisons against a valid reference. The analysis unveileda future applicability of the same concept in objectively measuringthe QoE (Quality of Experience). Although there are techniquesand measuring equipment in the industry, they often mix QoS(Quality of Services) with QoE, and causes with effects. In ouranalysis, we propose to clearly separate QoE (as an effect) fromQoS (as possible causes), and also to split the contributions to QoEin those that occur in the preparation of the content (such as theencoding of VoDs (Video on Demand) in backoffice), and thosethat take place at the moment of content delivery itself. Finally, weconsider that the customer enviroment, , is an element that needs tobe considered as a critical part the loop of quality.. As aconclusion, we consider that managing and control the QoE is thefuture to improve the Customer Experience