Real-time communication testing evolution with WebRTC 1.0

It is of utmost importance for the future success of WebRTC to ensure that interoperability is operational between web browsers and any WebRTC-compliant client. To be guaranteed as operational and effective, interoperability must be tested extensively by establishing WebRTC data and media connections between different web browsers running on different devices and operating systems. We will present in this paper a comprehensive view of the numerous testing challenges researchers have faced before arriving at the first release candidate of the WebRTC specifications. More specifically, we touch on WebRTC testing at different levels: W3C JS API compliance, stand-alone web application testing, WebRTC security testing, P2P network and ICE testing, synchronous and asymmetric testing and eventually full global interoperability testing. We will show at each level how WebRTC has been pushing boundaries of existing test suites, and triggering new developments both for the standards, and for the industry. Finally we present KITE, an open source, generic, reusable and easy to maintain automated testing environment for testing WebRTC P2P interoperability across all types of WebRTC-compliant clients.