Spatial coding-based Informed Source Separation

Recent advances in multimedia technology opened the path for individual manipulation of the different audio objects within a multichannel mix, for both sampling and karaoke applications. This requires the transmission of these objects as an additional information. Informed Source Separation (ISS) is an adequate framework for this problem. Its main idea is not to transmit the objects themselves, but rather the parameters required to recover them using the mixtures and separation algorithms. In recent studies, the connection was made between ISS and source coding and the concept of coding-based ISS (CISS) was introduced. CISS differs from classical source coding in its use of the mixtures, which permits to reduce the bitrates required to convey audio objects compared to source coding alone with the same model. In this study, we extend existing work on CISS to the case of multichannel mixtures and demonstrate a considerable increase of performance over classical ISS.