Universal Single-Shot Sampling Rate Distortion

Consider a finite set of multiple sources, described by a random variable with
$m$
components. Only
$k\leq m$
source components are sampled and jointly compressed in order to reconstruct all the
$m$
components under an excess distortion criterion. Sampling can be that of a fixed subset
$A$
with
$\vert A\vert =k$
or randomized over all subsets of size
$k$
. In the case of random sampling, the sampler may or may not be aware of the
$m$
source components. The compression code consists of an encoder whose input is the realization of the sampler and the sampled source components; the decoder input is solely the encoder output. The combined sampling mechanism and rate distortion code are universal in that they must be devised without exact knowledge of the prevailing source probability distribution. In a Bayesian setting, considering coordinated single-shot sampling and compression, our contributions involve achievability results for the cases of fixed-set, source-independent and source-dependent random sampling.