On the relation between identifiability, differential privacy, and mutual-information privacy

This paper investigates the relation between three different notions of privacy: identifiability, differential privacy and mutual-information privacy. Under a privacy-distortion framework, where the distortion is defined to be the expected Hamming distance between the input and output databases, we establish some fundamental connections between these three privacy notions. Given a maximum distortion D, let ε*
_i
(D) denote the smallest (best) identifiability level, and ε*
_d
(D) the smallest differential privacy level. Then we characterize ε*
_i
(D) and ε*
_d
(D), and prove that ε*
_i
(D) - ε
_x
≤ ε*
_d
(D) ≤ ε*
_i
(D) for D in some range, where ε
_x
is a constant depending on the distribution of the original database X, and diminishes to zero when the distribution of X is uniform. Furthermore, we show that identifiability and mutual-information privacy are consistent in the sense that given a maximum distortion D in some range, there is a mechanism that optimizes the identifiability level and also achieves the best mutual-information privacy.