A saturation analysis of error-spectrum shaping quantizers

Error spectrum shaping (ESS) quantizers are analyzed in the context of realistic FIR reconstruction filters and nonzero probability of saturation. Conditions for stable operation are derived, and a suboptimal but effective and computationally efficient design method is proposed. Excellent agreement is obtained between the analysis and simulations. Even under these more stringent constraints, ESS quantizers are shown to achieve significant signal-to-quantization-noise ratio (SQNR) gains when quantizing oversampled Gaussian sources.