AI-Based Cooperative Optimization of Pre- and Post-Compensation Filters for Coherent Transceivers with Limited Bandwidth and ENOB

Using a novel frequency-resolved pre- and post-compensation optimization technique, we show how AI-based optimization can boost the system performance resulting in gains > 3dB over typical pre-emphasis techniques.