Nonlinear Distortion Mitigation by Machine Learning of SVM Classification for PAM-4 and PAM-8 Modulated Optical Interconnection

We demonstrated a support vector machine (SVM) based machine learning method to mitigate modulation nonlinearity distortion for PAM-4 and PAM-8 vertical cavity surface emitter laser multi-mode fiber (VCSEL-MMF) optical link. Simulations at 100 Gb/s data rate and experimental work at 60 Gb/s data rate were carried out. We achieved a significant improvement in bit error rate (BER) when complete binary tree SVMs (CBT-SVMs) are applied for both PAM-4 and PAM-8 signals. Quantitative analysis of the sensitivity gain versus modulation nonlinearity distortion is presented with experimentally verification. The results indicate that CBT-SVMs have better performance for PAM-8 compared to PAM-4. The sensitivity gain increases almost linearly with the increase of eye-linearity (increase of modulation nonlinearity distortion). Up to 2.5-dB sensitivity improvement is achieved by the proposed CBT-SVMs at eye-linearity of 1.72 for PAM-4.