Design of the optimal separating hyperplane for the decision feedback equalizer using support vector machines

The conventional decision feedback equalizer (DFE) separates the different signal classes using a single hyperplane. It is well known that the popular minimum mean square error (MMSE) design is generally not the optimal minimum bit error rate (MBER) solution. We propose a method of designing the separating hyperplane for the conventional DFE based on support vector machines (SVMs). The SVM design achieves asymptotically the MBER solution and can be computed efficiently.