Near-optimum soft decision equalization for frequency selective MIMO channels

In this paper, we develop soft decision equalization (SDE) techniques for frequency selective multiple-input multiple-output (MIMO) channels in the quest for low-complexity equalizers with error performance competitive to that of maximum likelihood (ML) sequence detection. We demonstrate that decision feedback equalization (DFE) based on soft-decisions, expressed via the posterior probabilities associated with feedback symbols, is able to outperform hard-decision DFE, with a low computational cost that is polynomial in the number of symbols to be recovered and linear in the signal constellation size. Building on the probabilistic data association (PDA) multiuser detector, we present two new MIMO equalization solutions to handle the distinctive channel memory. The first SDE algorithm adopts a zero-padded transmission structure to convert the challenging sequence detection problem into a block-by-block least-square formulation. It introduces key enhancement to the original PDA to enable applications in rank-deficient channels and for higher level modulations. The second SDE algorithm takes advantage of the Toeplitz channel matrix structure embodied in an equalization problem. It processes the data samples through a series of overlapping sliding windows to reduce complexity and, at the same time, performs implicit noise tracking to maintain near-optimum performance. With their low complexity, simple implementations, and impressive near-optimum performance offered by iterative soft-decision processing, the proposed SDE methods are attractive candidates to deliver efficient reception solutions to practical high-capacity MIMO systems. Simulation comparisons of our SDE methods with minimum-mean-square error (MMSE)-based MIMO DFE and sphere decoded quasi-ML detection are presented.