Prototype Filter Design for Effectively Suppressing Out-of-Band Radiation in GFDM Systems

In this letter, a design method of a prototype filter for effectively suppressing out-of-band radiation (OOBR) in generalized frequency division multiplexing (GFDM) systems is proposed. A generic model that can suppress out-of-band energy leakage in the frequency-domain is introduced. The function that is solved in this model gives the target prototype filter. By adding several constraints such as the boundary, energy and spectral density energy concentration degree (SDECD) to the objective function, a finite-length optimized Nyquist prototype filter is designed. The optimized Nyquist pulse can suppress the OOBR of the GFDM system more effectively compared with the traditional Nyquist pulses.