An Efficient Running Quantile Estimation Technique alongside Correntropy for Outlier Rejection in Online Regression

In this paper, online linear regression in the presence of non-Gaussian noise is addressed. In such environments, there are outliers in error samples (error between system output and labels) and/or the error does not follow a Gaussian distribution. Information theoretic measures such as error entropy criterion (EEC) and error correntropy criterion (ECC) are known for their superior performance compared to mean square error (MSE) in these cases. In this paper, an efficient technique of running quantile estimation based on quantization of error samples is introduced alongside which correntropy leads to lower steady state misalignment compared to previous algorithms.