Shrinkage Degree in $L_{2}$ -Rescale Boosting for Regression

$L_{2}$
-rescale boosting (
$L_{2}$
-RBoosting) is a variant of
$L_{2}$
-Boosting, which can essentially improve the generalization performance of
$L_{2}$
-Boosting. The key feature of
$L_{2}$
-RBoosting lies in introducing a shrinkage degree to rescale the ensemble estimate in each iteration. Thus, the shrinkage degree determines the performance of
$L_{2}$
-RBoosting. The aim of this paper is to develop a concrete analysis concerning how to determine the shrinkage degree in
$L_{2}$
-RBoosting. We propose two feasible ways to select the shrinkage degree. The first one is to parameterize the shrinkage degree and the other one is to develop a data-driven approach. After rigorously analyzing the importance of the shrinkage degree in
$L_{2}$
-RBoosting, we compare the pros and cons of the proposed methods. We find that although these approaches can reach the same learning rates, the structure of the final estimator of the parameterized approach is better, which sometimes yields a better generalization capability when the number of sample is finite. With this, we recommend to parameterize the shrinkage degree of
$L_{2}$
-RBoosting. We also present an adaptive parameter-selection strategy for shrinkage degree and verify its feasibility through both theoretical analysis and numerical verification. The obtained results enhance the understanding of
$L_{2}$
-RBoosting and give guidance on how to use it for regression tasks.