Gradient based adaptive regularization

A technique to optimize regularization parameters for a given supervised training problem is presented. A training database is applied to minimize a regularized cost function, and a validation database is used to estimate and optimize generalization properties by means of a modification of regularization. The performance is validated for a vowel classification task and compared to other approaches.