Model selection criteria and the orthogonal series method for function estimation

Closed-form solutions are presented for function estimation using the orthogonal series method and various model selection criteria. While Akaike's (1974) AIC criterion does not lead to consistent estimates, a family of criteria that includes minimum description length operates within a logarithmic factor of the minimax rate in a range of Sobolev smoothness classes.