By Topic

Consistent Order Estimation and Minimal Penalties

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$33 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

2 Author(s)
Elisabeth Gassiat ; Lab. de Math. d'Orsay, Univ. Paris-Sud, Orsay, France ; Ramon van Handel

Consider an i.i.d. sequence of random variables whose distribution f* lies in one of the nested families of models Mq, q ≥ 1. The smallest index q* such that Mq* contains f* is called the model order. The aim of this paper is to explore the consistency properties of penalized likelihood model order estimators such as Bayesian information criterion. We show in a general setting that the minimal strongly consistent penalty is of order η(q)loglogn, where η(q) is a dimensional quantity. In contrast to previous work, an a priori upper bound on the model order is not assumed. The results rely on a sharp characterization of the pathwise fluctuations of the generalized likelihood ratio statistic under entropy assumptions on the model classes. Our results are applied to the geometrically complex problem of location mixture order estimation, which is widely used but poorly understood.

Published in:

IEEE Transactions on Information Theory  (Volume:59 ,  Issue: 2 )