By Topic

Evaluation of Estimation Algorithms: Credibility Tests

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$31 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

3 Author(s)
Li, X.R. ; Dept. of Electr. Eng., Univ. of New Orleans, New Orleans, LA, USA ; Zhanlue Zhao ; Xiao-Bai Li

Assessments of estimation performance are often available. For example, many statistical estimators and filters provide assessments of the first two moments of their own estimation error (i.e., mean-square error [MSE] or error covariance matrix and bias). Are these assessments credible in that they reflect the true situation? The paper addresses this important yet little studied topic, referred to as the credibility of the assessments (or the estimators that make the assessments). We define the concept of credibility and formulate three classes of commonly encountered credibility-testing problems: MSE alone, bias alone, and MSE and bias jointly. Taking advantage of results in multivariate statistical analysis, we present several statistical tests for the credibility problems formulated and analyze and discuss in detail pros and cons of the proposed tests, contrasting with the existing test. How these tests can be used and how they perform are illustrated by representative numerical examples. For the existing MSE credibility test, we explain its underlying principle and analyze, discuss, and demonstrate its drawbacks and limitations. We also propose a test for comparing different credibility assessments.

Published in:

Systems, Man and Cybernetics, Part A: Systems and Humans, IEEE Transactions on  (Volume:42 ,  Issue: 1 )