Cart (Loading....) | Create Account
Close category search window

It's time for your evaluation

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$31 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

1 Author(s)
Knight, K. ; Inf. Sci. Inst., Univ. of Southern California, Marina del Rey, CA, USA

If there is a word that strikes fear into the hearts of speech and natural-language researchers, it is “evaluation”. It's not that we don't like evaluation-mostly, we do-it's just that we've developed this knee-jerk response: “Another evaluation? Already? But we just did an evaluation!” Well, that's an exaggeration. But funder-promoted, common evaluations have profoundly affected our research in years past. In these evaluations, researchers agree on a number of tasks and criteria for success, then work independently on those tasks. In many cases, funding agencies provide sample inputs and outputs in advance, but withhold test data until “evaluation day”. Several months later, participating researchers gather at a specialized workshop to discuss results and techniques. Whether you're interested in machine translation, morphology, speech-query processing, information extraction, or information retrieval, there is a common evaluation somewhere where you can test your ideas in an empirical, quantitatively scored setting. The author looks at some strengths and weaknesses of these common evaluations

Published in:

IEEE Expert  (Volume:11 ,  Issue: 5 )

Date of Publication:

Oct 1996

Need Help?

IEEE Advancing Technology for Humanity About IEEE Xplore | Contact | Help | Terms of Use | Nondiscrimination Policy | Site Map | Privacy & Opting Out of Cookies

A not-for-profit organization, IEEE is the world's largest professional association for the advancement of technology.
© Copyright 2014 IEEE - All rights reserved. Use of this web site signifies your agreement to the terms and conditions.