The no free lunch theorem of optimization (NFLT) is an impossibility theorem telling us that a general-purpose universal optimization strategy is impossible, and the only way one strategy can outperform another is if it is specialized to the structure of the specific problem under consideration. Since virtually all decision and control problems can be cast as optimization problems, an appreciation of the NFLT and its consequences is essential for control engineers. We present a framework for conceptualizing optimization problems that leads useful insights and a simple explanation of the NFLT
Published in:
Decision and Control, 2001. Proceedings of the 40th IEEE Conference on
(Volume:5
)
Date of Conference: 2001