This chapter contains sections titled: 7.1 AdaBoost's Loss function, 7.2 Coordinate Descent, 7.3 Loss Minimization Cannot Explain Generalization, 7.4 Functional Gradient Descent, 7.5 Logistic Regression and Conditional Probabilities, 7.6 Regularization, 7.7 Applications to Data-Limited Learning, Summary, Bibliographic Notes, Exercises