Some notes on the stability of learning

Learning theory based on ERM principle, especially promoted by VC theory provides some conditions on the hypothesis space to ensure generalization. However, several successful learning algorithms including regularization learning, SVM, bagging and boost are not strictly ERM. So, scientists are looking for new foundation of learning. Stability conditions are perhaps new foundation. We give an exponential bound for generalization performance based on concentration inequality with strong CV stability.