Reliable learning: a theoretical framework

A proper theoretical framework, called reliable learning, for the analysis of consistency of learning techniques incorporating prior knowledge for the solution of pattern recognition problems is introduced by properly extending standard concepts of Statistical Learning Theory. In particular, two different situations are considered: in the first one a reliable region is determined where the correct classification is known; in the second case the prior knowledge regards the correct classification of some points in the training set. In both situations sufficient conditions for ensuring the consistency of the Empirical Risk Minimization (ERM) criterion is established and an explicit bound for the generalization error is derived.