Restricted Bayes optimal classifiers*
Idea: Instead of restricting the distribution, restrict the form of the classifier:
- Fix a set of classifiers H e.g.,
- hyperplanes, polynomial surfaces
- Choose h* from H that minimizes the Bayes error relative to our estimated distribution