Density estimation
Problem: many parameters to estimate from our training data
- Can lead to high variance estimates of P
- Bayes optimal decision boundary using our estimate is complex and sensitive to noise in training data
- For high dimensional spaces restrict estimates to very simple classes of distributions
- e.g., Gaussian, Naïve Bayes