A Naive Bayes classifier assigns an observation to the class with the most probable explanation of its features. It combines each class’s prior probability with the likelihood of observing those features to estimate a posterior probability. For an email containing words such as “free,” “offer,” and “urgent,” it weighs whether spam or a legitimate sender is the more probable source. section 2.4.1
The model’s simplifying assumption is that features are conditionally independent given the class. This lets it multiply individual feature likelihoods to form a joint likelihood. Though real features may be correlated, the assumption can make classification fast and effective. Despite its name, the model’s parameters are typically estimated from training data using maximum likelihood; Bayes’ theorem then yields class posteriors. section 2.4.1 section 3.6.2






