Title:
A Bayesian View of Boosting and Its Extension
A Bayesian View of Boosting and Its Extension
Files
Author(s)
Bobick, Aaron F.
Essa, Irfan
Shi, Yifan
Essa, Irfan
Shi, Yifan
Advisor(s)
Editor(s)
Collections
Supplementary to
Permanent Link
Abstract
In this paper, we provide a Bayesian perspective of boosting framework, which we refer to as Bayesian Integration. Through this perspective, we prove the standard ADABOOST is a special case of the naive
Bayesian tree with a mapped conditional probability table and a particular weighting schema. Based on this perspective, we introduce a new algorithm ADABOOST.BAYES by taking the dependency between the
weak classifiers into account, which extends the boosting framework into non-linear combinations of weak classifiers. Compared with standard ADABOOST, ADABOOST.BAYES requires less training iterations but exhibits stronger tendency to overfit. To leverage on both ADABOOST and ADABOOST. BAYES, we introduce a simple switching schema ADABOOST. SOFTBAYES to integrate ADABOOST and ADABOOST.BAYES. Experiments on synthetic data and the UCI data set prove the validity of our framework.
Sponsor
Date Issued
2005
Extent
365042 bytes
Resource Type
Text
Resource Subtype
Technical Report