Scaling Up the Accuracy of Decision-Tree Classifiers: A Naive-Bayes Combination
|
| Title | Scaling Up the Accuracy of Decision-Tree Classifiers: A Naive-Bayes Combination |
| Authors | |
| Abstract | C4.5 and NB are two of the top 10 algorithms in data mining thanks to their simplicity, effectiveness, and efficiency. In order to integrate their advantages, NBTree builds a naive Bayes classifier on each leaf node of the built decision tree. NBTree significantly outperforms C4.5 and NB in terms of classification accuracy. However, it incurs very high time complexity. In this paper, we propose a very simple, effective, and efficient algorithm based on C4.5 and NB. We simply denote it C4.5-NB. Our motivation is to keep the high classification accuracy of NBTree without incurring the high time complexity. In C4.5-NB, C4.5 and NB are built and evaluated independently at the training time, and the class-membership probabilities are weightily averaged according to their classification accuracies on training data at the test time. Empirical studies on a large number of UCI data sets show that it performs as well as NBTree in terms of classification accuracy, but is significantly more efficient than NBTree. |
| Publisher | ACADEMY PUBLISHER |
| Date | 2011-07-01 |
| Source | Journal of Computers Vol 6, No 7 (2011) |
| Rights | Copyright © ACADEMY PUBLISHER - All Rights Reserved.To request permission, please check out URL: http://www.academypublisher.com/copyrightpermission.html. |