Trading-off diversity and accuracy for optimal ensemble tree selection in random forests

H Elghazel, A Aussem, F Perraud - Ensembles in Machine Learning …, 2011 - Springer
H Elghazel, A Aussem, F Perraud
Ensembles in Machine Learning Applications, 2011Springer
We discuss an effective method for optimal ensemble tree selection in Random Forests by
trading-off diversity and accuracy of the ensemble during the selection process. As the
chances of overfitting increase dramatically with the size of the ensemble, we wrap cross-
validation around the ensemble selection to maximize the amount of validation data
considering, in turn, each fold as a validation fold to select the trees from. The aim is to
increase performance by reducing the variance of the tree ensemble selection process. We …
Abstract
We discuss an effective method for optimal ensemble tree selection in Random Forests by trading-off diversity and accuracy of the ensemble during the selection process. As the chances of overfitting increase dramatically with the size of the ensemble, we wrap cross-validation around the ensemble selection to maximize the amount of validation data considering, in turn, each fold as a validation fold to select the trees from. The aim is to increase performance by reducing the variance of the tree ensemble selection process. We demonstrate the effectiveness of our approach on several UCI and real-world data sets.
Springer
顯示最佳搜尋結果。 查看所有結果