FoCM 2014 conference

Workshop B1 - Approximation Theory

December 16, 14:35 ~ 15:25 - Room B21

Wavelet decompositions of Random Forests

Shai Dekel

GE Global Research & Tel-Aviv University, Israel   -

In the talk we will review how Approximation Theory can be applied to solve some of the challenges of Machine Learning. Tools such as the tree-based Random Forest and the Gradient Boosting Machine are popular and powerful machine learning algorithms that are also employed as part of 'Deep Learning' systems. Constructing the right form of wavelet decomposition of these tools allows establishing ordering of their decision nodes: from `significant' features to `less significant' to `insignificant' noise. Consequently, simple wavelet techniques can be used to overcome the presence of noise and misclassifications in the training sets and compress large scale neural networks.

View abstract PDF