FoCM 2014 conference

Workshop B1 - Approximation Theory

December 16, 14:35 ~ 15:25 - Room B21

## Wavelet decompositions of Random Forests

### GE Global Research & Tel-Aviv University, Israel   -   Shai.Dekel@GE.com

In the talk we will review how Approximation Theory can be applied to solve some of the challenges of Machine Learning. Tools such as the tree-based Random Forest and the Gradient Boosting Machine are popular and powerful machine learning algorithms that are also employed as part of 'Deep Learning' systems. Constructing the right form of wavelet decomposition of these tools allows establishing ordering of their decision nodes: from significant' features to less significant' to `insignificant' noise. Consequently, simple wavelet techniques can be used to overcome the presence of noise and misclassifications in the training sets and compress large scale neural networks.