YC-Coder-Chen / Tree-Math

Math behind all the mainstream tree-based machine learning models

Tree-Math

Machine learning study notes, contains Math behind all the mainstream tree-based machine learning models, covering basic decision tree models (ID3, C4.5, CART), boosted models (GBM, AdaBoost, Xgboost, LightGBM), bagging models (Bagging Tree, Random Forest, ExtraTrees).

Author

@Yingxiang Chen
@Zihan Yang

Base Decision Tree

1. ID3 Model
2. C4.5 Model
3. CART Tree Model

Boosting Tree Models

1. Adaptive Boosting (AdaBoost)
2. GBM (Gradient Boosting Machine)
3. XGboost (Extreme Gradient Boosting)
4. LightGBM (Light Gradient Boosting Machine)

Bagging Tree Models

1. Bagging Tree
2. Random Forest
3. Extra Trees (Extremely Randomized Trees)