bolagadalla / ML-Project-1

This is Project 1 for CSCI-381 Machine Learning which we have to implement Decision Tree and Random Forest from scratch.

CSCI-381 ML Project 1

Implementing a Decision Tree and Random Forest from scratch in python.

Description

In the DT_orig.py file, it contains the code from the article Implementing a Decision Tree From Scratch which is a simple implementation of a Decision Tree. However, in that article the author only implements the Decision Tree based on the criterion entropy and excluding gini implmentation. As well as the Tree only accepts numpy arrays and numerical values only.

In this project I implemented the following:

1. The gini criterion
2. Uses pandas.DataFrame instead of numpy array
3. The target value can be categorical input.
4. Random Forest Ensemble