subhadeep-123 / Implementations-Of-Machine-Learning-Algorithms

This repository contains implementations of all Machine Learning Algorithms

Machine-Learning-Algorithms

What is Machine Learning?

Machine learning (ML) is the scientific study of algorithms and statistical models that computer systems use to effectively perform a specific task without using explicit instructions, relying on patterns and inference instead. It is seen as a subset of artificial intelligence. Machine learning algorithms build a mathematical model of sample data, known as "training data", in order to make predictions or decisions without being explicitly programmed to perform the task.

---

• What is Supervised learning?

Supervised learning is the machine learning task of learning a function that maps an input to an output based on example input-output pairs. It infers a function from labeled training data consisting of a set of training examples. In supervised learning, each example is a pair consisting of an input object (typically a vector) and a desired output value (also called the supervisory signal). A supervised learning algorithm analyzes the training data and produces an inferred function, which can be used for mapping new examples.

Example 1: Given data about the size of houses on the real estate market, try to predict their price. Price as a function of size is a continuous output, so this is a regression problem. We could turn this example into a classification problem by instead making our output about whether the house "sells for more or less than the asking price." Here we are classifying the houses based on price into two discrete categories.

Example 2: (a) Regression - Given a picture of a person, we have to predict their age on the basis of the given picture (b) Classification - Given a patient with a tumor, we have to predict whether the tumor is malignant or benign.

Regression Algorithms

1. Linear Regression
2. Multiple Linear Regression
3. Polynomail Regression
4. Support Vector Regression
5. Desision Tree Regression
6. Random Forest Regression

Classification Algorithms

1. Logistic Regression
2. K Nearest Neighbours Classification
3. Support Vector Classification
4. Kernel SVM
5. Naive Bayes
6. Desision Tree Classification
7. Random Forest Classification

• What is unsupervised learning?

Unsupervised learning is a term used for Hebbian learning, associated to learning without a teacher, also known as self-organization and a method of modeling the probability density of inputs. The cluster analysis as a branch of machine learning that groups the data that has not been labeled, classified or categorized. Instead of responding to feedback, cluster analysis identifies commonalities in the data and reacts based on the presence or absence of such commonalities in each new piece of data.

Example: Clustering: Take a collection of 1,000,000 different genes, and find a way to automatically group these genes into groups that are somehow similar or related by different variables, such as lifespan, location, roles, and so on. Non-clustering: The "Cocktail Party Algorithm", allows you to find structure in a chaotic environment. (i.e. identifying individual voices and music from a mesh of sounds at a cocktail party).

Clustering Algorithms

1. K-Means Clustering
2. Mean-Shift Clustering
3. Density-Based Spatial Clustering of Applications with Noise (DBSCAN)
4. Expectation–Maximization (EM) Clustering using Gaussian Mixture Models (GMM)
5. Agglomerative Hierarchical Clustering