Gaussian Mixture Model Implementation in Pyspark
GMM algorithm models the entire data set as a finite mixture of Gaussian distributions,each parameterized by a mean vector, a covariance matrix and a mixture weights. Here the probability of each point to belong to each cluster is computed along with the cluster statistics.
This distributed implementation of GMM in pyspark estimates the parameters using the Expectation-Maximization algorithm and considers only diagonal covariance matrix for each component.
GMM Clustering with next parameters (c_components = 2, n_iter=100 and convengernce=10), obtaining the next means:
[ 9.99759714 0.01083996]
[ 0.03545101 0.03003542]
and covars
[ 0.09724083 3.06364234]
[ 0.94146449 1.02791156]