alexiszamanidis / news_articles_text_mining

News Articles Text Classification and Clustering using Machine Learning in Python. Also, KNN implementation from scratch using max heap.

News Articles Text Classification and Clustering

In this repository we perform Text Classification and Clustering experiments. Also, generating Word Clouds for each article category.

The input consists of 2225 documents from a news site that corresponds to stories in five local areas from 2004-2005.

Document Categories

• Business
• Entertainment
• Politics
• Sport
• Tech

First line of each document is the title and the rest is the content of the article.

The whole procedure consists of:

1. Create a data set of all documents
2. Text pre-processing
   1. Remove special characters, lower case
   2. Remove Stopwords
   3. Lemmatization
   4. Stemming
   5. Tokenization
3. Generate Word Clouds
4. Vectorization
5. Classification and Clustering

I also implemented a KNN Classifier using max heap, but it was too slow for this data set.

Word Clouds

Business

Entertainment

Politics

Sport

Tech

Classification

Classifier: MultinomialNB, SVM, RF, KNN

Vectorization: Bag Of Words, Tf-idf

Dimensionality Reduction: PCA, SVD and ICA

Roc curves

Clustering

Clusterer: Kmeans

Vectorization: Bag Of Words, Tf-idf, Word2vec

Dimensionality Reduction: PCA, SVD and ICA

PCA

SVD

ICA