Text Analysis
The repository contains Text analysis machine learning compition.
Use Case
- Next word Prediction
- Sentiment Analysis - Analying social media influencer
- Classification
- Topic Modeling - Identify topic category of the text
- Langunage Translation
- Visualization
Pre-Processing
- Case standardization
- Tokenization - character, word, n-gram, sentences
- Removing Stopwords
- Stemming & Lemming
- Word Embeding 5.1) Skip gram 5.2) CBOW 5.3) GloVE 5.4) FastText
- Postional Encoding
Traditional Methods
- Bag of Words
- TF IDF
- Machine learning based - Naive Bayes, Logistic Regression
Deep learning models
- RNN
- GRU
- LSTM
- Bi-Directional LSTM
- Attention
- Transformer 5.1) Bert 5.2) GPT
Dictonary based sentiments
AFIN, BING
Topic Discovery
Latent Drichlet Analysis - Discovering Topics Latent Sementic Analysis - Discovering Document
Source
Tidy Text Hands on ML Github Mam