Hasitha Arumawadu's repositories
textClassification-deploy-AML
This demonstrate how to deploy text classification model on Azure Machine Learning Services using azureml-sdk.
skillExtractorAML
This project extract skills of employees using JD(Job Description) free text column. Use Azure Machine Learning Service and Azure Data Lake Gen2 as storage layer. Model runs on AML computer cluster in parallel model. Input data takes from Data Lake and register under AML Datastore. Output data uploaded into AML default Blob storage.
sparkNextBestOffer-RF
This is Spark/Scala based Next Best Offer Recommendation Model which used Random Forest Classifier Algorithm
clusteringCreditRating
This is pyspark based K-means clustering model which categorized Mobile Telecommunication customer based on their credit behaviors
emotionDetection-MS_faceAPI
This uses Microsoft Face API to realtime detect human emotions and insert into SQL Server database.
LSTMtextClassifier
LSTM based text classifier using GloVe vector embedding. Model training runs on Azure Machine Learning workspace as an Experiment using compute cluster
NDVI-and-maxConnectedArea
This will calculates the NDVI values on each pixel on 4-channel image and identify the maximum vegetation area
NPSClassification
This is pyspark based NPS(Net Promote Score) text classification model developed using Naive Bayes Classifier.
pysparkWordCloud
This is pyspark based simple word cloud developed using TF-IDF
sparkChurnPrediction
This is spark/Scala based Mobile Telecommunication Customer Churn Prediction model developed using Random Forest algorithm
sparkRecommendationModel
This is Spark/Scala based Mobile Telecommunication Customer Value Added Services Recommendation Model which used Collaborative Filtering based Alternative Least Square Algorithm.
airflow-crypto
Airflow pipeline to encrypt and decrypt data
information-retrival-faiss-distrilbert
Semantic search engine
Resume-validation
This will validate and separate documents into CV or non-CV.
spark-event-processor
Pyspark based event processor