data-preprocessing

There are 11 repositories under data-preprocessing topic.

zzw922cn / Automatic_Speech_Recognition
End-to-end Automatic Speech Recognition for Madarian and English in Tensorflow
automatic-speech-recognition tensorflow timit-dataset feature-vector phonemes data-preprocessing rnn audio deep-learning lstm end-to-end cnn rnn-encoder-decoder evaluation paper speech-recognition layer-normalization chinese-speech-recognition
Language:Python 2843
skrub
skrub-data / skrub
Machine learning with dataframes
data data-analysis data-cleaning data-preparation data-preprocessing data-science data-wrangling dataframe dataframes dirty-data machine-learning
Language:Python 1457
Western-OC2-Lab / AutoML-Implementation-for-Static-and-Dynamic-Data-Analytics
Implementation/Tutorial of using Automated Machine Learning (AutoML) methods for static/batch and online/continual learning
automated-machine-learning automl concept-drift data-preprocessing data-stream-processing data-streams deep-learning feature-engineering hyperparameter-tuning intrusion-detection-system iot iot-data-analytics machine-learning model-selection python-examples python-samples
Language:Jupyter Notebook 627
data-prep-kit / data-prep-kit
Open source project for data preparation of LLM application builders
data-preparation finetuning llm llmapps data data-prep data-preprocessing data-preprocessing-pipelines datacuration large-language-models large-scale-data-processing python ray spark datarecipes code-quality deduplication malware
Language:HTML 613
machinelearnjs / machinelearnjs
Machine Learning library for the web and Node.
data-preprocessing easy-to-use feature-extraction machine-learning minimalistic node probabilistic-models random-forest statistical-learning structured-data svm web
Language:TypeScript 542
klib
akanz1 / klib
Easy to use Python library of customized functions for cleaning and analyzing data.
data-science data-analysis klib data-visualization python feature-selection data-cleaning data-preprocessing
Language:Python 509
desbordante-core
Desbordante / desbordante-core
Desbordante is a high-performance data profiler that is capable of discovering many different patterns in data using various algorithms. It also allows to run data cleaning scenarios using these algorithms. Desbordante has a console version and an easy-to-use web application.
data-analytics data-cleaning data-cleansing data-engineering data-exploration data-mining data-profiling data-science data-wrangling data-preprocessing feature-selection feature-engineering feature-extraction spreadsheets tabular-data anomaly-detection data-mining-algorithms exploratory-data-analysis knowledge-discovery correlations
Language:C++ 397
shamspias / customizable-gpt-chatbot
A dynamic, scalable AI chatbot built with Django REST framework, supporting custom training from PDFs, documents, websites, and YouTube videos. Leveraging OpenAI's GPT-3.5, Pinecone, FAISS, and Celery for seamless integration and performance.
artificial-intelligence chatbot data-preprocessing django django-rest-framework gpt-3 machine-learning nlp python conversational-ai voice-chat voice-recognition voice-to-text voice-transcription gpt-voice natural-language-processing langchain langchain-python longchain autogpt
Language:Python 389
msamogh / nonechucks
Deal with bad samples in your dataset dynamically, use Transforms as Filters, and more!
pytorch data-processing data-preprocessing data-pipeline data-cleaning preprocessing machine-learning torch
Language:Python 379
100-Days-Of-ML-Code
harunurrashid97 / 100-Days-Of-ML-Code
A day to day plan for this challenge. Covers both theoritical and practical aspects
machine-learning python eda vizualization 100daysofmlcode datascience tutorials siraj-raval-challenge machine-learning-algorithms infographics 100-days-of-code implementation regression-algorithms exploratory-data-analysis data-science data-preprocessing decision-tree textsummarization linear-regression article
Language:Jupyter Notebook 227
TirendazAcademy / PANDAS-TUTORIAL
Jupyter Notebooks and Data Sets for Pandas Library
data data-analysis data-preprocessing data-science machine-learning pandas pandas-dataframe pandas-datareader pandas-library pandas-python pandas-series pandas-tricks-for-data-manipulation pandas-tutorial python
Language:Jupyter Notebook 210
HasnainRaz / SemSegPipeline
A simpler way of reading and augmenting image segmentation data into TensorFlow
augmentation data-augmentation data-augmentations data-preprocessing deep-learning image-augmentation image-preprocessing input-pipeline masks pipeline python semantic-segmentation tensorflow
Language:Python 144
thepanacealab / SMMT
Social Media Mining Toolkit (SMMT) main repository
annotation data-acquisition data-annotation data-preprocessing gathering spacy tweets twitter-api
Language:Python 133
dali_backend
triton-inference-server / dali_backend
The Triton backend that allows running GPU-accelerated data pre-processing pipelines implemented in DALI's python API.
dali data-preprocessing deep-learning fast-data-pipeline gpu image-processing nvidia-dali python
Language:C++ 132
dansuh17 / segan-pytorch
SEGAN pytorch implementation https://arxiv.org/abs/1703.09452
segan pytorch data-preprocessing segan-pytorch audio speech-enhancement source-separation mir
Language:Python 108
TensorMSA / tensormsa
Deep learning GUI frame work for enterprise
deep-learning machine-learning tensorflow docker gpu microservices-architecture data-preprocessing docker-compose
Language:Python 108
Mohan-Zhang-u / mzutils
deep-learning machine-learning machinelearning question-answering tensorflow tensorflow2 torch data-preprocessing data-visualization natural-language-processing reinforcement-learning toolkit readthedocs
Language:Python 104
asavinov / prosto
Prosto is a data processing toolkit radically changing how data is processed by heavily relying on functions and operations with functions - an alternative to map-reduce and join-groupby
workflow data-processing map-reduce spark pandas python feature-engineering data-science data-wrangling data-preprocessing data-preparation business-intelligence olap
Language:Python 90
HypoX64 / candock
A time series signal analysis and classification framework
eeg deep-learning classification series-signal-analysis data-preprocessing data-augmentation
Language:Python 85
wangxb96 / Awesome-EdgeAI
Resources of our survey paper "Optimizing Edge AI: A Comprehensive Survey on Data, Model, and System Strategies"
data-preprocessing edge-ai edge-computing efficient-algorithm machine-learning model-acceleration model-compression model-inference tiny-ml awesome-list deep-learning model-deployment model-design
80
nursnaaz / 25DaysInMachineLearning
I will update this repository to learn Machine learning with python with statistics content and materials
python machine-learning machine-learning-algorithms machinelearning machinelearning-python statistics data-science modelling python3 data-preprocessing practise descriptive-statistics bias linear-regression decision-tree numpy covariance logistic-regression random-forest bagging
Language:Jupyter Notebook 58
hxycorn / Twitter-Sentiment-Analysis-about-ChatGPT
A quantitative study on over 1.25 million tweets about ChatGPT, employed data scrapping, data cleaning, EDA, topic modeling, and sentiment analysis.
data-analysis data-preprocessing data-visualization roberta-model sentiment-analysis topic-modeling twitter-scraping vader
Language:Jupyter Notebook 55
LaureBerti / Learn2Clean
Learn2Clean: Optimizing the Sequence of Tasks for Data Preparation and Cleaning
reinforcement-learning data-cleaning data-cleaning-pipeline automated data-curation data-preprocessing
Language:Python 51
danielhanchen / sciblox
sciblox - Easier Data Science and Machine Learning
boosting data-analysis data-mining data-preprocessing data-science data-visualization imputation machine-learning python sklearn
Language:HTML 50
soumyadip007 / Data-Science-Using-Python-University-Course-Module
“Data science” is just about as broad of a term as they come. It may be easiest to describe what it is by listing its more concrete components: Data exploration & analysis. Included here: Pandas; NumPy; SciPy; a helping hand from Python's Standard Library.
data-science python jupyter-notebook knn data-processing data-preprocessing data-preparation data-visualization panda numpy plotting
Language:Jupyter Notebook 45
Elysian01 / Data-Purifier
A Python library for Automated Exploratory Data Analysis, Automated Data Cleaning, and Automated Data Preprocessing For Machine Learning and Natural Language Processing Applications in Python.
data-cleaning-pipeline data-cleaning data-preprocessing data-science jupyter python-library datapurifier data-analysis eda python3 python-lib data-visualization exploratory-data-analysis
Language:Jupyter Notebook 44
ojasphansekar / Zillow-Home-Value-Prediction
XGBoost, LightGBM, LSTM, Linear Regression, Exploratory Data Analysis
python-3 machine-learning xgboost-algorithm lightgbm-models lstm-neural-networks exploratory-data-analysis data-preprocessing data-cleansing
Language:Jupyter Notebook 43
teamreboott / data-modori
data data-analysis data-preprocessing data-visualization llm lmops
Language:Python 41
Rpita623 / Movie-Recommendation-System-using-R_Project
Movie Recommendation System: Project using R and Machine learning
rprogramming data-visualization data-science data-analysis datascience rstudio recommender-system recommendation-system recommendation-engine recommendation recommender-systems recommendations machine-learning machinelearning machine-learning-algorithms movie-recommendation-system movie-recommendation r data-preprocessing movielens-dataset
Language:R 40
repetere / modelscript
REPO MOVED TO https://github.com/repetere/jsonstack-data - Data Science and Machine learning in JavaScript
machine-learning data-science data-mining data-preprocessing javascript
Language:JavaScript 39
Kukuster / SumStatsRehab
GWAS summary statistics files QC tool
summary-statistics gwas gwas-summary-statistics gwas-pipeline data-preparation data-preprocessing data-prep bioinformatics bioinformatics-tool sumstats compbio computational-biology
Language:Python 38
mattkearns / automated-data-preprocessing
A command-line utility program for automating the trivial, frequently occurring data preparation tasks: missing value interpolation, outlier removal, and encoding categorical variables.
data-preprocessing data-processing automation python pandas argparse data-science data-engineering machine-learning interpolation imputation outlier-detection outlier-removal one-hot-encode command-line-tool
Language:Python 36
Pooja-Bhojwani / linked-eed
Aim is to come up with a job recommender system, which takes the skills from LinkedIn and jobs from Indeed and throws the best jobs available for you according to your skills.
data-mining data-preprocessing jaccard-similarity job-recommendation python skill-algorithm social-network-backend text-mining
Language:Python 36
CHB-MIT-data-preprocessing-and-prediction
tothemoon10080 / CHB-MIT-data-preprocessing-and-prediction
This project focuses on data preprocessing and epilepsy seizure prediction using the CHB-MIT EEG dataset. It includes steps like data cleansing, feature extraction, and handling imbalanced datasets, aimed at improving the accuracy of seizure prediction.
data-preprocessing eeg-analysis feature-extraction healthcare-analytics machine-learning python signal-processing chb-mit-dataset epilepsy-prediction
Language:Python 34
Western-OC2-Lab / MSANA-Online-Data-Stream-Analytics-And-Concept-Drift-Adaptation
Data stream analytics: Implement online learning methods to address concept drift and model drift in dynamic data streams. Code for the paper entitled "A Multi-Stage Automated Online Network Data Stream Analytics Framework for IIoT Systems" published in IEEE Transactions on Industrial Informatics.
adaptive-learning anomaly-detection change-detector cicids2017 concept-drift data-preprocessing data-stream drift drift-detection ensemble-learning feature-engineering intrusion-detection-system iot iot-data-analytics machine-learning online-learning real-time-analytics streaming-data
Language:Jupyter Notebook 32
vlivashkin / GPUParallel
Joblib-like interface for parallel GPU computations (e.g. data preprocessing)
joblib gpu-computing multiprocessing data-processing pytorch data-preprocessing
Language:Python 31

data-preprocessing

zzw922cn / Automatic_Speech_Recognition

skrub-data / skrub

Western-OC2-Lab / AutoML-Implementation-for-Static-and-Dynamic-Data-Analytics

data-prep-kit / data-prep-kit

machinelearnjs / machinelearnjs

akanz1 / klib

Desbordante / desbordante-core

shamspias / customizable-gpt-chatbot

msamogh / nonechucks

harunurrashid97 / 100-Days-Of-ML-Code

TirendazAcademy / PANDAS-TUTORIAL

HasnainRaz / SemSegPipeline

thepanacealab / SMMT

triton-inference-server / dali_backend

dansuh17 / segan-pytorch

TensorMSA / tensormsa

Mohan-Zhang-u / mzutils

asavinov / prosto

HypoX64 / candock

wangxb96 / Awesome-EdgeAI

nursnaaz / 25DaysInMachineLearning

hxycorn / Twitter-Sentiment-Analysis-about-ChatGPT

LaureBerti / Learn2Clean

danielhanchen / sciblox

soumyadip007 / Data-Science-Using-Python-University-Course-Module

Elysian01 / Data-Purifier

ojasphansekar / Zillow-Home-Value-Prediction

teamreboott / data-modori

Rpita623 / Movie-Recommendation-System-using-R_Project

repetere / modelscript

Kukuster / SumStatsRehab

mattkearns / automated-data-preprocessing

Pooja-Bhojwani / linked-eed

tothemoon10080 / CHB-MIT-data-preprocessing-and-prediction

Western-OC2-Lab / MSANA-Online-Data-Stream-Analytics-And-Concept-Drift-Adaptation

vlivashkin / GPUParallel