data-preprocessing

There are 9 repositories under data-preprocessing topic.

zzw922cn / Automatic_Speech_Recognition
End-to-end Automatic Speech Recognition for Madarian and English in Tensorflow
automatic-speech-recognition tensorflow timit-dataset feature-vector phonemes data-preprocessing rnn audio deep-learning lstm end-to-end cnn rnn-encoder-decoder evaluation paper speech-recognition layer-normalization chinese-speech-recognition
Language:Python 2839
skrub-data / skrub
Prepping tables for machine learning
machine-learning data-science data-cleaning data data-preparation data-preprocessing data-analysis dirty-data data-wrangling
Language:Python 1010
Western-OC2-Lab / AutoML-Implementation-for-Static-and-Dynamic-Data-Analytics
Implementation/Tutorial of using Automated Machine Learning (AutoML) methods for static/batch and online/continual learning
automated-machine-learning automl concept-drift data-preprocessing data-stream-processing data-streams deep-learning feature-engineering hyperparameter-tuning intrusion-detection-system iot iot-data-analytics machine-learning model-selection python-examples python-samples
Language:Jupyter Notebook 613
machinelearnjs / machinelearnjs
Machine Learning library for the web and Node.
machine-learning easy-to-use minimalistic web node statistical-learning random-forest svm feature-extraction data-preprocessing probabilistic-models structured-data
Language:TypeScript 537
klib
akanz1 / klib
Easy to use Python library of customized functions for cleaning and analyzing data.
data-analysis data-cleaning data-preprocessing data-science data-visualization feature-selection klib python
Language:Python 476
msamogh / nonechucks
Deal with bad samples in your dataset dynamically, use Transforms as Filters, and more!
pytorch data-processing data-preprocessing data-pipeline data-cleaning preprocessing machine-learning torch
Language:Python 373
shamspias / customizable-gpt-chatbot
A dynamic, scalable AI chatbot built with Django REST framework, supporting custom training from PDFs, documents, websites, and YouTube videos. Leveraging OpenAI's GPT-3.5, Pinecone, FAISS, and Celery for seamless integration and performance.
artificial-intelligence chatbot data-preprocessing django django-rest-framework gpt-3 machine-learning nlp python conversational-ai voice-chat voice-recognition voice-to-text voice-transcription gpt-voice natural-language-processing langchain langchain-python longchain autogpt
Language:Python 340
desbordante-core
Desbordante / desbordante-core
Desbordante is a high-performance data profiler that is capable of discovering many different patterns in data using various algorithms. It also allows to run data cleaning scenarios using these algorithms. Desbordante has a console version and an easy-to-use web application.
anomaly-detection correlations data-analytics data-cleaning data-cleansing data-engineering data-exploration data-mining data-mining-algorithms data-preprocessing data-profiling data-science data-wrangling exploratory-data-analysis feature-engineering feature-extraction feature-selection knowledge-discovery spreadsheets tabular-data
Language:C++ 333
100-Days-Of-ML-Code
harunurrashid97 / 100-Days-Of-ML-Code
A day to day plan for this challenge. Covers both theoritical and practical aspects
machine-learning python eda vizualization 100daysofmlcode datascience tutorials siraj-raval-challenge machine-learning-algorithms infographics 100-days-of-code implementation regression-algorithms exploratory-data-analysis data-science data-preprocessing decision-tree textsummarization linear-regression article
Language:Jupyter Notebook 213
iTechArt / convtools-ita
convtools is a python library to declaratively define conversions for processing collections, doing complex aggregations and joins.
python code-generation transformations conversions data-preprocessing data-processing data-preparation functional-programming
Language:Python 183
TirendazAcademy / PANDAS-TUTORIAL
Jupyter Notebooks and Data Sets for Pandas Library
data data-analysis data-preprocessing data-science machine-learning pandas pandas-dataframe pandas-datareader pandas-library pandas-python pandas-series pandas-tricks-for-data-manipulation pandas-tutorial python
Language:Jupyter Notebook 158
HasnainRaz / SemSegPipeline
A simpler way of reading and augmenting image segmentation data into TensorFlow
tensorflow deep-learning input-pipeline data-augmentation semantic-segmentation python data-preprocessing augmentation pipeline data-augmentations image-augmentation image-preprocessing masks
Language:Python 145
thepanacealab / SMMT
Social Media Mining Toolkit (SMMT) main repository
annotation twitter-api data-annotation data-acquisition data-preprocessing spacy gathering tweets
Language:Python 129
dali_backend
triton-inference-server / dali_backend
The Triton backend that allows running GPU-accelerated data pre-processing pipelines implemented in DALI's python API.
dali data-preprocessing deep-learning fast-data-pipeline gpu image-processing nvidia-dali python
Language:C++ 117
Mohan-Zhang-u / mzutils
deep-learning machine-learning machinelearning question-answering tensorflow tensorflow2 torch data-preprocessing data-visualization natural-language-processing reinforcement-learning toolkit readthedocs
Language:Python 108
TensorMSA / tensormsa
Deep learning GUI frame work for enterprise
deep-learning machine-learning tensorflow docker gpu microservices-architecture data-preprocessing docker-compose
Language:Python 108
dansuh17 / segan-pytorch
SEGAN pytorch implementation https://arxiv.org/abs/1703.09452
segan pytorch data-preprocessing segan-pytorch audio speech-enhancement source-separation mir
Language:Python 105
asavinov / prosto
Prosto is a data processing toolkit radically changing how data is processed by heavily relying on functions and operations with functions - an alternative to map-reduce and join-groupby
business-intelligence data-preparation data-preprocessing data-processing data-science data-wrangling feature-engineering map-reduce olap pandas python spark workflow
Language:Python 89
HypoX64 / candock
A time series signal analysis and classification framework
eeg deep-learning classification series-signal-analysis data-preprocessing data-augmentation
Language:Python 77
nursnaaz / 25DaysInMachineLearning
I will update this repository to learn Machine learning with python with statistics content and materials
bagging bias covariance data-preprocessing data-science decision-tree descriptive-statistics linear-regression logistic-regression machine-learning machine-learning-algorithms machinelearning machinelearning-python modelling numpy practise python python3 random-forest statistics
Language:Jupyter Notebook 58
danielhanchen / sciblox
sciblox - Easier Data Science and Machine Learning
data-science data-visualization data-mining data-analysis imputation machine-learning data-preprocessing python sklearn boosting
Language:HTML 48
hxycorn / Twitter-Sentiment-Analysis-about-ChatGPT
A quantitative study on over 1.25 million tweets about ChatGPT, employed data scrapping, data cleaning, EDA, topic modeling, and sentiment analysis.
data-analysis data-preprocessing data-visualization roberta-model sentiment-analysis topic-modeling twitter-scraping vader
Language:Jupyter Notebook 46
LaureBerti / Learn2Clean
Learn2Clean: Optimizing the Sequence of Tasks for Data Preparation and Cleaning
reinforcement-learning data-cleaning data-cleaning-pipeline automated data-curation data-preprocessing
Language:Python 44
soumyadip007 / Data-Science-Using-Python-University-Course-Module
“Data science” is just about as broad of a term as they come. It may be easiest to describe what it is by listing its more concrete components: Data exploration & analysis. Included here: Pandas; NumPy; SciPy; a helping hand from Python's Standard Library.
data-science python jupyter-notebook knn data-processing data-preprocessing data-preparation data-visualization panda numpy plotting
Language:Jupyter Notebook 44
Elysian01 / Data-Purifier
A Python library for Automated Exploratory Data Analysis, Automated Data Cleaning, and Automated Data Preprocessing For Machine Learning and Natural Language Processing Applications in Python.
data-cleaning-pipeline data-cleaning data-preprocessing data-science jupyter python-library datapurifier data-analysis eda python3 python-lib data-visualization exploratory-data-analysis
Language:Jupyter Notebook 41
repetere / modelscript
REPO MOVED TO https://github.com/repetere/jsonstack-data - Data Science and Machine learning in JavaScript
machine-learning data-science data-mining data-preprocessing javascript
Language:JavaScript 39
teamreboott / data-modori
data data-analysis data-preprocessing data-visualization llm lmops
Language:Python 39
wangxb96 / Awesome-AI-on-the-Edge
Resources of our survey paper "Enabling AI on Edges: Techniques, Applications and Challenges"
data-preprocessing edge-ai edge-computing efficient-algorithm machine-learning model-acceleration model-compression model-inference tiny-ml awesome-list deep-learning model-deployment model-design
38
Pooja-Bhojwani / linked-eed
Aim is to come up with a job recommender system, which takes the skills from LinkedIn and jobs from Indeed and throws the best jobs available for you according to your skills.
data-mining data-preprocessing python text-mining social-network-backend job-recommendation skill-algorithm jaccard-similarity
Language:Python 34
Rpita623 / Movie-Recommendation-System-using-R_Project
Movie Recommendation System: Project using R and Machine learning
rprogramming data-visualization data-science data-analysis datascience rstudio recommender-system recommendation-system recommendation-engine recommendation recommender-systems recommendations machine-learning machinelearning machine-learning-algorithms movie-recommendation-system movie-recommendation r data-preprocessing movielens-dataset
Language:R 32
ELToulemonde / dataPreparation
Data preparation for data science projects.
data-preparation data-science date-conversion variable-selection variable-elimination r data-preprocessing speed
Language:R 31
Kukuster / SumStatsRehab
GWAS summary statistics files QC tool
summary-statistics gwas gwas-summary-statistics gwas-pipeline data-preparation data-preprocessing data-prep bioinformatics bioinformatics-tool sumstats
Language:Python 31
maet3608 / nuts-ml
Flow-based data pre-processing for deep learning
deep-learning deep-learning-framework deep-learning-library data-science data-preprocessing
Language:Python 31
mdkearns / automated-data-preprocessing
A command-line utility program for automating the trivial, frequently occurring data preparation tasks: missing value interpolation, outlier removal, and encoding categorical variables.
argparse automation command-line-tool data-engineering data-preprocessing data-processing data-science imputation interpolation machine-learning one-hot-encode outlier-detection outlier-removal pandas python
Language:Python 31
KwokHing / YandexCatBoost-Python-Demo
Demo on the capability of Yandex CatBoost gradient boosting classifier on a fictitious IBM HR dataset obtained from Kaggle. Data exploration, cleaning, preprocessing and model tuning are performed on the dataset
catboost data-analysis data-preprocessing data-science feature-selection gradient-boosting gradient-boosting-classifier one-hot-encode pandas pearson-correlation python python27 seaborn variance-analysis visualization yandex-catboost
Language:Jupyter Notebook 30
Western-OC2-Lab / MSANA-Online-Data-Stream-Analytics-And-Concept-Drift-Adaptation
Data stream analytics: Implement online learning methods to address concept drift and model drift in dynamic data streams. Code for the paper entitled "A Multi-Stage Automated Online Network Data Stream Analytics Framework for IIoT Systems" published in IEEE Transactions on Industrial Informatics.
adaptive-learning anomaly-detection change-detector cicids2017 concept-drift data-preprocessing data-stream drift drift-detection ensemble-learning feature-engineering intrusion-detection-system iot iot-data-analytics machine-learning online-learning real-time-analytics streaming-data
Language:Jupyter Notebook 30

data-preprocessing

zzw922cn / Automatic_Speech_Recognition

skrub-data / skrub

Western-OC2-Lab / AutoML-Implementation-for-Static-and-Dynamic-Data-Analytics

machinelearnjs / machinelearnjs

akanz1 / klib

msamogh / nonechucks

shamspias / customizable-gpt-chatbot

Desbordante / desbordante-core

harunurrashid97 / 100-Days-Of-ML-Code

iTechArt / convtools-ita

TirendazAcademy / PANDAS-TUTORIAL

HasnainRaz / SemSegPipeline

thepanacealab / SMMT

triton-inference-server / dali_backend

Mohan-Zhang-u / mzutils

TensorMSA / tensormsa

dansuh17 / segan-pytorch

asavinov / prosto

HypoX64 / candock

nursnaaz / 25DaysInMachineLearning

danielhanchen / sciblox

hxycorn / Twitter-Sentiment-Analysis-about-ChatGPT

LaureBerti / Learn2Clean

soumyadip007 / Data-Science-Using-Python-University-Course-Module

Elysian01 / Data-Purifier

repetere / modelscript

teamreboott / data-modori

wangxb96 / Awesome-AI-on-the-Edge

Pooja-Bhojwani / linked-eed

Rpita623 / Movie-Recommendation-System-using-R_Project

ELToulemonde / dataPreparation

Kukuster / SumStatsRehab

maet3608 / nuts-ml

mdkearns / automated-data-preprocessing

KwokHing / YandexCatBoost-Python-Demo

Western-OC2-Lab / MSANA-Online-Data-Stream-Analytics-And-Concept-Drift-Adaptation