data-preprocessing

There are 10 repositories under data-preprocessing topic.

zzw922cn / Automatic_Speech_Recognition
End-to-end Automatic Speech Recognition for Madarian and English in Tensorflow
automatic-speech-recognition tensorflow timit-dataset feature-vector phonemes data-preprocessing rnn audio deep-learning lstm end-to-end cnn rnn-encoder-decoder evaluation paper speech-recognition layer-normalization chinese-speech-recognition
Language:Python 2845
skrub-data / skrub
Prepping tables for machine learning
machine-learning data-science data-cleaning data data-preparation data-preprocessing data-analysis dirty-data data-wrangling
Language:Python 1081
Western-OC2-Lab / AutoML-Implementation-for-Static-and-Dynamic-Data-Analytics
Implementation/Tutorial of using Automated Machine Learning (AutoML) methods for static/batch and online/continual learning
automated-machine-learning automl concept-drift data-preprocessing data-stream-processing data-streams deep-learning feature-engineering hyperparameter-tuning intrusion-detection-system iot iot-data-analytics machine-learning model-selection python-examples python-samples
Language:Jupyter Notebook 614
machinelearnjs / machinelearnjs
Machine Learning library for the web and Node.
machine-learning easy-to-use minimalistic web node statistical-learning random-forest svm feature-extraction data-preprocessing probabilistic-models structured-data
Language:TypeScript 537
klib
akanz1 / klib
Easy to use Python library of customized functions for cleaning and analyzing data.
data-science data-analysis klib data-visualization python feature-selection data-cleaning data-preprocessing
Language:Python 493
msamogh / nonechucks
Deal with bad samples in your dataset dynamically, use Transforms as Filters, and more!
pytorch data-processing data-preprocessing data-pipeline data-cleaning preprocessing machine-learning torch
Language:Python 374
desbordante-core
Desbordante / desbordante-core
Desbordante is a high-performance data profiler that is capable of discovering many different patterns in data using various algorithms. It also allows to run data cleaning scenarios using these algorithms. Desbordante has a console version and an easy-to-use web application.
data-analytics data-cleaning data-cleansing data-engineering data-exploration data-mining data-profiling data-science data-wrangling data-preprocessing feature-selection feature-engineering feature-extraction spreadsheets tabular-data anomaly-detection data-mining-algorithms exploratory-data-analysis knowledge-discovery correlations
Language:C++ 370
shamspias / customizable-gpt-chatbot
A dynamic, scalable AI chatbot built with Django REST framework, supporting custom training from PDFs, documents, websites, and YouTube videos. Leveraging OpenAI's GPT-3.5, Pinecone, FAISS, and Celery for seamless integration and performance.
artificial-intelligence chatbot data-preprocessing django django-rest-framework gpt-3 machine-learning nlp python conversational-ai voice-chat voice-recognition voice-to-text voice-transcription gpt-voice natural-language-processing langchain langchain-python longchain autogpt
Language:Python 356
100-Days-Of-ML-Code
harunurrashid97 / 100-Days-Of-ML-Code
A day to day plan for this challenge. Covers both theoritical and practical aspects
machine-learning python eda vizualization 100daysofmlcode datascience tutorials siraj-raval-challenge machine-learning-algorithms infographics 100-days-of-code implementation regression-algorithms exploratory-data-analysis data-science data-preprocessing decision-tree textsummarization linear-regression article
Language:Jupyter Notebook 220
TirendazAcademy / PANDAS-TUTORIAL
Jupyter Notebooks and Data Sets for Pandas Library
python pandas-tutorial pandas pandas-python pandas-dataframe pandas-tricks-for-data-manipulation pandas-library pandas-series pandas-datareader data data-analysis data-preprocessing data-science machine-learning
Language:Jupyter Notebook 174
HasnainRaz / SemSegPipeline
A simpler way of reading and augmenting image segmentation data into TensorFlow
tensorflow deep-learning input-pipeline data-augmentation semantic-segmentation python data-preprocessing augmentation pipeline data-augmentations image-augmentation image-preprocessing masks
Language:Python 144
thepanacealab / SMMT
Social Media Mining Toolkit (SMMT) main repository
annotation twitter-api data-annotation data-acquisition data-preprocessing spacy gathering tweets
Language:Python 129
dali_backend
triton-inference-server / dali_backend
The Triton backend that allows running GPU-accelerated data pre-processing pipelines implemented in DALI's python API.
nvidia-dali dali deep-learning gpu data-preprocessing python fast-data-pipeline image-processing
Language:C++ 119
Mohan-Zhang-u / mzutils
deep-learning machine-learning machinelearning question-answering tensorflow tensorflow2 torch data-preprocessing data-visualization natural-language-processing reinforcement-learning toolkit readthedocs
Language:Python 108
TensorMSA / tensormsa
Deep learning GUI frame work for enterprise
deep-learning machine-learning tensorflow docker gpu microservices-architecture data-preprocessing docker-compose
Language:Python 107
dansuh17 / segan-pytorch
SEGAN pytorch implementation https://arxiv.org/abs/1703.09452
audio data-preprocessing mir pytorch segan segan-pytorch source-separation speech-enhancement
Language:Python 106
asavinov / prosto
Prosto is a data processing toolkit radically changing how data is processed by heavily relying on functions and operations with functions - an alternative to map-reduce and join-groupby
workflow data-processing map-reduce spark pandas python feature-engineering data-science data-wrangling data-preprocessing data-preparation business-intelligence olap
Language:Python 90
HypoX64 / candock
A time series signal analysis and classification framework
eeg deep-learning classification series-signal-analysis data-preprocessing data-augmentation
Language:Python 79
IBM / data-prep-kit
Open source project for data preparation of LLM application builders
code-quality data data-prep data-preparation data-preprocessing data-preprocessing-pipelines datacuration datarecipes deduplication finetuning large-language-models large-scale-data-processing llm llmapps malware python ray spark
Language:Python 69
nursnaaz / 25DaysInMachineLearning
I will update this repository to learn Machine learning with python with statistics content and materials
python machine-learning machine-learning-algorithms machinelearning machinelearning-python statistics data-science modelling python3 data-preprocessing practise descriptive-statistics bias linear-regression decision-tree numpy covariance logistic-regression random-forest bagging
Language:Jupyter Notebook 58
hxycorn / Twitter-Sentiment-Analysis-about-ChatGPT
A quantitative study on over 1.25 million tweets about ChatGPT, employed data scrapping, data cleaning, EDA, topic modeling, and sentiment analysis.
data-analysis data-preprocessing data-visualization roberta-model sentiment-analysis topic-modeling twitter-scraping vader
Language:Jupyter Notebook 53
wangxb96 / Awesome-EdgeAI
Resources of our survey paper "A Systematic Review of AI Deployment on Resource-Constrained Edge Devices: Challenges, Techniques, and Applications"
data-preprocessing edge-ai edge-computing efficient-algorithm machine-learning model-acceleration model-compression model-inference tiny-ml awesome-list deep-learning model-deployment model-design
49
danielhanchen / sciblox
sciblox - Easier Data Science and Machine Learning
data-science data-visualization data-mining data-analysis imputation machine-learning data-preprocessing python sklearn boosting
Language:HTML 48
LaureBerti / Learn2Clean
Learn2Clean: Optimizing the Sequence of Tasks for Data Preparation and Cleaning
reinforcement-learning data-cleaning data-cleaning-pipeline automated data-curation data-preprocessing
Language:Python 46
soumyadip007 / Data-Science-Using-Python-University-Course-Module
“Data science” is just about as broad of a term as they come. It may be easiest to describe what it is by listing its more concrete components: Data exploration & analysis. Included here: Pandas; NumPy; SciPy; a helping hand from Python's Standard Library.
data-science python jupyter-notebook knn data-processing data-preprocessing data-preparation data-visualization panda numpy plotting
Language:Jupyter Notebook 44
Elysian01 / Data-Purifier
A Python library for Automated Exploratory Data Analysis, Automated Data Cleaning, and Automated Data Preprocessing For Machine Learning and Natural Language Processing Applications in Python.
data-cleaning-pipeline data-cleaning data-preprocessing data-science jupyter python-library datapurifier data-analysis eda python3 python-lib data-visualization exploratory-data-analysis
Language:Jupyter Notebook 43
repetere / modelscript
REPO MOVED TO https://github.com/repetere/jsonstack-data - Data Science and Machine learning in JavaScript
machine-learning data-science data-mining data-preprocessing javascript
Language:JavaScript 39
teamreboott / data-modori
data data-analysis data-preprocessing data-visualization llm lmops
Language:Python 39
ojasphansekar / Zillow-Home-Value-Prediction
XGBoost, LightGBM, LSTM, Linear Regression, Exploratory Data Analysis
python-3 machine-learning xgboost-algorithm lightgbm-models lstm-neural-networks exploratory-data-analysis data-preprocessing data-cleansing
Language:Jupyter Notebook 38
Pooja-Bhojwani / linked-eed
Aim is to come up with a job recommender system, which takes the skills from LinkedIn and jobs from Indeed and throws the best jobs available for you according to your skills.
data-mining data-preprocessing python text-mining social-network-backend job-recommendation skill-algorithm jaccard-similarity
Language:Python 35
Rpita623 / Movie-Recommendation-System-using-R_Project
Movie Recommendation System: Project using R and Machine learning
rprogramming data-visualization data-science data-analysis datascience rstudio recommender-system recommendation-system recommendation-engine recommendation recommender-systems recommendations machine-learning machinelearning machine-learning-algorithms movie-recommendation-system movie-recommendation r data-preprocessing movielens-dataset
Language:R 34
Kukuster / SumStatsRehab
GWAS summary statistics files QC tool
summary-statistics gwas gwas-summary-statistics gwas-pipeline data-preparation data-preprocessing data-prep bioinformatics bioinformatics-tool sumstats compbio computational-biology
Language:Python 33
mdkearns / automated-data-preprocessing
A command-line utility program for automating the trivial, frequently occurring data preparation tasks: missing value interpolation, outlier removal, and encoding categorical variables.
argparse automation command-line-tool data-engineering data-preprocessing data-processing data-science imputation interpolation machine-learning one-hot-encode outlier-detection outlier-removal pandas python
Language:Python 33
ELToulemonde / dataPreparation
Data preparation for data science projects.
data-preparation data-science date-conversion variable-selection variable-elimination r data-preprocessing speed
Language:R 31
maet3608 / nuts-ml
Flow-based data pre-processing for deep learning
data-preprocessing data-science deep-learning deep-learning-framework deep-learning-library
Language:Python 31
Western-OC2-Lab / MSANA-Online-Data-Stream-Analytics-And-Concept-Drift-Adaptation
Data stream analytics: Implement online learning methods to address concept drift and model drift in dynamic data streams. Code for the paper entitled "A Multi-Stage Automated Online Network Data Stream Analytics Framework for IIoT Systems" published in IEEE Transactions on Industrial Informatics.
adaptive-learning anomaly-detection change-detector cicids2017 concept-drift data-preprocessing data-stream drift drift-detection ensemble-learning feature-engineering intrusion-detection-system iot iot-data-analytics machine-learning online-learning real-time-analytics streaming-data
Language:Jupyter Notebook 30

data-preprocessing

zzw922cn / Automatic_Speech_Recognition

skrub-data / skrub

Western-OC2-Lab / AutoML-Implementation-for-Static-and-Dynamic-Data-Analytics

machinelearnjs / machinelearnjs

akanz1 / klib

msamogh / nonechucks

Desbordante / desbordante-core

shamspias / customizable-gpt-chatbot

harunurrashid97 / 100-Days-Of-ML-Code

TirendazAcademy / PANDAS-TUTORIAL

HasnainRaz / SemSegPipeline

thepanacealab / SMMT

triton-inference-server / dali_backend

Mohan-Zhang-u / mzutils

TensorMSA / tensormsa

dansuh17 / segan-pytorch

asavinov / prosto

HypoX64 / candock

IBM / data-prep-kit

nursnaaz / 25DaysInMachineLearning

hxycorn / Twitter-Sentiment-Analysis-about-ChatGPT

wangxb96 / Awesome-EdgeAI

danielhanchen / sciblox

LaureBerti / Learn2Clean

soumyadip007 / Data-Science-Using-Python-University-Course-Module

Elysian01 / Data-Purifier

repetere / modelscript

teamreboott / data-modori

ojasphansekar / Zillow-Home-Value-Prediction

Pooja-Bhojwani / linked-eed

Rpita623 / Movie-Recommendation-System-using-R_Project

Kukuster / SumStatsRehab

mdkearns / automated-data-preprocessing

ELToulemonde / dataPreparation

maet3608 / nuts-ml

Western-OC2-Lab / MSANA-Online-Data-Stream-Analytics-And-Concept-Drift-Adaptation