data-cleansing

There are 7 repositories under data-cleansing topic.

• hi-primus / optimus

  :truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark

  sparkpysparkdata-wranglingbigdatabig-data-cleaningdata-sciencedata-cleansingdata-cleanerdata-transformationmachine-learningdata-profilingdata-extractiondata-explorationdata-analysisdata-preparationcudfdaskdask-cudfdata-cleaning
  Language:Python 1446

• data-forge / data-forge-ts

  The JavaScript data transformation and analysis toolkit inspired by Pandas and LINQ.

  data-wranglingdata-forgedatadata-analysisjavascriptnodejslinqpandasvisualizationdata-visualizationdata-managementdata-manipulationdata-mungingdata-cleaningdata-cleansingcsvjson
  Language:TypeScript 1304
• desbordante-core

  Desbordante / desbordante-core

  Desbordante is a high-performance data profiler that is capable of discovering many different patterns in data using various algorithms. It also allows to run data cleaning scenarios using these algorithms. Desbordante has a console version and an easy-to-use web application.

  data-analyticsdata-cleaningdata-cleansingdata-engineeringdata-explorationdata-miningdata-profilingdata-sciencedata-wranglingdata-preprocessingfeature-selectionfeature-engineeringfeature-extractionspreadsheetstabular-dataanomaly-detectiondata-mining-algorithmsexploratory-data-analysisknowledge-discoverycorrelations
  Language:C++ 359

• probcomp / PClean

  A domain-specific probabilistic programming language for scalable Bayesian data cleaning

  probabilistic-programmingprobabilistic-graphical-modelsdata-cleaningdata-cleansingbayesian-inference
  Language:Julia 215

• ajaymache / data-analysis-using-python

  Exploratory data analysis 📊using python 🐍of used car 🚘 database taken from ⓚ𝖆𝖌𝖌𝖑𝖊

  data-sciencedata-analysisdata-visualizationdata-cleaningdata-cleansingdata-wranglingdata-science-pythondata-analyticsdata-analysis-pythonedaexploratory-data-analysiskaggle-competitionkaggle-datasetkaggle-used-cars-dataset
  Language:Jupyter Notebook 213

• BDFD-LearningGround / Cousera_Google-Data-Analytics-Professional-Certificate

  Quizzes & Assignment Solutions for Google Data Analytics Professional Certificate on Coursera. Also included a few resources on side that I found helpful.

  data-cleansingsqldecision-makingdatavizpythondata-sciencedata-analysisexcelquizcourseraassignment-solutionsrgoogledatadata-analyticsprofessional-certificates
  188

• data-integrations / wrangler

  Wrangler Transform: A DMD system for transforming Big Data

  wrangledata-transformationdata-transformdata-sciencetransform-datamanipulate-datacdapbig-datacdap-plugintransformprojectpreparationdata-cleansingdata-prepparsingavro
  Language:Java 83

• ojasphansekar / Zillow-Home-Value-Prediction

  XGBoost, LightGBM, LSTM, Linear Regression, Exploratory Data Analysis

  python-3machine-learningxgboost-algorithmlightgbm-modelslstm-neural-networksexploratory-data-analysisdata-preprocessingdata-cleansing
  Language:Jupyter Notebook 31

• kbasu2016 / Autism-Detection-in-Adults

  This is a binary classification problem related with Autistic Spectrum Disorder (ASD) screening in Adult individual. Given some attributes of a person, my model can predict whether the person would have a possibility to get ASD using different Supervised Learning Techniques and Multi-Layer Perceptron.

  supervised-learningmlp-classifiernaive-bayes-classifierdecision-tree-classifierlogistic-regression-modelsrandom-forestsupport-vector-machinequadratic-discriminant-analysisk-nearest-neighboursdata-wranglingdata-cleansinglinear-discriminant-analysis
  Language:Jupyter Notebook 20

• bakdata / dedupe

  Java DSL for (online) deduplication

  duplicate-detectionduplicate-removaldata-cleaningdata-cleansingdeduplication
  Language:Java 19

• iweld / data_cleaning

  An SQL data cleaning project

  sqldata-analyticsdata-cleansingexcelsql-beginnersqlpracticesqlprojectsql-practice
  14

• AP-State-Skill-Development-Corporation / Data-Science-Using-Python-Internship-EB1

  This repo created for sharing the required/discussed files during Online Internship training program on Data Science Using Python in May-2021

  data-sciencemachine-learningdata-analysispython3data-visualisationdata-cleansing
  Language:Jupyter Notebook 13

• AlexLamson / DataWrangler

  Make quick and dirty data mining made easier in Sublime Text

  sublime-text-plugindata-mungingdata-cleaningdata-cleansingdata-wranglingtext-manipulation
  Language:Python 11

• brunocampos01 / porto-seguro-safe-driver-prediction

  Predict if a driver will file an insurance claim next year. (Kaggle Competition)

  challengekaggleporto-segurodata-engineeringmachine-learningpythondata-sciencerandom-forestxgboostkaggle-competitiondata-cleansinginsurance-claimsdataset
  Language:Python 10

• data-forge / data-forge-fs

  This library contains the file system extensions to Data-Forge that allow it to directly read and write CSV and JSON files in Node.js

  data-wranglingdata-forgedatadata-analysisjavascriptnodejslinqpandasvisualizationdata-visualizationdata-managementdata-manipulationdata-mungingdata-cleaningdata-cleansingcsvjson
  Language:TypeScript 10

• LieseB-1746743 / data-cleaning

  Data cleaning tool.

  cleaning-datadata-profilingdata-cleaningdata-cleansingdata-clustering
  Language:JavaScript 9

• mtimjones / dataprocessing

  Data cleanse, clustering with Vector Quantization and Adaptive Resonance Theory

  data-sciencedata-cleansingvector-quantizationart1
  Language:C 9

• prachitqwer / Power-BI---Product-Rationalization

  Product Rationalization of Pro Bikes Inc using Power BI

  business-analysisdashboarddata-analyticsdata-cleansingdata-modelingdata-transformationdata-visualizationdax-expressiondescriptive-analyticsfinancepowerbisqlsql-servertime-intelligence
  9

• HypertextAssassin0273 / Excel_Data_Organizer_and_Cleaner-DS_Project

  Data Structures project in C++11 language, uses custom Vector & String structures with Move Semantics (Rule of Five)

  cpp11data-cleaningdata-cleansingdata-structure-projectsdata-structuresdata-structures-projectdata-wranglingds-projectseasy-projectexcel-operationsmove-semanticsobject-oriented-programmingoopopen-sourceopen-source-codeopen-source-projectrule-of-fivestringuniversity-projectvector
  Language:C++ 8

• saksham-joshi / super_clean_data

  This is Repository containing two .csv files , one is cleaned and another one is very unconsistent and non-regular data of Mobile Phones. See the difference between both the data files.

  data-cleaningdata-cleansingnumpypandaspython
  8

• TimKong21 / PwC-Switzerland-Power-BI-in-Data-Analytics-Virtual-Case-Experience

  Comprehensive Power BI dashboards showcasing insights on Call Centre Trends, Customer Retention, and Diversity & Inclusion to drive business impact.

  data-storytellingpowerbidata-visualizationinteractive-dashboardsbusiness-intelligencecall-center-analyticscustomer-retentiondiversity-and-inclusiondata-analyticspwcdata-cleansing
  7
• DataCleaning

  DataPreprocessing / DataCleaning

  Data Cleaning is a python package for data preprocessing. This cleans the CSV file and returns the cleaned data frame. It does the work of imputation, removing duplicates, replacing special characters, and many more.

  data-preprocessingimputationthresholdpythondatadata-wranglingdata-cleaningdata-cleansing
  Language:Python 6

• PedroChaparro / PI202202-alako-data

  This repository contains all the files related to project's data collection, data normalization / cleansing and database management.

  data-cleaningdata-cleansingjavascriptpythonrubyscrapingweb-scrapingjupiter-notebooksentence-embeddingssentence-transformers
  Language:Jupyter Notebook 4

• prachitqwer / PowerBI-Demographic-Analysis

  Power BI based Data\Business analysis of e-commerce company with focus on demographic analysis

  dashboarddata-analysisdata-analyticsdata-cleansingdata-modelingdata-transformationdata-visualizationdax-languaguedescriptive-analyticsetlpower-querypowerbisqlsql-servertime-intelligence
  4

• saksham-joshi / Vehicles_Data_Cleaning

  A dataset of waste vehicles with 350,000+ rows is cleaned using pandas and jupyter notebook in python.

  data-analysisdata-cleaningdata-cleansingdatasetpandas-pythonpython
  Language:Jupyter Notebook 4

• sontron / madis

  Manipulating and Analyzing Data Interactively with Shiny

  visualizationshinydata-manipulationlinear-modelsdata-cleansingrinteractivedata-mining
  Language:R 4

• aminkhod / TA--Course-ofData-mining--Fall-2018

  Here is some implementation and using methods in Topics on Data mining course

  machine-learning-algorithmsdata-minigdata-sciencefeature-selectiondeep-learning-tutorialcross-validationregressionclassificationclusteringdata-cleansingdata-visualizationteaching-assistant
  Language:Python 3

• bluestero / urlgenie

  Python package to make URL extraction, generalization, validation, and filtration easy.

  generalizationurl-parsingdata-cleaningdata-cleansingdata-curationdata-processingdata-sanitizationurl-generalization
  Language:Python 3

• dikshantnaik / Data-Cleaning-Assignment-Internship

  A Python script to Parse data from Non-Meaningful data to Meaningful and save it to .csv File

  data-cleaningdata-sciencedata-cleansingpython
  Language:Python 3

• fpjnijweide / autoencoder-pdb-cleaning

  This is the source code for the paper "A probabilistic database approach to autoencoder-based data cleaning".

  autoencodermachine-learningdata-cleaningdata-integrationdata-cleansingneural-networksprobabilistic-databases
  Language:Jupyter Notebook 3

• NataliaAssange / littlejsontools

  Some little json tools for my own use and maybe can help you

  jsondata-cleansing
  Language:Python 3

• siegstedt / predict_credit_card_approval

  Commercial banks receive a lot of applications for credit cards. Many of them get rejected for many reasons, like high loan balances, low income levels, or too many inquiries on an individual's credit report, for example. Manually analyzing these applications is mundane, error-prone, and time-consuming. Luckily, this task can be automated with the power of machine learning. Here is an automatic credit card approval predictor using machine learning techniques.

  data-manipulationmachine-leadata-cleansingfinancesklearn
  Language:Jupyter Notebook 3

• astradrel / ecommercedashboard

  This project showcase the business dashboard for an E-Commerce company based on its 2008 - 2012 sales records

  tableaudata-analysisdata-visualizationdata-cleansingbusiness-intelligencedashboard
  Language:Jupyter Notebook 2

• julianacastilloaraujo / Google-Data-Analytics

  ⭐️ Google Data Analytics + Coursera ⭐️ 👩‍💻 Datos, datos, en todas partes(este curso) 🔍 Skills : Spreadsheet, Data Cleansing, Data Analysis, Data Visualization (DataViz), SQL

  data-cleansingdatavizspreadsheetsql
  2

• zislam / CAIRAD

  Implements the CAIRAD techique for detecting noisy values in a dataset for Weka

  data-cleansingwekajavadataminingdata-miningdata-sciencedata-analysisnoisenoisynoisy-datanoise-identificationnoise-detection
  Language:Java 2

• zislam / DMI

  Implements the DMI imputation algorithm for imputing missing values in a dataset from Rahman, M. G., and Islam, M. Z. (2013): Missing Value Imputation Using Decision Trees and Decision Forests by Splitting and Merging Records: Two Novel Techniques

  wekajavadata-miningdataminingdataminingmissing-valuesmissing-value-imputationimputationpreprocessingdata-analysisanalysisdata-cleansingdata-cleaning
  Language:Java 2