dataingestion

There are 0 repository under dataingestion topic.

• psnegi / data_science_tools1

  course website for data science tools 1

  datasciencebash-scriptpandasseaborngitedamatplotlibjupyter-notebooksklearndataingestiondatawrangling
  Language:Jupyter Notebook 11

• chayansraj / Microsoft-Azure-Medallion-Data-pipeline

  In this project we are going to create an end-to-end data platform right from Data Ingestion, Data Transformation, Data Loading and Reporting.

  analyticsazureazure-data-factoryazure-databricksazure-storageazure-synapse-analyticsbig-datacloudcloud-computingdata-engineeringdata-sciencedata-visualizationdatabasedataingestionetl-pipelinemysqlpowerbisparksql
  Language:Jupyter Notebook 4

• immanuvelprathap / Data-Science-Road-Map

  data-sciencestatisticsprogrammingmachine-learningtext-miningnlp-machine-learningdata-visualizationbig-datadataingestiondatamunging
  Language:Python 4

• george-mountain / Data-Extraction-Integration-and-Analysis---Clustering-Operations

  This repository for a project detailing the step by step approach of scraping data, integrating data from various sources, performing analysis on data from various sources for the purpose of analaysis. It also shows how APIs can be harnessed for data engr operations. In this project, the four square API was utilized for the location data.

  clustering-algorithmdataingestiondataintegrationdataprojectdatasciencedatascrapingfoursquare-apimachine-learning
  Language:Jupyter Notebook 2

• bolzon / poc-localstack

  Proof of concept using localstack as a mock AWS (cloud) to build a basic data ingestion infra using Terraform

  awsbigdatadata-ingestiondataingestiondevopsfirehoselocalstackpocsreterraform
  Language:HCL 1

• camara94 / introduction-to-data-engineering

  Describe the different entities that form a modern data ecosystem. Describe and differentiate between the role and responsibilities of Data Engineers, Data Scientists, Data Analysts, Business Analysts, and Business Intelligence Analysts. Explain what Data Engineering is. List the tasks that need to be performed in a typical data engineering lifecycle. Describe what a day in the life of a Data Engineer looks like.

  dataingestiondatadataintegrationpythondatasciencemachinelearningbusiness-intelligencebusiness-analyticsstatistical-analysis
  1

• khadkarajesh / wine-prediction

  White and Red Wine classification using logistic regression

  machine-learningclassificationlogistic-regressionairflowairflow-dagsscikit-learnmachine-learning-pipelinepandasnumpymlflowpostgresqldata-sciencedataingestionpipelinepythonflaskevidentlylogistic-regression-algorithmclassification-algorithmsupervised-learning
  Language:HTML 1

• luccayz / dataengineer_project_002

  O projeto consiste em desenvolver uma solução para a migração de dados de uma fonte com muitos arquivos para uma base de dados hospedada em ambiente Cloud.

  azureazuresqldbcsvdatadataengineeringdataingestiondmasql
  Language:TSQL 0

• MaheshKumarMK / Compressive-strength-prediction

  The main purpose of this repository is to build the pipeline for training of regression models and predict the compressive strength of concrete to reduce the risk and cost involved in discarding the concrete structures when the concrete cube test fails.

  datadataingestiondatasciencedatatransformationdatavalidationdockergcpgithubworkflowmachine-learningmodelbuildingmodelevaluationmodeltrainingpipelinepython3
  Language:Python 0

• OmerGamie / mlproject

  This repo hosts an end-to-end machine learning project designed to cover the full lifecycle of a data science initiative. The project encompasses a comprehensive approach including data Ingestion, preprocessing, exploratory data analysis (EDA), feature engineering, model training and evaluation, hyperparameter tuning, and cloud deployment.

  aws-cloudazureci-cddataingestionexception-handlingflask-webappgithub-actionshyperparameter-tuningloggingpython3gradientboostingregressorkneighborsregressorlinearregressionrandomforestregressordecisiontreeregressorr2-scorexgboost-regressormodelevaluationmodeltraining
  Language:Jupyter Notebook 0

• OmerGamie / sfguide-intro-to-machine-learning-with-snowpark-ml-for-python-main

  dataingestionfeature-transformationmlflowmodel-trainingpython3snowpark
  Language:Jupyter Notebook 0

• PoopLord1 / 4ChanWatcher

  An application of my Centipede framework to watch 4Chan for any potentially threatening behavior.

  4chandataingestionpipelinewebscraping
  Language:Python 0

• max030 / Team8NJAssignment1

  datasciencedataingestiondatawranglingdata-analysisdata-visualisationpythonnotebook-jupyterpipelines-as-codedocker-imagepython-2
  Language:Jupyter Notebook

• rizkyirw / Pipeline-Project

  Resource for ETL & Data Ingestion program using Apache Airflow

  dataingestiondatapipelineetl-automation
  Language:Python