data-warehousing

There are 7 repositories under data-warehousing topic.

• cynkra / dm

  Working with relational data models in R

  data-modeldata-warehousingdatawarehousingdbidbplyrrrelational-databases
  Language:R 489

• apache / doris-flink-connector

  Flink Connector for Apache Doris

  data-warehousingmppolapdbmsapachedorisflinkconnector
  Language:Java 278

• apache / doris-manager

  Cluster manager for Apache Doris

  data-warehousingmppolapdbmsapachedorismanagerui
  Language:Java 161

• totalhack / zillion

  Make sense of it all. Semantic data modeling and analytics with a sprinkle of AI. https://totalhack.github.io/zillion/

  warehousedata-warehousingdatasourcesquery-builderreportinganalyticsdata-analysispythonsqlaiopenaitext-to-sqlsemantic-data-modelsemantic-layer
  Language:Python 153
• Skytrax-Data-Warehouse

  iam-mhaseeb / Skytrax-Data-Warehouse

  A full data warehouse infrastructure with ETL pipelines running inside docker on Apache Airflow for data orchestration, AWS Redshift for cloud data warehouse and Metabase to serve the needs of data visualizations such as analytical dashboards.

  pythonpython3databasedata-visualizationdata-analysisdata-warehousedata-warehousingredshiftairflowdockersqldata-orchestrationdata-analyticss3s3-bucketmetabasedata-engineeringdata-cleaningdata-processing
  Language:Python 131
• Real-time-Data-Warehouse

  izhangzhihao / Real-time-Data-Warehouse

  Real-time Data Warehouse with Apache Flink & Apache Kafka & Apache Hudi

  flinkdata-warehousereal-time-data-warehousedata-warehousingflink-sqldebeziumkafkaelasticsearchdelta-lakecdcchange-data-capturehudihoodieicebergsqldatalakedeltadeltalakesparkspark-sql
  Language:Dockerfile 99

• anna-geller / prefect-dataplatform

  Example repository showing how to build a data platform with Prefect, dbt and Snowflake

  analyticsanalytics-engineeringautomationdata-engineeringdata-platformdbtpythonsnowflakesqldata-warehousingdataflowdataflow-opsorchestrationprefect
  Language:Python 81

• apache / doris-spark-connector

  Spark Connector for Apache Doris

  data-warehousingmppolapdbmsapachedorissparkconnector
  Language:Java 67

• apache / doris-website

  Apache Doris Website

  dorisanalyticsapachebig-datadata-warehousingdatabasedatalakedbmsdistributed-systemhadoophivehudiicebergmppolapssbtpchvectorized
  Language:TypeScript 64

• oracle / dw-vldb-samples

  This is a top level repository for code examples related to Data Warehousing and Very Large Databases.

  data-warehousingdatabase
  Language:PLSQL 33

• fibo / OLAP-cube

  is an hypercube of data

  olap-cubebusiness-intelligencecubepivotpivot-tablestabledata-warehousedata-warehousingdwholapreport
  Language:JavaScript 32
• data-platforms-tools

  ryandawsonuk / data-platforms-tools

  Guide to data platforms and tools

  azure-synapse-analyticsdata-warehousingbigquerydatabrickssnowflakedata-platformclouderadata-meshdata-governance
  31

• apache / doris-thirdparty

  Self-managed thirdparty dependencies for Apache Doris

  analyticsbig-datadata-warehousingdatabasedatalakedbmsdistributed-databasehadoophivehudiicebergmppolapreal-timesqlssbtpchvectorized
  27

• cfpb / aurora

  An open source enterprise data warehousing and analysis platform.

  ansibledata-sciencedata-warehousing
  Language:Jinja 21

• CEDStandards / CEDS-Data-Warehouse

  Modeled for longitudinal storage and reporting of P-20W data, the Common Education Data Standards (CEDS) Data Warehouse implements star schema data warehouse normalization techniques for improved query performance.

  cedseducation-data-standardseducation-dataeducation-databasesql-serverdata-warehousedata-warehousingdata-warehouses
  Language:TSQL 18

• alexisrolland / listof

  :scroll: Simple and flexible application to manage configuration data aka lists of values.

  data-warehousedata-warehousingdimensionsfeature-storelist-of-valueslistsmappingmapping-tools
  Language:Vue 16

• gavindsouza / instagram-to-sqlite

  Save data from Instagram takeout to a SQLite database

  data-warehousingdogsheephacktoberfestinstagramsqlitetakeout
  Language:Python 14

• geofurb / Ornitholog

  Open-source Twitter collection and archiving tool for tracking specific topics and collecting bulk data.

  twitter-apicollect-tweetsstore-tweetstweetsstreaming-apidata-miningdata-collectiondata-warehousing
  Language:Python 14

• totalhack / zillion-web

  Zillion Web: A Demo UI and Web API for Zillion

  vuedockerswarmdemo-uidocker-swarm-modezillionanalyticswarehousedata-warehousingfastapitypescriptnlptext-to-sql
  Language:Vue 14

• confluentinc / demo-realtime-data-warehousing

  Streaming data pipelines for real-time data warehousing. Includes fully managed connectors (PostgreSQL CDC, Snowflake).

  confluent-cloudconnectdata-warehousingksqldbstreaming-data-pipelinesdatabrickspostgresqlsnowflake
  Language:HCL 13

• Amey-Thakur / DATA-WAREHOUSING-AND-MINING-AND-DATA-WAREHOUSING-AND-MINING-LAB

  CSC603: Data Warehousing and Mining [DWM] & CSL603: Data Warehousing and Mining Lab [DWM Lab] <Semester VI>

  engineeringcomputer-engineeringcomputer-sciencetextbooksdata-warehousingdata-warehousedata-miningdata-warehouse-architectureameythakurameymegasatish
  11

• kpratikin / Business-Intelligence-and-Data-Warehousing

  Business Intelligence and Data Warehousing Project

  business-intelligencedata-warehousingdimensional-modelentity-relationship-diagrametletl-pipelineextract-transform-loadpentahotableau-desktop
  Language:TSQL 10

• amod26 / DataEngineeringWithPython

  Various Projects on Python related to Data Engineering

  pythondatabasesqlite3redshiftcassandrasqlnosqldata-warehousingoptimization
  Language:Jupyter Notebook 7

• AnthonyByansi / MicrosoftFabric-Exploratorium

  A comprehensive educational resource hub dedicated to mastering Microsoft Fabric, offering in-depth tutorials, real-world use cases, and hands-on guides for seamless end-to-end analytics

  analyticsbig-datacollaborationdata-integrationdata-transformationdata-warehousingdelta-lakemicrosoft-fabricpowerbireal-time-analyticssparkone-lakedata-analyticsdata-engineeringdata-sciencelakehouseserverless-computing
  Language:Shell 7

• DeleLinus / HFR-Data-Warehousing

  End-to-end data engineering processes for the NIGERIA Health Facility Registry (HFR). The project leveraged Selenium, Pandas, PySpark, PostgreSQL and Airflow

  airflowairflow-dagsapache-sparkdata-engineerdata-engineering-pipelinedata-ingestiondata-miningdata-sciencedata-warehouse-architecturedata-warehousingdatabase-designelterdiagramnigerian-datapostgresql-databasepysparkpythonselenium-pythonetl-automationetl-pipeline
  Language:Python 7

• jimit105 / Computer-Engineering-Programs

  Programs for various subjects of Computer Engineering

  algorithmsartificial-intelligencebig-data-analyticscompiler-constructioncomputer-engineeringcryptographydata-miningdata-structuresdata-warehousingobject-oriented-programmingoperating-systems
  Language:C 7

• MattTriano / analytics_data_where_house

  An analytics engineering sandbox focusing on real estates prices in Cook County, IL

  airflowdata-engineeringdata-pipelinesdata-warehousingdbteltpythondockermkdocs-materialopen-sourcedata-catalogdata-discoverydata-platformsuperset
  Language:Python 7

• ShawnShiSS / data-engineering-ssis-etl

  Starter project for building an ETL pipeline using SSIS in Visual Studio 2019

  data-engineeringssisetletl-pipelinevisualstudio2019data-warehousingdata-manipulation
  7

• dharm18 / stock-datawarehouse

  A data warehouse and business intelligence project on Stock market dataset to answer non-trivial BI queries.

  datawarehousingbusiness-intelligencedatasciencedataanalyticsdata-warehousedata-warehousingdata-visualizationtableau-desktopstock-datawarehouse
  Language:R 6

• JennyferWAN / Coursera_IBM_Data_Engineering

  IBM Data Engineering - Master SQL, RDBMS, ETL, Data Warehousing, NoSQL, Big Data and Spark with hands-on job-ready skills

  courseradata-engineeringdata-pipelinesdata-warehousingetlibm-courseraibm-data-engineeringnosqlrdbmsshellsqluxbigdataspark
  Language:Jupyter Notebook 6
• demo-azuresynapse

  aessing / demo-azuresynapse

  This repository includes the demos and codes I use to play around with Azure Synapse Anayltics

  analyticsazureazure-sql-datawarehouseazure-synapse-analyticsazure-synapse-dwhdata-engineeringdata-warehousingdatawarehousemachine-learningmdwhmicrosoftpowerbipythonscalasparkspark-dotnetspark-sqlsql-data-warehousesynapsesynapse-analytics
  5

• jonathankamau / udend-data-warehouse-project

  Sparkify Data Warehouse Project for song play analysis

  datadata-warehousingetl-pipeline
  Language:Python 5

• mahmoudparsian / data-warehousing

  This repository is a place for the Data Warehousing course at the Information Systems & Analytics department, Santa Clara University.

  business-intelligencedata-analyticsdata-miningdata-modelingdata-warehousingdatabasedimensional-modelingetlstar-schemadata-lakedata-lakehousedata-visualizationelt
  Language:HTML 5

• vein-project-team / vp-data

  Chinese hushen stock market analysis project

  pythondata-analysisstock-market-analysisdata-warehousingchinese-stock
  Language:Python 5

• trieb-work / schemabase

  The schemabase Integration framework to build custom data movers between different cloud services. Using BullMQ, Webhooks, Prisma Database and more

  data-warehousingecommerceecommerce-platform
  Language:TypeScript 4

• BayoAdejare / lightning-streams

  Batch/stream ETL pipeline of NOAA GLM dataset, using Python frameworks: Dagster, PySpark and Parquet storage.

  clusteringcsvdata-engineeringdata-pipelinedata-warehousingdatabaseetl-pipelinejupyter-notebookk-means-clusteringmachine-learningnoaa-dataorchestrationparquetpysparkpythonspark-sqlspark-streamingsqlstreaming
  Language:Python 3