data-factory
There are 3 repositories under data-factory topic.
- Language:Apex 222
Azure-Player / azure.datafactory.tools
Tools for deploying Data Factory (v2) in Microsoft Azure
Language:PowerShell 205- procfwk
mrpaulandrew / procfwk
A cross tenant metadata driven processing framework for Azure Data Factory and Azure Synapse Analytics achieved by coupling orchestration pipelines with a SQL database and a set of Azure Functions.
Language:C# 178 - Forceea-data-factory
Forceea / Forceea-data-factory
The most advanced and powerful native open-source data factory for Salesforce.
Language:Apex 121 microsoft / MCW-Modern-cloud-apps
MCW Modern cloud apps
Language:JavaScript 110houbb / data-factory
🏭Auto generate mock data for java test.(便于 Java 测试自动生成对象信息)
Language:Java 87A stand-alone test framework that allows to write unit tests for Data Factory pipelines on Microsoft Fabric and Azure Data Factory.
Language:Python 67ontola / ontologies
Never manage a namespace object map again, scrap typo's for well-known ontologies. Like DefinitelyTyped, but for ontologies.
Language:TypeScript 48Azure / data-factory-deploy-action
GitHub Action for side-effect free deployment of Azure Data Factory resources
Language:PowerShell 29- Microsoft-Data-Integration-Pipeline-Training
mrpaulandrewltd / Microsoft-Data-Integration-Pipeline-Training
Training workshop content on Azure Data Factory and Azure Synapse Analytics Data Integration Pipelines
Language:TSQL 28 LREN-CHUV / airflow-imaging-plugins
Set of plugins helping to work with imaging data in Airflow.
Language:Python 15ekote / Build-Your-First-End-to-End-Lakehouse-Solution
Build Your First End-to-End Lakehouse Solution (aka.ms/fabconlake)
Language:Jupyter Notebook 12HBPMedical / mri-preprocessing-pipeline
MRI preprocessing pipeline
Language:MATLAB 12- Language:Python 12
rubensworks / rdf-data-factory.js
A TypeScript/JavaScript implementation of the RDF/JS data factory.
Language:TypeScript 10GitHub Action that exports Azure Data Factory resources to an ARM Template
Language:Shell 8- Dadela
GitHub Action that validates all of the Azure Data Factory resources in the Git repository
Language:Shell 7tangyiming / tangram
组件化拖拽式造数/自动化场景构建平台 low code paltform for scenario testing and data factory
Language:Java 6gupta-aayushkr / F1-Racing
The project aims to process Formula 1 racing data, create an automated data pipeline, and make the data available for presentation and analysis purposes.
Language:Python 5curie-data-factory / helm-charts
Helm Chart Repository
Language:Mustache 4This project contains scripts to extract metadata from DICOM files, NIFTI files and spreadsheets, and import them into a database.
Language:Python 4UngeheurenUngeziefer / learn_data_engineer
data engineering job preparing
Language:Jupyter Notebook 4MRI preprocessing pipeline
Language:MATLAB 3- Language:PowerShell 2
DAGs adapting the MRI preprocessing pipeline to Airflow
Language:Python 2- Language:Shell 2
paladique / Workshop-DataInAzure
Supplemental Guide to Data in Azure Lecture
Language:Jupyter Notebook 2waqarg2001 / Earthquake-ETL-Pipeline-DE
Utlised Azure services to orchestrate earthquake daily data pipeline from USGS, consisting of last 7 days of data. Data was transformed and loaded into Azure SQL database and finally Tableau dashboard was made.
Language:Python 2alexandremcastro / Data-Lakehouse-Azure
Este é um projeto pessoal que tem como objetivo de criar uma solução de Data Lakehouse na plataforma de nuvem da Microsoft Azure, utilizando a ferramenta Azure Data Factory, seguindo a medallion architecture (Bronze, Silver, Gold) para armazenar dados do NNDSS do órgão CDC.
- Language:C# 1
egoliveira1 / NYC-payroll-project
Create high-quality data pipelines using Azure
- Language:Jupyter Notebook 1
- Language:Go 1
jperod / data_factory
Data Engineering Module Inspired on Azure Data Factory for Pipeline orchestration of Data
Language:Python 1Tchimwa / Private-Endpoint-with-Azure-Data-Factory
Enabling Private Endpoint on Azure Data Factory with different DNS scenarios.
Language:Bicep 1
