azure-data-factory

There are 10 repositories under azure-data-factory topic.

• Azure-Player / azure.datafactory.tools

  Tools for deploying Data Factory (v2) in Microsoft Azure

  azure-data-factoryadftoolspublishdata-factoryci-cdcicddeploydeploymentdevopspowershell-module
  Language:PowerShell 203

• microsoft / MCW-Big-data-analytics-and-visualization

  MCW Big data analytics and visualization

  machine-learningazure-data-factoryhdinsightspark-sqldatabase-administratorpower-bi
  Language:JavaScript 189

• furmangg / automating-azure-analysis-services

  Code samples for a SQL Saturday presentation on the topic of Automating Azure Analysis Services

  azure-analysis-servicesazure-analysisservicesazure-data-factoryssis
  Language:JavaScript 66

• microsoft / data-factory-testing-framework

  A stand-alone test framework that allows to write unit tests for Data Factory pipelines on Microsoft Fabric and Azure Data Factory.

  azure-data-factoryfunctional-testsmicrosoft-fabrictesting-frameworkunit-testsdata-factoryfabrictest
  Language:Python 64
• AzureDataFactoryHOL

  Mmodarre / AzureDataFactoryHOL

  Azure Data Factory Hands On Lab - Step by Step - A Comprehensive Azure Data Factory and Mapping Data Flow step by step tutorial

  azure-data-factoryazureadf-pipelinefilter-activitylookup-activityforeach-activitymetadata-activitymapping-dataflowsazure-key-vaultetl-pipelinehands-on-labhands-on-azure-data-factoryazure-data-factory-tutorialazure-modern-data-warehousweb-activityforeach-loop-activity
  64

• Jayvardhan-Reddy / Azure-Certification-DP-200

  Road to Azure Data Engineer Part-I: DP-200 - Implementing an Azure Data Solution

  azurecertification-prepazure-certificationresourcesdp-200data-engineeringdata-engineerazure-storageazure-servicesdata-storagedata-lakeazure-portalsql-dwazure-databricksazure-data-factoryazure-cosmos-dbpolybaseexam-prepmicrosoft-azurebatch-processing
  63

• justBlindbaek / PowerBIMonitor

  A complete solution to extract the Power BI audit log, Power BI tenant metadata and Microsoft Graph data. Using Azure Data Factory or Integration Pipelines in Azure Synapse Analytics

  power-biazure-data-factorysynapse-analytics
  Language:TSQL 55

• tomaztk / Azure-Databricks

  Azure Databricks - Advent of 2020 Blogposts

  pythonnotebooksnotebookdatabricksdatabricks-notebooksr-languagesparksqlazure-databricksdata-analyticsazure-data-factoryscalapysparksparkrspark-structured-streamingdata-engineergmachine-learningmllibmlflowazure-machine-learnning
  Language:Jupyter Notebook 54

• justBlindbaek / TraditionalModernDW

  Simple cloud only DWH solution architecture.

  architecturepowerbiazure-sql-databaseazure-data-factoryazure-data-lake
  Language:TSQL 38

• AdamPaternostro / Azure-Data-Factory-CI-CD-Source-Control

  How do to CI/CD with Azure Data Factory

  azure-data-factoryazure-data-factory-tudevopsci-cd
  Language:PowerShell 37

• rlevchenko / terraform-azure-data

  Terraform script to deploy almost all Azure Data Services

  servicebusdatalakedatafactoryeventhubdatabricksazurefunctionsazuredataexplorerkustoazureanalysisservereventgridazure-data-factoryazure-resourcesdata-lake-storageazurelrs
  Language:HCL 36

• liprec / vsts-publish-adf

  This extension adds Azure Data Factory release tasks to Azure Pipelines.

  azure-data-factoryazure-devopsazure-pipelines
  Language:PowerShell 28

• AnalyticJeremy / ADF_BigQuery

  How to authenticate to Google Big Query when connecting from Azure Data Factory v2

  google-bigqueryazure-data-factoryadfoauth2
  Language:PowerShell 26

• gbrueckl / Azure.DataFactory.LocalEnvironment

  This code allows you to load any existing Azure Data Factory project file (*.dfproj) and perform further actions like "Export to ARM Template" or to debug custom C# activities

  azure-data-factoryazure-armarm-templatesadf
  Language:C# 26

• Jayvardhan-Reddy / Azure-Certification-DP-201

  Road to Azure Data Engineer Part-II: DP-201 - Designing an Azure Data Solution

  azureazure-certificationazure-certsresourcesdp-201data-engineeringdata-engineermicrosoft-azuredesignazure-storageazure-securityazure-data-solutionazure-active-directoryazure-data-factoryazure-data-lakeazure-data-warehouseazure-cosmos-dbazure-stream-analyticsbatch-processingstream-processing
  18

• AnthonyByansi / Azure-Data-Fundamentals-Guide

  A comprehensive guide to understanding and implementing data management and analytics solutions in the Azure ecosystem using Azure Data Fundamentals.

  azureazure-active-directoryazure-data-factoryazure-data-lakeazure-data-studioazure-databaseazure-databricksazure-synapse-analytics
  Language:Mermaid 16

• areed1192 / trading-system

  A python application that leverages Microsoft Azure to build a fully functional trading system.

  azurepythontd-ameritrade-apiiex-apiazure-data-factoryazure-blob-storageazure-sqlazure-rbacazure-key-vault
  Language:Python 13
• AZURE_SYNAPSE_AND_SAP_SFLIGHT_DEMO

  ROBROICH / AZURE_SYNAPSE_AND_SAP_SFLIGHT_DEMO

  Azure Synapse and SAP SFLIGHT demo application integration scenario

  sap-dataazure-synapsesap-erpsap-tableazure-data-factory
  13

• fabioms-br / azure-data-factory

  Aprender Gerencimento de Dados ETL/ELT

  dataazureazure-data-factorycloud-computingdata-analysisdata-extractiondata-miningdata-structuresdatabasedatasetetletl-pipelinelinked-services
  12

• furmangg / automating-azure-sql-dw

  Code samples for an Ignite conference presentation on the topic of Automating Azure SQL Data Warehouse

  azure-sql-datawarehouseazure-data-factoryazure-automationazure-automation-runbooksazure-cliazure-key-vaultazure-keyvaultazure-analysis-servicesazure-analysisservicesazure-blob-storagekey-rotation
  Language:PowerShell 11

• MSBrett / ccm_datafactory

  An example of how to use Azure Data Factory to retrieve usage data from the Azure Management API and store the results in Azure Data Lake.

  azure-data-factoryazure-resource-templatescost-management
  Language:PowerShell 11

• airscholar / FootballDataEngineering

  An end-to-end data engineering pipeline that fetches data from Wikipedia, cleans and transforms it with Apache Airflow and saves it on Azure Data Lake. Other processing takes place on Azure Data Factory, Azure Synapse and Tableau.

  apache-airflowazure-data-factoryazure-data-lake-gen2azure-databricksazure-synapse-analyticsdata-engineeringdataengineering
  Language:Python 10

• dataplat / AzureDataPipelineTools

  A collection of Azure Function to make building Azure Data Factory pipeline simpler and easier.

  azure-data-factoryazure-functionsazure-data-lakeazuredata-engineering
  Language:C# 10

• fvarga01 / Azure-Talking-Points

  Annotated Microsoft Azure documentation links used throughout day to day technical conversations.

  azurenewsletterazure-sqlazure-synapse-analyticsazure-data-factoryazure-logic-appsgenomicshealthcare
  10

• AdamPaternostro / Azure-App-Insights-Distrubuted-Tracing

  How to use Application Insights to do distributed tracing through a Web App, REST API, Function App, Service Bus, Databricks and Data Factory.

  azureapplication-insightsdatabricksazure-functionsservice-busazure-data-factorymonitoring
  Language:C# 9

• wilson-mok / demo

  In this repository, you will find varies demo and presentations I have delivered throughout the year. This includes the link to the video, the source codes and the data files.

  azuredata-analysisazure-data-factoryazure-synapse-analyticsdata-engineeringdatabricks
  Language:Jupyter Notebook 9

• AdamPaternostro / Azure-Big-Data-and-Machine-Learning-Architecture

  A ready to use architecture for processing data and performing machine learning in Azure

  azurebig-dataazure-data-lakeazure-data-factoryml-ops
  Language:C# 8

• Jcardif / SerengetiDataLab

  An E2E solution of the Data Resources on Azure using the Snapshot Serengeti dataset. This E2E solution focuses Azure Synapse Analytics, Power Bi & the Azure Data Factory.

  azure-dataazure-data-factoryazure-data-lakeazure-mlazure-sqlazure-storageazure-synapse-analyticsmicrosoft-purviewpower-bisynapse-analytics
  Language:Bicep 8

• bennyaustin / synapse-dataplatform

  A modern data platform implemented on Azure Synapse Analytics using ELT Framework - https://github.com/bennyaustin/elt-framework. Data platform infrastructure provisioned using https://github.com/bennyaustin/iac-synapse-dataplatform

  pysparkmssparkutilsazure-data-factoryazure-databricksazure-devops-pipelinesazure-synapse-analyticsazure-synapse-pipelinesazure-synapse-serverless-sqlelt-frameworkelt-pipelinegithub-actions
  Language:TSQL 6

• jomit / iot-central

  Sample code + scripts to develop Azure IoT Central Solutions

  iotazure-iot-centralopc-daazure-data-factoryazure-functionspowerbiazure-sql-serverrslinxopcserver
  Language:C# 6

• tomkerkhove / gdpr-with-azure

  Scenarios on how you can be GDPR compliant by using Azure services

  azureazure-data-factoryazure-data-lakeazure-logicapps
  Language:C# 6

• chayansraj / Microsoft-Azure-Medallion-Data-pipeline

  In this project we are going to create an end-to-end data platform right from Data Ingestion, Data Transformation, Data Loading and Reporting.

  analyticsazureazure-data-factoryazure-databricksazure-storageazure-synapse-analyticsbig-datacloudcloud-computingdata-engineeringdata-sciencedata-visualizationdatabasedataingestionetl-pipelinemysqlpowerbisparksql
  Language:Jupyter Notebook 5

• PujitH-V / ETL_with_Pyspark_-_SparkSQL

  A sample project designed to demonstrate ETL process using Pyspark & Spark SQL API in Apache Spark.

  azureazure-data-factoryazure-databricks
  Language:HTML 5

• using-system / ProcessMyMedia

  Build your Azure Media Services workflow in .NET Core

  azure-media-servicesazuredotnet-coredotnet-core2azure-data-factoryazure-storage
  Language:C# 5
• demo-mdwh

  aessing / demo-mdwh

  Modern Dataware House Demos with Azure Databricks, Azure Data Factory & Azure Dedicated SQL pool (formerly SQL DW)

  azure-databricksazuredatabricksdatabricks-notebookssparkdelta-lakedatadata-engineeringdata-sciencemachine-learningmletlmodern-data-warehousedemosmdwhdatawarehousedatawarehousingdatafactoryazure-data-factorydatalake
  4

• marc-jellinek / AzureDataFactoryDemo_GenericSqlSink

  Throwing Mud on the Wall - Instant ELT using Azure Data Factory

  azure-data-factoryetlelt
  Language:TSQL 4