mutazag / adf

Azure Data Factory repo

• 1. Prep
• 2. ADF
  • 2.1. validate pipeline
  • 2.2. build arm templates
  • 2.3. Using Custom Paramater and ARM deployment

1. Prep

in nodejs console, run

npm install

this will require the file package.json to be present in the same folder, with the following content:

{
    "scripts": {
        "build": "node node_modules/@microsoft/azure-data-factory-utilities/lib/index"
    },
    "dependencies": {
        "@microsoft/azure-data-factory-utilities": "^0.1.5"
    }
}

the installation will create a folder named node_modules, add this folder to the .gitignore file if not already done.

2. ADF

2.1. validate pipeline

-- below are ok

npm run build validate c:\git\adf /subscriptions/<Subscription ID>/resourceGroups/datafactorydev/providers/Microsoft.DataFactory/factories/<ADF Name>

2.2. build arm templates

before: no need yet to: ---Install-Module Az.DataFactory -Force -AllowClobber

needed to create arm-template-parameters-definition.json, param syntax in this url link: https://docs.microsoft.com/en-us/azure/data-factory/continuous-integration-deployment#custom-parameter-syntax

npm run build export c:\git\adf /subscriptions/<Subscription ID>/resourceGroups/datafactorydev/providers/Microsoft.DataFactory/factories/<ADF Name> "ArmTemplate"

Using . as the path for local folder will produce an ARM template with a blank data factory.

Must inclose the resource identified in double qoutes " " when running the command in bash

2.3. Using Custom Paramater and ARM deployment

Arm templates custom paramaters usage: https://docs.microsoft.com/en-us/azure/data-factory/continuous-integration-deployment#triggers

Explaination in stackoverflow: https://stackoverflow.com/questions/67666564/adf-pipeline-trigger-deployment-on-devops/67667011#67667011