adisaljusi / databricks-delta-lakehouse-example

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Azure Databricks Delta Lakehouse

Infrastructure Deployment

Known Limitations - Caveats - Issues

Only account admin can create metastores.

When deploying a Databricks Metastore for the first time, an error messages will appear.

│ Error: cannot create metastore data access: Only account admins can create Azure Managed Identity Storage Credentials.
│ 
│   with databricks_metastore_data_access.primary,
│   on unity_catalog.tf line 19, in resource "databricks_metastore_data_access" "primary":
│   19: resource "databricks_metastore_data_access" "primary" {
│ 

Sadly, this issue as of writing, can be remediated with an automated deployment. A user with Azure Active Directory Global Administrator permissions, has to sign into the Azure Databricks account cosnsole for the first time. Only then, are you able deploy metastore unity Databricks metastore.

This requirement is described in this documentation https://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/get-started#requirements

Only account admins can craete Azure Managed Identity Storage Credentials

Similarly to "Only account admins can create metastores a error message will appear. At the time of writing this I could not find a official solution that succesfully resolves the issue. My assumption is that this relate to the metastore provisioning not being able to capture the changes at the time of creation. By rerunning the Terraform plan, the issue was resolved, but it leaves out open questions. Tt may certainly be the case that the metastore assignment needs to wait for a few seconds, until the databricks_metastore_data_access can be provisioned.

╷
│ Error: cannot create metastore data access: Only account admins can create Azure Managed Identity Storage Credentials.
│ 
│   with databricks_metastore_data_access.primary,
│   on unity_catalog.tf line 19, in resource "databricks_metastore_data_access" "primary":
│   19: resource "databricks_metastore_data_access" "primary" {
│ 

About


Languages

Language:Jupyter Notebook 99.8%Language:HCL 0.1%Language:Python 0.1%Language:PowerShell 0.0%