How to resolve New-AzResourceGroupDeployment: - The deployment 'DataBricksDeployment' failed with error(s). Showing 1 out of 1 error(s). Status Message: The definition of application 'Databricks25' cannot be null. (Code:InvalidApplicationDefi

Question

How to resolve New-AzResourceGroupDeployment: - The deployment 'DataBricksDeployment' failed with error(s). Showing 1 out of 1 error(s). Status Message: The definition of application 'Databricks25' cannot be null. (Code:InvalidApplicationDefi

Tsholofelo Mautla 26

God day

Does anyone know what could be causing this error.

New-AzResourceGroupDeployment: 10:06:59 - The deployment 'DataBricksDeployment' failed with error(s). Showing 1 out of 1 error(s).

Status Message: The definition of application 'DatabricksTM0825' cannot be null. (Code:InvalidApplicationDefinition)

        {
            "type": "Microsoft.Databricks/workspaces",
            "apiVersion": "2024-05-01",
            "name": "[parameters('workspaceName')]",
            "location": "[resourceGroup().location]",
            "sku": {
                "name": "Premium"
            },
            "properties": {
                "accessConnector": {
                    "id": "/subscriptions/subscriptionID/resourceGroups/RGName/providers/Microsoft.Databricks/accessConnectors/DatabricksAccessConnector",
                    "identityType": "SystemAssigned"
                },
                "authorizations": [
                    {
                    "principalId": "string",
                    "roleDefinitionId": "string"
                    }             
                ],
                "createdBy": {"TM": "TM"},
                "defaultCatalog": {
                    "initialName": "[parameters('DefaultCatalogName')]",
                    "initialType": "UnityCatalog"
                },
                "defaultStorageFirewall": "Enabled",
                "encryption": {
                    "entities": {
                        "managedDisk": {
                            "keySource": "Microsoft.Keyvault",
                            "keyVaultProperties": {
                                "keyName": "[parameters('DiskKeyName')]",
                                "keyVaultUri": "[parameters('ManagedDiskkeyVaultUri')]",
                                "keyVersion": "[parameters('KeyVersion')]"
                            },
                            "rotationToLatestKeyVersionEnabled": true
                        },
                        "managedServices": {
                            "keySource": "Microsoft.Keyvault",
                            "keyVaultProperties": {
                                "keyName": "[parameters('KeyName')]",
                                "keyVaultUri": "[parameters('customerManagedKeyVaultUri')]",
                                "keyVersion": "[parameters('KeyVersion')]"
                            }
                        }
                    }
                },
                "enhancedSecurityCompliance": {
                    "automaticClusterUpdate": {
                        "value": "Enabled"
                    },
                    "complianceSecurityProfile": {
                        "value": "Enabled",
                        "ComplianceStandards":[
                        "none"
                    ]

                    },
                    
                    "enhancedSecurityMonitoring": {
                        "value": "Enabled"
                    }
                },
                "managedDiskIdentity": {
                    "value": "Enabled"
                },
                "managedResourceGroupId": "[concat('subscriptions/', subscription().subscriptionId, '/resourceGroups/',  parameters('managedResourceGroupId'))]",
                "parameters": {
                    "amlWorkspaceId": {
                        "value": "[concat('subscriptions/', subscription().subscriptionId, '/resourceGroups/', resourceGroup().name, '/providers/Microsoft.MachineLearningServices/workspaces/', parameters('amlWorkspaceId'))]"
                    },
                    "customPrivateSubnetName": {
                        "value": "[parameters('privateSubnetName')]"
                    },
                    "PrivateSubnetPrefix":  {
                        "value": "[parameters('privateSubnetPrefix')]"
                    },
                    "publicSubnetPrefix": {
                        "value": "[parameters('PublicSubnetPrefix')]"

                    },
                    "customPublicSubnetName": {
                        "value": "[parameters('PublicSubnetName')]"
                    },
                    "customVirtualNetworkId": {
                        "value": "[concat('subscriptions/', subscription().subscriptionId, '/resourceGroups/', resourceGroup().name, '/Microsoft.Network/virtualNetworks/', parameters('VnetId'))]"
                    },
                    "enableNoPublicIp": {
                        "value": true
                    },
                    "encryption": {
                        "value": {
                            "KeyName": "[parameters('KeyName')]",
                            "keySource": "Microsoft.Keyvault",
                            "keyvaulturi": "[parameters('keyVaultUri')]",
                            "keyversion": "[parameters('KeyVersion')]"
                        }
                    },
                    // "loadBalancerBackendPoolName": {
                    //     "value": "[parameters('loadBalancerBackendPoolName')]"
                    // },
                    // "loadBalancerId": {
                    //     "value": "[concat('subscriptions/', subscription().subscriptionId, '/resourceGroups/', resourceGroup().name, '/Microsoft.Network/loadBalancers/', parameters('amlWorkspaceId'))]"
                    // },
                    // "natGatewayName": {
                    //     "value": "[parameters('natGatewayName')]"
                    // },
                    "prepareEncryption": {
                        "value": true
                    },
                
                    // "publicIpName": {
                    //     "value": "[parameters('publicIpName')]"
                    // },
                    "requireInfrastructureEncryption": {
                        "value": true
                    },
                    "storageAccountName": {
                        "value": "[parameters('storageAccountName')]"
                    },
                    "storageAccountSkuName": {
                        "value": "[parameters('storageAccountSkuName')]"
                    },
                    "vnetAddressPrefix": {
                        "value": "[parameters('addressPrefix')]"
                    }
                },
                "publicNetworkAccess": "Disabled",
                "requiredNsgRules": "NoAzureDatabricksRules",
                "storageAccountIdentity": {
                    // "value": "bbmnmntm25jan"
                    "Id": "[concat('subscriptions/', subscription().subscriptionId, '/resourceGroups/', resourceGroup().name, '/Microsoft.ManagedIdentity/UserAssignedIdentities/', parameters('amlWorkspaceId'))]"
                 },
                "uiDefinitionUri": "https://myaccount.blob.core.windows.net/mycontainer/myblobcls",
                "updatedBy": {
                    "name": "TM"
                }
            },
            "managedBy": "[concat('subscriptions/', subscription().subscriptionId, '/resourceGroups/', resourceGroup().name, '/Microsoft.Databricks/workspaces/', parameters('workspaceName'))]",
            // "sku": {
            //     "name": "Premium",
            //     "tier": "Premium"
            // },
            "tags": {
                "{customized property}": "string"
            }
            
            
        },

KarishmaTiwari-MSFT 20,852 Reputation points Microsoft Employee Moderator

2025-01-14T18:30:24.2033333+00:00

Our team is looking into it and will get back shortly. Thanks.
Bhargava-MSFT 31,361 Reputation points Microsoft Employee Moderator

2025-01-14T19:43:57.08+00:00
Hello Tsholofelo Mautla,

From the error message, it seems like there might be a problem with the application definition or the way it is being referenced in the deployment template. The error suggests that something is null. Ensure that no required fields are left empty or null.

also please check the below and see if it helps.

Check the application definition for 'DatabricksTM0825' is correctly specified in your deployment template.

Make sure that all parameters used in the deployment template are correctly defined and passed.

Ensure that the accessConnector property is correctly configured with the appropriate id and identityType

Make sure the resource group and subscription are correctly specified and accessible for the deployment

Review encryption-related fields to ensure that all required values are provided and correctly referenced.

I hope this helps.
Bhargava-MSFT 31,361 Reputation points Microsoft Employee Moderator

2025-01-15T23:34:31.4266667+00:00

Hello Tsholofelo Mautla,

I am checking to see if you had a chance to look into my above response. Please let me know if you have any further questions. Thank you.
Bhargava-MSFT 31,361 Reputation points Microsoft Employee Moderator

2025-01-16T16:29:40.5133333+00:00

Hello Tsholofelo Mautla,

I am checking to see if you had a chance to look into my above response. Please let me know if you have any further questions. Thank you.

1 answer

Your answer

KarishmaTiwari-MSFT 20,852 Reputation points Microsoft Employee Moderator

2025-01-14T18:30:24.2033333+00:00

Our team is looking into it and will get back shortly. Thanks.
Bhargava-MSFT 31,361 Reputation points Microsoft Employee Moderator

2025-01-14T19:43:57.08+00:00

Hello Tsholofelo Mautla,

From the error message, it seems like there might be a problem with the application definition or the way it is being referenced in the deployment template. The error suggests that something is null. Ensure that no required fields are left empty or null.

also please check the below and see if it helps.

Check the application definition for 'DatabricksTM0825' is correctly specified in your deployment template.

Make sure that all parameters used in the deployment template are correctly defined and passed.

Ensure that the accessConnector property is correctly configured with the appropriate id and identityType

Make sure the resource group and subscription are correctly specified and accessible for the deployment

Review encryption-related fields to ensure that all required values are provided and correctly referenced.

I hope this helps.
Bhargava-MSFT 31,361 Reputation points Microsoft Employee Moderator

2025-01-15T23:34:31.4266667+00:00

Hello Tsholofelo Mautla,

I am checking to see if you had a chance to look into my above response. Please let me know if you have any further questions. Thank you.
Bhargava-MSFT 31,361 Reputation points Microsoft Employee Moderator

2025-01-16T16:29:40.5133333+00:00

Hello Tsholofelo Mautla,

I am checking to see if you had a chance to look into my above response. Please let me know if you have any further questions. Thank you.

Answer 1

I was also getting the same error. Earlier, I was passing the connector id from the resource itself.
But once I hardcoded its values, the error was gone.

Earlier code -

resource accessConnector 'Microsoft.Databricks/accessConnectors@2024-05-01' = {
  name: 'unity-catalog-access-connector'
  location: location
  identity: {
    type: 'SystemAssigned'
  }
}

module configurationStore 'br/XXCC:bicep/modules/dip/core/databricks:4.0.0' = if (!existingAdb){
  name: databricksName
  params: {
    name: databricksName
    customPrivateSubnetName: adbPrivateSubnetName
    dbstorage: dbstorage
    customPublicSubnetName: adbPublicSubnetName
    customVirtualNetworkId: customVirtualNetworkId
    managedResourceGroupName: managedResourceGroupName
    enableNoPublicIp: enableNoPublicIp
    additionalDatabricksProperties: {
      publicNetworkAccess: 'Disabled'
      requiredNsgRules: 'NoAzureDatabricksRules'
      defaultStorageFirewall: 'Enabled'
      accessConnector: {
        id: accessConnector.id
        identityType: 'SystemAssigned'
      }
    }
   }
}

Current code -

accessConnector: {
        id: '/subscriptions/*****/resourceGroups/****/
providers/Microsoft.Databricks/accessConnectors/unity-catalog-access-connector'

Share via

How to resolve New-AzResourceGroupDeployment: - The deployment 'DataBricksDeployment' failed with error(s). Showing 1 out of 1 error(s). Status Message: The definition of application 'Databricks25' cannot be null. (Code:InvalidApplicationDefi

1 answer

Your answer