The Issue:
When attempting to create a Connection for an Azure account, you receive the following error message:
ADLS_02 - Failed to connect to Azure Data Lake Store: ‘Operation failed: “An HTTP header that’s mandatory for this request is not specified”,400,PUT, <URL>
The Solution:
This error could potentially indicate that the Connection type set in Control Hub and the Azure account type do not match. When using a Data Collector version that is higher than 5.4, you are presented with a number of options when creating a new connection to Azure. These options include:
- Azure Blob Storage
- Azure Data Lake Storage Gen2
- Azure Synapse
When this error is encountered, before troubleshooting further it is important to first check that the connection type that was chosen here matches the Azure Account type you are connecting to. This can be verified by checking the Azure Account FQDN. For example:
An FQDN like example.dfs.core.windows.net would be used for an Azure Data Lake Storage Gen2 connection.
An FQDN like example.blob.core.windows.net would be used for an Azure Blob Storage Connection.
If these do not match, this is likely the cause for the error.