Azure Data Lake Storage Gen2 Using AAD WriteBack Connector

Intro

Azure Data Lake is a suite of cloud-based services designed to store, manage, and analyze massive amounts of data in any format. Azure Data Lake Storage Gen2 is a highly scalable data lake solution built on Azure Storage. It enables organizations to manage large volumes of data efficiently and provides an optimized platform for building enterprise data lakes on Azure. It also helps accelerate the transition from proof of concept to production environments.

You can connect to your Azure Data Lake Storage Gen2 Using AAD WriteBack Connector account in the Data Center. This topic discusses the fields and menus specific to the Azure Data Lake Storage Gen2 Using AAD WriteBack Connector connector user interface. To add DataSets, set update schedules, and edit DataSet information, see Adding a DataSet Using a Connector.

Prerequisites

To connect to your Azure Data Lake Storage Gen2 Using AAD WriteBack Connector account and create a DataSet, you must have the following:

The below parameters are needed to locate your data and the user details who is allowed to access.

• Azure Application Client ID: This is the username for your application. Identifies the service or application connecting to the Azure Data Lake.
• Azure Application Client Secret: This is the password for your application. The Client Secret proves that the application is authorized to connect.
• Tenant ID: Uniquely identifies your specific instance of Microsoft Entra ID (formerly Azure AD).
• Account Name: The unique name of your Storage Account in Azure.
• Container: A folder or files system created within the storage account.

The Account Name and Container identifies the storage resource, while Tenant ID, Azure Application Client ID, and Azure Application Client Secret are used for secure authentication.

Get an Azure App Client ID

To generate the Azure Application Client ID, follow the below steps:

1. Sign in to the Microsoft Azure portal.
2. Go to Microsoft Entra ID > App registrations.
3. Select the app registration you want to use.
4. On the Overview page, copy the value in Application (client) ID.

Get the Azure App Client Secret

Use these steps to view an existing client secret or create a new one.

1. Sign in to the Microsoft Azure portal.
2. Go to Microsoft Entra ID > App registrations.
3. Select the app registration you want to use.
4. Under Manage, select Certificates & secrets.
5. To create a new secret, under Client secrets, select New client secret, configure the options, and then select Add.
6. Copy the secret Value and save it in a secure location.

Important: The secret value is shown only once, when you create it. If you don’t save it, you can’t retrieve it later, and you must create a new client secret.

Get the Microsoft Entra Tenant ID

Use these steps to find your Microsoft tenant ID (directory ID).

1. Sign in to the Microsoft Entra admin center.
2. Select Microsoft Entra ID.
3. On the Overview page, copy the Tenant ID.

If you’re working with an app integration, you can also find the tenant ID in the app registration:

1. In Microsoft Entra ID, select App registrations.
2. Select your app.
3. On the Overview page, copy the Directory (tenant) ID.

Get the Azure Data Lake Storage Gen2 Account Name

1. Sign in to the Microsoft Azure portal.
2. Go to Storage accounts.
3. Select the storage account that has Data Lake Storage Gen2 enabled.
4. On the Overview page, copy the Storage account name.

You can use this value as the Azure Data Lake Storage Gen2 account name for integrations and connectivity.

Get the Container Name

A container is a folder-like storage space in an Azure Data Lake Storage Gen2 account that you use to organize and store data.

1. Sign in to the Microsoft Azure portal.
2. Open the storage account you want to use.
3. Under Data storage, select Containers.
4. From the list, select the container and copy its name.

Connecting to Your Azure Data Lake Storage Gen2 Using AAD WriteBack Connector Account

This section enumerates the options in the Credentials and Details panes on the Azure Data Lake Storage Gen2 Using AAD WriteBack Connector Connector page. The components of the other panes in this page, Scheduling and Name & Describe Your DataSet, are universal across most connector types and are discussed in great detail in Adding a DataSet Using a Connector.

Credentials Pane

This pane contains fields for entering credentials to connect to your Azure Data Lake Storage Gen2 Using AAD WriteBack Connector account. The following table describes what is needed for each field:

Field	Description
Azure Application Client ID	Enter the client ID (GUID: Globally Unique Identifier) of the client web app obtained from Azure Active Directory configuration.
Azure Application Client Secret	Enter the secret key of the client web app.
Tenant ID	Enter your Tenant ID. To obtain the Tenant ID follow the below steps: 1.Navigate to the Azure portal (www.azure.com). 2.Select Azure Active Directory > Properties. The Directory ID is your Tenant ID.
Account Name	Enter your storage account name.
Container	Enter your container name.

Once you have entered valid Azure Data Lake Storage Gen2 Using AAD WriteBack Connector credentials, you can use the same account any time you go to create a new Azure Data Lake Storage Gen2 Using AAD WriteBack Connector DataSet. You can manage connector accounts in the Accounts tab in the Data Center. For more information about this tab, see Manage Connector Accounts.

Details Pane

This pane contains a primary Reports menu, along with various other menus which may or may not appear depending on the report type you select.

Field	Description
How would you like to choose the directory name?	Select how you want to choose the directory name.
Discover Directory Name	Select the directory name.
Enter Directory Name	Enter the directory name. Field Name Description test Example for main or root directory test/test Example for sub directory test/test/test Example for sub-sub-directory
Input DataSet Id	Enter your Domo DataSet ID (GUID) from the DataSet URL. Example: https://customer.domo.com/datasources/aaaaaaaa-bbbb-cccc-dddd-eeeeeeeeeeee/details/settings
Select filename	Choose whether to use the DataSet GUID or enter a filename manually.
FileName	Enter the output file name.
My Domo Input DataSet is very large	Select this option when exporting a large DataSet from Domo to Azure Data Lake. The connector uses a faster process when this option is enabled.

Other Panes

For information about the remaining sections of the connector interface, including how to configure scheduling, retry, and update options, see Adding a DataSet Using a Connector.