Skip to main content
waffle.svg
Domo Knowledge Base

Microsoft Azure Data Lake Store Connector

Version 3

 

Intro

Azure Data Lake Store is an enterprise-wide hyper-scale repository for big data analytic workloads. Use this connector to pull data files from your Data Lake Store into Domo. You can retrieve data files in any of the following file types: CSV, XLS, XLSX and JSON. For more information about Azure's API, see https://docs.microsoft.com/en-us/azu...ta-lake-store/

You connect to your Microsoft Azure Data Lake Store account in the Data Center. This topic discusses the fields and menus that are specific to the Microsoft Azure Data Lake Store connector user interface. General information for adding DataSets, setting update schedules, and editing DataSet information is discussed in Adding a DataSet Using a Data Connector.

Prerequisites

To connect to your Microsoft Azure Data Lake Store account and create a DataSet, you must have the following:

  • Your Microsoft Azure Data Lake Store tenant ID

  • Your Microsoft Azure Data Lake Store client ID

  • Your Microsoft Azure Data Lake Store client secret

To obtain credentials, please reach out to your Microsoft account representative. 

Connecting to Your Microsoft Azure Data Lake Store Account

This section enumerates the options in the Credentials and Details panes in the Microsoft Azure Data Lake Store Connector page. The components of the other panes in this page, Scheduling and Name & Describe Your DataSet, are universal across most connector types and are discussed in greater length in Adding a DataSet Using a Data Connector.

Credentials Pane

This pane contains fields for entering credentials to connect to your Microsoft Azure Data Lake Store account. The following table describes what is needed for each field:  

Field

Description

Tenant ID

Enter your Microsoft Azure Data Lake Store tenant ID.

Client ID

Enter your Microsoft Azure Data Lake Store client ID.

Client Secret

Enter your Microsoft Azure Data Lake Store client secret.

Account FQDN

Enter the fully-qualified domain name of your Azure Data Lake Store account. For example: mycompany.azuredatalakestore.net

Once you have entered valid Microsoft Azure Data Lake Store credentials, you can use the same account any time you go to create a new Microsoft Azure Data Lake Store DataSet. You can manage connector accounts in the Accounts tab in the Data Center. For more information about this tab, see Managing User Accounts for Connectors.

Details Pane

This pane contains a primary Reports menu, along with various other menus which may or may not appear depending on the report type you select.

Menu

Description

Report

Select the Microsoft Azure Data Lake Store report you want to run. The following reports are available:

ACL Status

Returns the ACL status for a given file or directory.

Content Summary

Returns a content summary for a given file or directory.

Directory/File Information

Retrieves the metadata for a given file or directory.

Download File

Imports the content of a selected file into a Domo DataSet.

Directory Path

Enter the directory path of the file you want to import into Domo.

Path

Enter the complete path of the file or directory you want to retrieve information for. For example: /test/abc.csv

How Would You Like to Choose Your File Name?

Select how you want to choose the file you intend to import into Domo. Select Files Discovery to choose your file from a list of files. Select Enter File Name to enter the name yourself.

Select File

Select the file you want to import into Domo.

File Name

Enter the name of the file you want to import into Domo.

File Format

Select the format of the file you want to import. Options include CSV, XLS, XLSX, and JSON. 

Delimiter 

Select the delimiter to use to parse your CSV file. To choose a custom delimiter, select Other, then enter your delimiter in the Custom Delimiter field.

Custom Delimiter

Enter the custom delimiter you want to use to parse your CSV file. Enter tab or Unicode characters in \uxxxx form (e.g. \u005e). 

Quote Character

Select the desired quote character for parsing your CSV file. (A double quote is the CSV standard.) To choose a custom quote character, select Other, then enter your quote character in the Custom Quote Character field. 

Custom Quote Character

Enter the custom quote character you want to use to parse your CSV file. Enter tab or Unicode characters in \uxxxx form (e.g. \u005e).

Escape Character

Select the escape character to use to parse your CSV file. To choose a custom escape character, select Other, then enter your delimiter in the Custom Escape Character field.

Header Start Row (Optional)

Enter the header start row for your Excel file. 

Data Start Row (Optional)

Enter the data start row for your Excel file. 

Footer Rows to Skip (Optional)

Enter the number of rows to skip at the end of your Excel file, if any. 

Sheet Name (Optional)

If your Excel file contains more than one sheet, enter the name of the sheet you want to import. Be sure to check the sheet name for accidental spaces. If this field is left blank, the first sheet of the workbook will be used. 

Data Field Key (Optional)

Enter the data field key for the JSON file you want to import.

Sublist to Flatten (Optional)

Enter the lists you want to flatten in your data. Separate multiple lists with commas.

Other Panes

For information about the remaining sections of the connector interface, including how to configure scheduling, retry, and update options, see Adding a DataSet Using a Data Connector.