Skip to main content
waffle.svg
Domo Knowledge Base

AWS Data Exchange V2 Connector

Version 3

 

Intro

AWS Data Exchange makes it easy to find, subscribe to, and use third-party data in the cloud. You can access datasets from qualified data providers that include category-leading brands such as Reuters, who curate data from over 2.2 million unique news stories per year in multiple languages; Change Healthcare, who process and anonymize more than 14 billion healthcare transactions and $1 trillion in claims annually; Dun & Bradstreet, who maintain a database of more than 330 million global business records; and Foursquare, whose location data is derived from 220 million unique consumers and includes more than 60 million global commercial venues. Use Domo's Data Exchange Connector to import data into Domo from your Amazon S3 bucket. With the powerful datasets from AWS combined with the ability to visualize and create business solutions in Domo, you can create high-value solutions by combining your own data with external datasets. This connector lists only the AWS Data Exchange datasets that you've subscribed to and approved. To learn more about the Amazon S3 API, visit their page (http://docs.aws.amazon.com/AmazonS3/...I/Welcome.html).

You connect to your AWS Data Exchange V2 account in the Data Center. This topic discusses the fields and menus that are specific to the AWS Data Exchange V2 connector user interface. General information for adding DataSets, setting update schedules, and editing DataSet information is discussed in Adding a DataSet Using a Data Connector.

Primary Use Cases

This connector is an excellent choice for retrieving flat files when APIs are not an option.

Primary Metrics

N/A

Primary Company Roles

  • Data specialists
  • Marketing roles
  • Finance roles
  • Anyone who has data stored in S3

Average Implementation Time

Less than an hour if you have the correct file types in S3.

Ease of Use (on a 1-to-10 scale with 1 being easiest)

4

Best Practices

Understanding the data stored in S3 and its relation to other S3 databases will be a huge asset in using this connector.

Prerequisites

To connect to your AWS Data Exchange V2 account and create a DataSet, you must have the following:

  • Your AWS access key. You can find this in the Security Credentials section of the AWS Console. Alternatively, if you are using IAM, you can find it under Users.

  • Your AWS secret key, which was provided when you created your access key. You can generate a new secret key in the AWS Console.

  • The name of the AWS S3 Bucket you want to retrieve files from.

Your AWS Access Key and Secret Key should also have AWS Data Exchange Full access.

Creating a User with the Proper Permissions

You must create a user with the proper permissions in the IAM Amazon Console before you can connect to S3 data in Domo.

To configure your user:

1. In the Identity and Access Management Amazon Console, click Users.

screen1.png

2. Click on the Add User button.

screen2.png

3. Add a new user, setting options as follows:

  1. In the Details pane, check the box for Programmatic Access under Select AWS access type.

  b. In the Permissions pane, select Attach existing policies directly, then check the box for either AmazonS3FullAccess or AmazonS3ReadOnlyAccess.
Customer-managed policies do not work.

Set Permissions.png

  c. Click Next: Tags button to add tags. Adding tags is optional.  

  d. In the Review pane, click Create User.

4.  Once your user is created, copy the access and secret keys to use in the Credentials pane in Domo.

Connecting to Your AWS Data Exchange V2 Account

This section enumerates the options in the  Credentials  and  Details  panes in the AWS Data Exchange V2 Connector page. The components of the other panes in this page, Scheduling and Name & Describe Your DataSet, are universal across most connector types and are discussed in greater length in Adding a DataSet Using a Data Connector.

Credentials Pane

This pane contains fields for entering credentials to connect to your AWS Data Exchange V2 account. The following table describes what is needed for each field:  

Field

Description

Access Key Enter your AWS access key. For information about finding your access key, see Prerequisites above.
Secret Key Enter your AWS secret key. For information about finding your secret key, see Prerequisites above.
Bucket Enter the AWS S3 Bucket you want to pull files from.
Region Select the region where your AWS S3 bucket is located.

Once you have entered valid AWS Data Exchange V2 credentials, you can use the same account any time you go to create a new AWS Data Exchange V2     DataSet. You can manage connector accounts in the Accounts tab in the Data Center. For more information about this tab, see Managing User Accounts for Connectors.

Details Pane

This pane lists the AWS Data Exchange datasets.

Menu

Description

List Data Sets Select the datasets. This connector lists only the AWS Data Exchange datasets that you've subscribed to and approved.

Other Panes

For information about the remaining sections of the connector interface, including how to configure scheduling, retry, and update options, see Adding a DataSet Using a Data Connector.