Databricks

Overview

This article explains how to connect a Databricks database to Preset.

Allowlist Preset IPs

Preset Cloud runs on four regions. For Preset to access your data, first thing you need to do is to add region based Preset IP addresses to your Inbound and Outbound firewall rules.

If you are not sure where your Preset workspace is located, you can refer to the URL on your browser when accessing Preset. It should look like this: https://xxxxxxxx.us2a.app.preset.io/superset..., where us2a means it is in us-east-1.

Retrieve Databricks Information

Step 1: Get Databricks Token

In Databricks, navigate to User Settings → Access Tokens → Generate New Token.

Step 2: Get Host and URL

Navigate to Clusters and select your cluster.

...then copy and save:

• Server Hostname
• Port
• HTTP Path

Connect with the Databricks Connector

Let's start by selecting + Database — have a look at Connecting your Data if you need help wth this step.

Select Databricks.

Fill the form with information from the Databricks cluster:

• Host with the Server Hostname
• Port with the Port
• Database name with the name of the database to be connected
• Access Token with the generated token
• HTTP Path with the HTTP Path
• Display Name with the name to be used on Preset for this connection

Click on Connect to create the connection.

Configure default Catalog and Schema

The connection would use the default Catalog and Schema specified on your Databricks settings. However, you can set a different Catalog or Schema to be used as default on Preset on the Advanced Settings:

1. Navigate to Settings > Database Connections to access the list of existing connections on your Workspace.
2. Hover the mouse over your Databricks connection and click on the pencil icon under the Actions column to modify it.
3. Navigate to the ADVANCED tab, and expand the Other section.
4. You should find a JSON on the ENGINE PARAMETERS configuration similar to this one:

{
    "connect_args":
    {
        "http_path": "{{Your HTTP Path}}"
    }
}

5. Specify the default Catalog and Schema that should be used on the connection_args:

{
    "connect_args":
    {
        "http_path": "{{Your HTTP Path}}",
        "catalog": "{{Catalog Name}}",
        "schema": "{{Schema Name}}"
    }
}

6. Save changes.

You can also query data from different catalogs on the SQL lab, using below structure:

SELECT * FROM {{Catalog_Name}}.{{Schema_Name}}.{{Table_Name}}