Databricks Delta Sharing

For onboarding a new customer who has Databricks we need set of credentials and grants :

You can give Sundial Read-Only access to your existing Databricks Schemas and Tables.

Access should preferably be given by Delta Sharing

Initial setup includes the following steps:

1. Enable Delta Sharing for a Databricks account.

2. Enable Delta Sharing on a Unity Catalog metastore.

   1. Enable Delta Sharing for your account

   To use Delta Sharing to share data securely with external recipients, an account admin must enable the External Data Sharing feature group for your Databricks account.

   1. As a Databricks account admin, log in to the account console.
   2. In the sidebar, click Settings.
   3. Go to the Feature enablement tab.
   4. On the External Data Sharing Feature Group row, click the Enable button.

   Click the Terms link to review the applicable terms for Delta Sharing. Clicking Enable represents acceptance of these terms.

   2. Enable Delta Sharing on a metastore

   Follow these steps for each Unity Catalog metastore that manages data that you plan to share using Delta Sharing.

   info

   You do not need to enable Delta Sharing on your metastore if you intend to use Delta Sharing only to share data with users on other Unity Catalog metastores in your account. Metastore-to-metastore sharing within a single Databricks account is enabled by default.

   1. As a Databricks account admin, log in to the account console.

   2. In the sidebar, click Data.

   3. Click the name of a metastore to open its details.

   4. Click the checkbox next to Enable Delta Sharing to allow a Databricks user to share data outside their organisation.

   5. Configure the recipient token lifetime.

      This configuration sets the period of time after which all recipient tokens expire and must be regenerated. Recipient tokens are used only in the open sharing protocol. Databricks recommends that you configure a default token lifetime rather than allow tokens to live indefinitely.

      info

      The recipient token lifetime for existing recipients is not updated automatically when you change the default recipient token lifetime for a metastore. In order to apply a new token lifetime to a given recipient, you must rotate their token. See Manage recipient tokens (open sharing).

      To set the default recipient token lifetime:

      1. Confirm that Set expiration is enabled (this is the default).

         If you clear this checkbox, tokens will never expire. Databricks recommends that you configure tokens to expire.

      2. Enter a number of seconds, minutes, hours, or days, and select the unit of measure.

      3. Click Enable.

      For more information, see Security considerations for tokens.

   6. Optionally enter a name for your organization that a recipient can use to identify who is sharing with them.

   7. Click Enable.

Credentials to be shared with Sundial :

Kindly share the following information with sundial over a security vault or secret store

In Case of Azure Databricks Kindly follow the following steps

Steps to Enable Delta Sharing for Azure Databricks

As a Sundial representative, follow these steps:

1. Log in to the Azure Databricks account console.

2. In the sidebar, click Data.

   

3. Click the name of a metastore to open its details.

4. Click the checkbox next to Enable Delta Sharing to allow a Databricks user to share data outside their organization.

5. Configure the recipient token lifetime. This configuration sets the period of time after which all recipient tokens expire and must be regenerated.

   To set the default recipient token lifetime:

   1. Confirm that Set expiration is enabled (this is the default).
      • If you clear this checkbox, tokens will never expire. Sundial recommends that you configure tokens to expire and rotate after few months.
   2. Enter a number of seconds, minutes, hours, or days, and select the unit of measure.
   3. Click Enable.

6. Enter a name for your organization that a recipient can use to identify the sharer.

7. Click Enable.

• For more information this link can be referred to this link

Credentials to be shared with Sundial :

Kindly share the following information with sundial over a security vault or secret store

shareCredentialsVersion : Version Number of Delta Sharing Credentials Shared
bearerToken : Unique Bearer Token to connect authenticate
endpoint : Link to Delta Sharing Endpoint to Connect
expirationTime : Expiration time of credentials