About cookies on this site Our websites require some cookies to function properly (required). In addition, other cookies may be used with your consent to analyze site usage, improve the user experience and for advertising. For more information, please review your cookie preferences options. By visiting our website, you agree to our processing of information as described in IBM’sprivacy statement. To provide a smooth navigation, your cookie preferences will be shared across the IBM web domains listed here.
Last updated: Nov 07, 2024
To access your data in Microsoft Azure Databricks, create a connection asset for it.
Databricks is a big data analytics tool that is based on Apache Spark.
Supported Databricks Runtime versionsCopy link to section
Copy link to section
The Microsoft Azure Databricks connection runs on the Azure Cloud runtimes.
Create a connection to Microsoft Azure DatabricksCopy link to section
Copy link to section
To create the connection asset, you need to enter the connection details and to select an authentication method.
Connection detailsCopy link to section
Copy link to section
- Hostname or IP address of the database
- Port number of the database
- HTTP path: Path of the endpoint for which the server is configured in HTTP transport mode.
CredentialsCopy link to section
Copy link to section
Choose an authentication method:
- Entra ID token
Note:
Prerequisite for Entra ID authentication:
Microsoft Entra ID is a cloud-based identity and access management service. To obtain connection values for the Entra ID authentication method, sign in to the Microsoft Azure portal. For information about Microsoft Entra ID, see What is Microsoft Entra ID? and Get Microsoft Entra ID tokens for service principals.
- Service principal credentials
Client ID and client secret of the service principal.
Note:
Prerequisite for service client principal authentication:
A service client principal is a credential created for Microsoft Azure Databricks that is used for automated tools, jobs and applications. For more inforation, see Manage service principals. To create a service client principal, see Use a service principal to authenticate with Azure Databricks.
- Username and password
Username and password for accessing the database.
Choose the method for creating a connection based on where you are in the platformCopy link to section
Copy link to section
- In a project
- Click Assets > New asset > Connect to a data source. See Adding a connection to a project.
- In a deployment space
- Click Import assets > Data access > Connection. See Adding data assets to a deployment space.
- In the Platform assets catalog
- Click New connection. See Adding platform connections.
Next step: Add data assets from the connectionCopy link to section
Copy link to section
Where you can use this connectionCopy link to section
Copy link to section
You can use the Microsoft Azure Databricks connection in the following workspaces and tools:
Projects
- SPSS Modeler
Catalogs
- Platform assets catalog
Microsoft Azure Databricks setupCopy link to section
Copy link to section
Get started: Account and workspace setup
Running SQL statementsCopy link to section
Copy link to section
To ensure that your SQL statements run correctly, refer to the Azure Databricks SQL language reference for the correct syntax.
Learn moreCopy link to section
Copy link to section
Parent topic: Supported connections