To access your data in IBM Cloud Data Engine, create a connection asset for it.
Important:
The IBM Cloud Data Engine connector is deprecated and will be discontinued in a future release. For more information, see Deprecation of Data Engine.
IBM Cloud Data Engine is a service on IBM Cloud that you use to build, manage, and consume data lakes and their table assets in IBM Cloud Object Storage (COS). IBM Cloud Data Engine provides functions to load, prepare, and query big data that
is stored in various formats. It also includes a metastore with table definitions. IBM Cloud Data Engine was formerly named "IBM Cloud SQL Query."
Prerequisites
Copy link to section
Create a connection to IBM Cloud Data Engine
Copy link to section
To create the connection asset, you need these connection details:
The Cloud Resource Name (CRN) of the IBM Cloud Data Engine instance. Go to the IBM Cloud Data Engine service instance in your resources list in your IBM Cloud dashboard and copy the value of the CRN from the deployment details.
Target Cloud Object Storage: A default location where IBM Cloud Data Engine stores query results. You can specify any Cloud Object Storage bucket that you have access to. You can also select the default Cloud Object Storage bucket that is
created when you open the IBM Cloud Data Engine web console for the first time from IBM Cloud dashboard. See the Target location field in the IBM Cloud Data Engine web console.
IBM Cloud API key: An API key for a user or service ID that has access to your IBM Cloud Data Engine and Cloud Object Storage services (for both the Cloud Object Storage data that you want to query and the default target Cloud Object Storage
location).
You can create a new API key for your own user:
In the IBM Cloud console, go to Manage > Access (IAM).
In the left navigation, select API keys.
Select Create an IBM Cloud API Key.
Credentials
Copy link to section
IBM Cloud Data Engine uses the SSO credentials that are specified as a single API key, which authenticates a user or service ID. The API key must have the following properties:
Manage permission for the IBM Cloud Data Engine instance
Read access to all Cloud Object Storage locations that you want to read from
Write access to the default Cloud Object Storage target location
Write access to the IBM Cloud Data Engine instance
Choose the method for creating a connection based on where you are in the platform
By default, all objects that are stored in IBM Cloud Object Storage are encrypted by using randomly generated keys and an all-or-nothing-transform (AONT). For details, see Encrypting your data. Additionally, you can use managed keys to encrypt the SQL query texts and error messages that are stored in the job information. See Encrypting SQL queries with Key Protect.
About cookies on this siteOur websites require some cookies to function properly (required). In addition, other cookies may be used with your consent to analyze site usage, improve the user experience and for advertising.For more information, please review your cookie preferences options. By visiting our website, you agree to our processing of information as described in IBM’sprivacy statement. To provide a smooth navigation, your cookie preferences will be shared across the IBM web domains listed here.