Managing the watsonx.ai Runtime service endpoint

You can use IBM Cloud connectivity options for accessing cloud services securely by using service endpoints. When you provision a watsonx.ai Runtime service instance, you can choose if you want to access your service through the public internet, which is the default setting, or over the IBM Cloud private network.

For more information, refer to IBM Cloud service endpoints.

You can use the Service provisioning page to choose a default endpoint from the following options:

Public network
Private network
Both, public and private networks

Public network

You can use public network endpoints to connect to watsonx.ai Runtime service instance on the public network. Your environment needs to have internet access to connect.

Private network

You can use private network endpoints to connect to your IBM watsonx.ai Runtime service instance over the IBM Cloud Private network. After you configure your watsonx.ai Runtime service to use private endpoints, the service is not accessible from the public internet.

Private URLs for watsonx.ai Runtime

Private URLs for watsonx.ai Runtime for each region are as follows:

Dallas - https://private.us-south.ml.cloud.ibm.com
London - https://private.eu-gb.ml.cloud.ibm.com
Frankfurt - https://private.eu-de.ml.cloud.ibm.com
Tokyo - https://private.jp-tok.ml.cloud.ibm.com

Using IBM Cloud service endpoints

Follow these steps to enable private network endpoints on your clusters:

Use IBM Cloud CLI to enable your account to use IBM Cloud service endpoints.
Provision a watsonx.ai Runtime service instance with private endpoints.

Provisioning with service endpoints

You can provision a watsonx.ai Runtime service instance with service endpoint by using IBM Cloud UI or IBM Cloud CLI.

Provisioning a service endpoint with IBM Cloud UI

To configure the endpoints of your IBM watsonx.ai Runtime service instance, you can use the Endpoints field on the IBM Cloud catalog page. You can configure a public, private, or a mixed network.

Configure endpoint from the service catalog

IBM Cloud CLI

If you provision an IBM watsonx.ai Runtime service instance by using the IBM Cloud CLI, use the command-line option service-endpoints to configure the watsonx.ai Runtime endpoints. You can specify the value public (the default value), private, or public-and-private:

ibmcloud resource service-instance-create <service instance name> pm-20 <plan_name> <region>  --service-endpoints <private/public/public-and-private>

For example:

ibmcloud resource service-instance-create wml-instance pm-20 standard us-south -p  --service-endpoints private

ibmcloud resource service-instance-create wml-instance pm-20 standard us-south --service-endpoints public-and-private

Parent topic: First steps