Sending model transactions

You must send model transactions from your deployment to Watson OpenScale to enable model evaluations.

To generate accurate results for your model evaluations constantly, Watson OpenScale must continue to receive new data from your deployment. Watson OpenScale provides different methods that you can use to send transactions for model evaluations.

Importing data

When you review evaluation results on the Watson OpenScale Insights dashboard, you can use the Actions menu to import payload and feedback data for your model evaluations.

For pre-production models, you can import data by uploading CSV files or connecting to data that is stored in Cloud Object Storage or a Db2 database.

import test data in pre-production

If you want to upload data that is already scored, you can select the Test data includes model output checkbox. Cloud Object Storage does not rescore the test data when you select this option. The data that you import can also include record_id/transaction_id and record_timestamp columns that are added to the payload logging and feedback tables when this option is selected.

For production models, you can import data by uploading CSV files or using endpoints to send your model transactions. The CSV files that you upload must include columns for model output predictions.

import test data in production

If you upload data with CSV files, you must send a scoring request with the endpoint for your deployment. You can access your deployment space to get the public endpoint for your online deployment to send scoring requests.

Using endpoints

For production models, Watson OpenScale supports endpoints that you can use to provide data in formats that enable evaluations. You can use the payload logging endpoint to send scoring requests for fairness and drift evaluations and use the feedback logging endpoint to provide feedback data for quality evaluations. You can also upload CSV files to provide data for model evaluations. For more information about the data formats, see Managing data for model evaluations.

Watson OpenScale also supports a debiased transactions endpoint that you can use to review the results of fairness evaluations. The debiased transactions endpoint applies active debiasing on your payload data to detect any bias in your model. For more information about active debiasing, see Reviewing debiased transactions.

Endpoints selection menu

You can use the following steps to send model transactions for your model evaluations with endpoints in Watson OpenScale:

On the monitor configuration page, select the Endpoints tab.
If you want to upload payload data with a CSV file, click Upload payload data.
If you want to upload feedback data with a CSV file, click Upload feedback data.
In the Model information panel, click Endpoints.
From the Endpoint menu, select the type of endpoint that you want to use.
From the Code language menu, choose the type of code snippet that you want to use.
Click Copy to clipboard to copy the code snippet and run the code in your notebook or application.

Parent topic: Managing data for model evaluations in Watson OpenScale