Providing model details
To configure model evaluations, you must provide details about your model to enable the Watson OpenScale service to understand how your model is set up.
Watson OpenScale provides different methods that you can use to provide model details for evaluations. The method that you use depends on how you want to configure evaluations and the type of deployments that you want to evaluate.
Providing model details in Watson OpenScale
When you add deployments, Watson OpenScale can automatically detect all of the required model details. If Watson OpenScale doesn't detect all of the required model details, you must manually provide model details.
The following sections describe how you can provide model details in Watson OpenScale:
Select a configuration method
For structured data models, you must provide model details by following guided steps or running a notebook to generate a configuration package that you can upload. If the deployment that you selected does not have a scoring endpoint, you must upload a configuration package.
Provide a sample transaction
For image and unstructured text models, Watson OpenScale does not require training data and you must manually provide a sample transaction to specify your model output and input.
Specify training data
If Watson OpenScale doesn't detect your training data details when you add a deployment, you can upload a CSV file to specify training data or connect to training data that is stored in a database or cloud storage. To connect to training data, you must select the location and specify connection details. If your training data details are detected when you add a deployment, the Database or cloud storage option is preselected and Watson OpenScale specifies the location and connection details for you.
Select the feature and label columns
Watson OpenScale displays a list of columns that are available in your training data. You must select the features that you used to train the model and specify a column as the Label/Target column that contains the expected or accurate class label for each record. After you select the feature and label columns, Watson OpenScale uses your training data, and automatically sends a scoring request to your deployment to validate your model output and your deployment status.
Select model output
Select a prediction column and a prediction probability column. The prediction column contains the prediction that your deployment generates and the prediction probability column contains the model's confidence in the prediction. Watson OpenScale might preselect expected columns based on the metadata that it identifies from your model deployment. You can choose to change these selections. The data type of the prediction column must match the data type of the label column. If the data types don't match, Watson OpenScale evaluations might not work properly.
Parent topic: Preparing to evaluate a model