0 / 0
Reviewing model transactions

Reviewing model transactions

You can analyze model transactions in the Watson OpenScale service to understand how your model predicts outcomes. For example, you can review the predicted biased outcomes in payload transactions, or analyze a drop in accuracy, to get a better understanding of how your deployment is performing.

Watson OpenScale provides the following different methods to help you analyze your model transactions:

  • When you review results from fairness evaluations, you can select View payload transactions to view a list of all of the model transactions that Watson OpenScale processes to predict any biased outcomes for each monitored attribute.

    List of payload of transactions displays

  • When you review results from drift evaluations, you can click the Number of transactions link on a transactions summary tile to view the transactions that are responsible for drift. The Transactions page specifies reasons for the drop in accuracy or drop in data consistency and provides a recommendation to help fix the drift of your model.

    Model drift transactions details page is displayed

  • When you review evaluation results, you can review performance to understand how your model processes scoring requests. Performance evaluations are enabled by default when you add deployments. To evaluate performance, Watson OpenScale calculates the total number of transaction records and the average number of transaction records per minute that your model processes.

    Performance evaluation transaction details page is displayed

  • When you review evaluation results, you can use the Predictions by confidence chart to analyze the transactions that are sent to your deployment in the date range that you select by reviewing prediction classes and confidence distribution in each class. You can also use the Chart builder to create custom visualizations to help you better understand model predictions and inputs at run time.

    The chart builder displays the output of the model’s prediction against the features or data ranges that you specify. For example, you can use the chart builder to see the split in predicted classes or confidence scores for different ranges of an attribute. You can also analyze the transactions that are sent to your deployment during a data range by creating a custom chart and choosing between featues, prediction classes, and confidence.

    Chart builder displaying metrics for model transactions is displayed

    When you review any transactions on the Transactions page in Watson OpenScale, you can choose to view explanations that provide details about how the predictions for each transaction are determined. For more information, see Explaining model transactions.

    Note:

    If your data includes a feature name containing a period (.), rendering a chart will fail with this error: Failed to get data

Learn more

Explaining model transactions

Parent topic: Reviewing model insights with Watson OpenScale

Generative AI search and answer
These answers are generated by a large language model in watsonx.ai based on content from the product documentation. Learn more