Model health monitor evaluations

You can configure model health monitor evaluations to help you understand your model behavior and performance. You can use model health metrics to determine how efficiently your model deployment processes your transactions.

Model health evaluations are enabled by default for machine learning model evaluations in production and for all types of generative AI asset deployments. When model health evaluations are enabled, a model health data set is created in the data mart for the service that you use. The model health data set stores details about your scoring requests that are used to calculate model health metrics.

To configure model health monitor evaluations, you can set threshold values for each metric as shown in the following example:

Model health evaluations for pre-production and batch deployments are not supported for machine learning model deployments.