0 / 0
Tracking models in a model inventory
Tracking models in a model inventory

Tracking models in a model inventory

Use a model inventory to organize machine learning models for your organization. You can create an entry for every model you want to track, then review the detail from the inventory page in the catalog. Use filters to refine the view. For example, view just the model entries that are in an approved state.

To view a model inventory, choose Model inventory from the Catalog section of the navigation pane.

Working with model entries

From the Model inventory, you can:

Creating a model entry

Create a model entry to track a model's lifecycle.

  1. From the navigation pane, click the Catalog section and then click Model inventory.
  2. Click New model entry and enter a name and description.
  3. Choose the catalog containing the model entry.
  4. After you create the entry, you can specify extra details such as the Model purpose, Business terms, or Supporting documentation.

Viewing model entry details

A model inventory contains model entries that would provide details about the model lifecycle, purpose, and facts that support governance. For each model entry, you can view:

  • The model entry name.
  • The status for the model entry. For example, a model might be awaiting development, under review, or in production.
  • Business terms associated with the model entry.
  • Tags available for the model entry.

For complete details on what is included for each model, see viewing model and deployment factsheets.

Changing the status of a model entry

You can change the status of a model entry to reflect a change in the model's lifecycle. For example, you can change the status of a model from Deployed for validation to Validated after you confirm that the model was adequately tested.

To change the status of a model entry:

  1. Open the model entry in the model inventory.
  2. Switch to the Asset tab.
  3. Click the Edit icon.
  4. Select the new status and click Update to save.

The model entry is displayed in the new status category.

Deleting a model entry

To delete a model entry from the inventory, click Remove from the action item on the model entry tile. The model entry is removed from the inventory and all association with the model in a project or space is deleted.

Use the search bar to search for a model entry by name, tag, classification, or business term.

Filtering the view

Use the filters in the model inventory view to refine the list. You can filter by alert (such as a change in drift, fairness or quality), business terms, catalog, classification, tags, and status.

Viewing alerts

When you evaluate a model, you can set thresholds to trigger an alert when a threshold is met. For example, you can set an alert that is triggered if bias detection for a monitored group changes by 10%. You can view the alerts for a model from the model entry.

If any of the model deployments has alerts, alerts are displayed in the model inventory as a badge on the model entry. Choose Preview alerts from the action menu item on a model entry in the model inventory page to see the details of the alerts.

Viewing the factsheet for a model

From the model tracking page for a model entry in an inventory, click the Asset tab to view the associated factsheet. You can also view the factsheet when you view model details in a project, space, or catalog. For details, see Viewing a model factsheet.

After a model is registered, facts about the model are captured and preserved automatically at each point in the model lifecycle, including whenever a model is updated or changed. For example, events are captured when a model is:

  • Created
  • Updated in any way, including having a tag or description revised
  • Promoted to a space
  • Published to a catalog
  • Deployed
  • Evaluated lifecycle in OpenScale

No user intervention is required to update the factsheet.

Additionally, facts are preserved about a model in a notebook after the IBM AI Governance Facts Client library (AIGovFactsClient) is started in the notebook. From that point, lifecycle metadata and metrics are automatically preserved.

Viewing the factsheet for a deployment

From the model details page for a model entry in an inventory, click the Asset tab to view the associated factsheet. You can also view the factsheet when you view deployment details in a space. For details, see Viewing a model factsheet.

Learn more