Docs
...
Contains none

Contains none evaluation metric

Last updated: Feb 07, 2025
Contains none evaluation metric

The contains none metric measures whether the rows in the prediction do not contain any of the specified keywords.

Metric details

Contains none is a content validation metric that uses string-based functions to analyze and validate generated LLM output text. The metric is available only when you use the Python SDK to calculate evaluation metrics.

Scope

The contains none metric evaluates generative AI assets only.

  • Types of AI assets: Prompt templates
  • Generative AI tasks:
    • Text summarization
    • Content generation
    • Question answering
    • Entity extraction
    • Retrieval augmented generation (RAG)
  • Supported languages: English

Scores and values

The contains none metric score indicates if the prediction rows contain any of the specifiied keywords.

  • Range of values: 0.0-1.0
  • Ratios:
    • At 0: The prediction rows contain the specified keywords.
    • At 1: The prediction rows contain none of the specified keywords.

Settings

  • Thresholds:
    • Lower limit: 0
    • Upper limit: 1

Parent topic: Evaluation metrics