0 / 0
Repetitivenes evaluation metric
Last updated: Mar 05, 2025
Repetitivenes evaluation metric

The repetitivensss metric Measures the percentage of n-grams that repeat in the foundation model output by calculating the number of repeated n-grams and the total number of n-grams in the model output.

Metric details

Repetitiveness is a content analysis metric for generative AI quality evaluations that can help evaluate generative AI model output against model input or context.

Scope

The repetitiveness metric evaluates generative AI assets only.

  • Types of AI assets: Prompt templates
  • Generative AI tasks: Text summarization
  • Supported languages: English

Settings

  • Thresholds:
    • Lower bound: 0

Parent topic: Evaluation metrics