Hit rate evaluation metric
Last updated: Feb 21, 2025
The hit rate evaluation metric measures whether there is at least one relevant context among the retrieved contexts.
Metric details
Hit rate is a retrieval quality metric for generative AI quality evaluations that measures the quality of how retrieval systems rank relevant contexts.
Scope
The hit rate metric evaluates generative AI assets only.
- Types of AI assets: Prompt templates
- Generative AI tasks: Retrieval Augmented Generation (RAG)
- Supported languages: English
Scores and values
The hit rate metric score whether at least one relevant context is among the retrieved contexts. If the score is trending upwards, at least one relevant context is in the retrieved context. If the score is trending downwards, no relevant contexts are retrieved.
- Range of values: 0.0-1.0
- Best possible score: 1.0
- Ratios:
- At 0: No relevant contexts are retrieved
- Over 0: Increasing rate of relevant contexts are retrieved
Settings
- Thresholds:
- Lower limit: 0
- Upper limit: 1
Parent topic: Evaluation metrics
Was the topic helpful?
0/1000