The hit rate evaluation metric measures whether there is at least one relevant context among the retrieved contexts.
Metric details
Copy link to section
Hit rate is a retrieval quality metric for generative AI quality evaluations that measures the quality of how retrieval systems rank relevant contexts.
Scope
Copy link to section
The hit rate metric evaluates generative AI assets only.
Types of AI assets: Prompt templates
Generative AI tasks: Retrieval Augmented Generation (RAG)
Supported languages: English
Scores and values
Copy link to section
The hit rate metric score whether at least one relevant context is among the retrieved contexts. If the score is trending upwards, at least one relevant context is in the retrieved context. If the score is trending downwards, no relevant contexts
are retrieved.
Range of values: 0.0-1.0
Best possible score: 1.0
Ratios:
At 0: No relevant contexts are retrieved
Over 0: Increasing rate of relevant contexts are retrieved