The reciprocal rank metric measures the reciprocal rank of the first relevant context.
Metric details
Copy link to section
Reciprocal rank is a retrieval quality metric for generative AI quality evaluations that measures the quality of how a retrieval system ranks relevant contexts. Retrieval quality metrics are calculated with LLM-as-a-judge models.
Scope
Copy link to section
The reciprocal rank metric evaluates generative AI assets only.
Types of AI assets: Prompt templates
Generative AI tasks: Retrieval Augmented Generation (RAG)
Supported languages: English
Scores and values
Copy link to section
The reciprocal rank metric score indicates whether relevant contexts are retrieved and where they are ranked. Higher scores indicate that the first relevant context is ranked higher. Lower scores indicate that the rist relevant context is
ranked lower.
Range of values: 0.0-1.0
Best possible score: 1.0
Ratios:
At 0: None of the relevant contexts are retrieved
At 1: The first relevant context is at the first position.