RAG Evaluation Benchmark — Enterprise Documents
12,400 questions over real enterprise documents with gold passages, hard negatives and unanswerable cases.
- Records
- 12.4K questions · 480K passages
- Refresh
- Static release (v2026.1)
Daily snapshots of 180+ hosted and open models: prices, context windows, limits and benchmark scores.
Model prices, context windows and rate limits change constantly, and providers rarely keep a public history. We snapshot the published specifications and pricing pages of 28 providers every day, normalise them into one schema (price per million tokens, cached-input pricing, modality support, deprecation dates) and attach published benchmark scores where the provider or the model card states them.
The result is a clean time series for cost forecasting, vendor comparisons and migration planning — including a record of when a model was deprecated and what replaced it.
| Field | Type | Description |
|---|---|---|
date |
date | Snapshot date |
provider / model_id |
string | Provider and model identifier |
modality |
array | text, vision, audio, embedding |
context_window |
integer | Maximum input tokens |
max_output_tokens |
integer | Maximum completion tokens |
input_price_per_mtok_usd |
decimal | Published input price |
output_price_per_mtok_usd |
decimal | Published output price |
cached_input_price_usd |
decimal | Cached or batch price when offered |
benchmark_scores |
json | Published scores with their source |
release_date / deprecation_date |
date | Lifecycle dates |
status |
string | preview, general_availability, deprecated, retired |
{
"date": "2026-09-01",
"provider": "vendor-a",
"model_id": "omni-pro-2",
"modality": [
"text",
"vision"
],
"context_window": 200000,
"max_output_tokens": 16384,
"input_price_per_mtok_usd": 2.5,
"output_price_per_mtok_usd": 10,
"cached_input_price_usd": 0.25,
"status": "general_availability"
}
{
"date": "2026-09-01",
"provider": "vendor-b",
"model_id": "compact-8b",
"modality": [
"text"
],
"context_window": 128000,
"max_output_tokens": 8192,
"input_price_per_mtok_usd": 0.15,
"output_price_per_mtok_usd": 0.6,
"status": "general_availability"
}
Illustrative sample showing the structure of the data. The full dataset is delivered after purchase.
12,400 questions over real enterprise documents with gold passages, hard negatives and unanswerable cases.
60K synthetic dialogues in six languages with function-call traces, tool schemas and realistic failure cases.
Half-hourly stock, delivery-time and price snapshots from 900 dark stores in 14 cities.
Tell us what you are trying to predict, automate or understand. We will reply within one business day with an approach, a timeline and a quote.