TL;DR
Gemini 2.5 Pro Preview (google/gemini-2.5-pro-preview) appears in 1 published study. 2025-08-06, GPT-oss and Gemini generating financial SQL queries: 0.900 for median score. Each result belongs to its own task, date and grading method.
- Exact tested ID
- google/gemini-2.5-pro-preview
- Published studies
- 1
- Provider
Inspect this exact model
GPT-oss and Gemini generating financial SQL queries
Gemini 2.5 Pro Preview: source evidence dated 2025-08-06.
- Median score
- 0.900
- Avg score
- 0.706
- Success rate
- 83.15%
- Avg time
- 56,393 ms
- Input cost
- $1.25/M
- Output cost
- $10.00/M
The displayed values belong to the identified model versions and this published task, with their original metric units.
How did this version perform on the job I need?
The first measured row below belongs to this model, not its provider's other models. Open that study to see the other arms and tested input.
2025-08-06: GPT-oss and Gemini generating financial SQL queriesSelect a model for the specific tested task. A profile with one study does not establish performance on other jobs.
Test a strategy with Aurora
Select a model for the specific tested task. A profile with one study does not establish performance on other jobs.
Test a strategy with AuroraKeep reporting dates and units beside the answer, and inspect its original citations.
GPT-oss and Gemini generating financial SQL queries
See the complete gpt-oss and gemini generating financial sql queries
Gemini 2.5 Pro Preview recorded 0.900 for median score in the 2025-08-06 publication. 90 financial questions per the article text, 4 models.
| Published metric | Value |
|---|---|
| Median score | 0.900 |
| Avg score | 0.706 |
| Success rate | 83.15% |
| Avg time | 56,393 ms |
| Input cost | $1.25/M |
| Output cost | $10.00/M |
| Context window | 1,048,576 |
No matching rows. Clear the filter to see all records.
GPT-oss and Gemini generating financial SQL queries: read these measurements
View task, sample and measurement units
90 financial questions per the article text, 4 models
Generate BigQuery SQL queries that answer complex financial questions.
Scoring
Three LLM judges score each query and its results from 0 to 1. The scores are averaged.
Cost units
List prices per million tokens, from $0.05/M input and $0.20/M output (GPT-OSS-20B) to $1.25/M input and $10.00/M output (Gemini 2.5 Pro Preview). No measured run spend is published.
Time units
Average time in milliseconds, from 38,538 ms (GPT-OSS-120B) to 56,393 ms (Gemini 2.5 Pro Preview).
No comments yet.