TL;DR
Gemini 2.5 Flash Preview (google/gemini-2.5-flash-preview) appears in 1 published study. 2025-07-11, Models generating financial SQL queries, July 2025: 0.900 for median score. Each result belongs to its own task, date and grading method.
- Exact tested ID
- google/gemini-2.5-flash-preview
- Published studies
- 1
- Provider
Inspect this exact model
Models generating financial SQL queries, July 2025
Gemini 2.5 Flash Preview: source evidence dated 2025-07-11.
- Median score
- 0.900
- Avg score
- 0.703
- Success rate
- 87.64%
- Avg time
- 33,344 ms
- Input cost
- $0.15/M
- Output cost
- $3.50/M
The displayed values belong to the identified model versions and this published task, with their original metric units.
How did this version perform on the job I need?
The first measured row below belongs to this model, not its provider's other models. Open that study to see the other arms and tested input.
2025-07-11: Models generating financial SQL queries, July 2025Select a model for the specific tested task. A profile with one study does not establish performance on other jobs.
Test a strategy with Aurora
Select a model for the specific tested task. A profile with one study does not establish performance on other jobs.
Test a strategy with AuroraKeep reporting dates and units beside the answer, and inspect its original citations.
Models generating financial SQL queries, July 2025
See the complete models generating financial sql queries, july 2025
Gemini 2.5 Flash Preview recorded 0.900 for median score in the 2025-07-11 publication. About 88 financial questions per the article text, 11 models.
| Published metric | Value |
|---|---|
| Median score | 0.900 |
| Avg score | 0.703 |
| Success rate | 87.64% |
| Avg time | 33,344 ms |
| Input cost | $0.15/M |
| Output cost | $3.50/M |
No matching rows. Clear the filter to see all records.
Models generating financial SQL queries, July 2025: read these measurements
View task, sample and measurement units
About 88 financial questions per the article text, 11 models
Generate SQL queries that answer financial questions against a financial database.
Scoring
Three LLM judges assign a 0 to 1 quality score that is separate from whether the query executes. The article states the score measures query and answer assessment, not investment returns.
Cost units
List prices per million tokens, from $0.10/M input and $0.40/M output (Gemini 2.0 Flash) to $15.00/M input and $75.00/M output (Claude Opus 4). Total run spend was reported as over $200, with $171.88 on Requesty.
Time units
Average time in milliseconds, from 31,140 ms (Gemini 2.0 Flash) to 74,812 ms (Grok-4).
No comments yet.