TL;DR
GPT-5 Nano (openai/gpt-5-nano) appears in 1 published study. 2025-08-10, GPT-5 family and peers generating financial SQL queries: 0.467 for median score. Each result belongs to its own task, date and grading method.
- Exact tested ID
- openai/gpt-5-nano
- Published studies
- 1
- Provider
- openai
Inspect this exact model
GPT-5 family and peers generating financial SQL queries
GPT-5 Nano: source evidence dated 2025-08-10.
- Median score
- 0.467
- Avg score
- 0.465
- Success rate
- 62.92%
- Avg time
- 54,926 ms
- Input cost
- $0.05/M
- Output cost
- $0.40/M
The displayed values belong to the identified model versions and this published task, with their original metric units.
How did this version perform on the job I need?
The first measured row below belongs to this model, not its provider's other models. Open that study to see the other arms and tested input.
2025-08-10: GPT-5 family and peers generating financial SQL queriesSelect a model for the specific tested task. A profile with one study does not establish performance on other jobs.
Test a strategy with Aurora
Select a model for the specific tested task. A profile with one study does not establish performance on other jobs.
Test a strategy with AuroraKeep reporting dates and units beside the answer, and inspect its original citations.
GPT-5 family and peers generating financial SQL queries
See the complete gpt-5 family and peers generating financial sql queries
GPT-5 Nano recorded 0.467 for median score in the 2025-08-10 publication. EvaluateGPT financial question set (count not restated in this article), 8 models.
| Published metric | Value |
|---|---|
| Median score | 0.467 |
| Avg score | 0.465 |
| Success rate | 62.92% |
| Avg time | 54,926 ms |
| Input cost | $0.05/M |
| Output cost | $0.40/M |
No matching rows. Clear the filter to see all records.
GPT-5 family and peers generating financial SQL queries: read these measurements
View task, sample and measurement units
EvaluateGPT financial question set (count not restated in this article), 8 models
Generate syntactically and semantically valid SQL queries for real-world financial questions.
Scoring
LLM-judge scores from 0 to 1 as described in the linked GPT-oss article (Claude Sonnet 4, Gemini 2.5 Pro and GPT-4.1 judges in that article). This article does not restate the judges.
Cost units
List prices per million tokens, from $0.05/M input and $0.40/M output (GPT-5 Nano) to $1.25/M input and $10.00/M output (Gemini 2.5 Pro, GPT-5, GPT-5 Chat). Total spend was reported as around $200.
Time units
Average time in milliseconds, from 40,236 ms (Gemini 2.5 Flash) to 113,743 ms (GPT-5).
No comments yet.