TL;DR
gpt-oss-20b (openai/gpt-oss-20b) appears in 1 published study. 2025-08-06, GPT-oss and Gemini generating financial SQL queries: 0.500 for median score. Each result belongs to its own task, date and grading method.
- Exact tested ID
- openai/gpt-oss-20b
- Published studies
- 1
- Provider
- openai
Inspect this exact model
GPT-oss and Gemini generating financial SQL queries
gpt-oss-20b: source evidence dated 2025-08-06.
- Median score
- 0.500
- Avg score
- 0.497
- Success rate
- 68.54%
- Avg time
- 49,607 ms
- Input cost
- $0.05/M
- Output cost
- $0.20/M
The displayed values belong to the identified model versions and this published task, with their original metric units.
How did this version perform on the job I need?
The first measured row below belongs to this model, not its provider's other models. Open that study to see the other arms and tested input.
2025-08-06: GPT-oss and Gemini generating financial SQL queriesSelect a model for the specific tested task. A profile with one study does not establish performance on other jobs.
Test a strategy with Aurora
Select a model for the specific tested task. A profile with one study does not establish performance on other jobs.
Test a strategy with AuroraKeep reporting dates and units beside the answer, and inspect its original citations.
GPT-oss and Gemini generating financial SQL queries
See the complete gpt-oss and gemini generating financial sql queries
gpt-oss-20b recorded 0.500 for median score in the 2025-08-06 publication. 90 financial questions per the article text, 4 models.
| Published metric | Value |
|---|---|
| Median score | 0.500 |
| Avg score | 0.497 |
| Success rate | 68.54% |
| Avg time | 49,607 ms |
| Input cost | $0.05/M |
| Output cost | $0.20/M |
| Context window | 131,072 |
No matching rows. Clear the filter to see all records.
GPT-oss and Gemini generating financial SQL queries: read these measurements
View task, sample and measurement units
90 financial questions per the article text, 4 models
Generate BigQuery SQL queries that answer complex financial questions.
Scoring
Three LLM judges score each query and its results from 0 to 1. The scores are averaged.
Cost units
List prices per million tokens, from $0.05/M input and $0.20/M output (GPT-OSS-20B) to $1.25/M input and $10.00/M output (Gemini 2.5 Pro Preview). No measured run spend is published.
Time units
Average time in milliseconds, from 38,538 ms (GPT-OSS-120B) to 56,393 ms (Gemini 2.5 Pro Preview).
No comments yet.