TL;DR
Claude Opus 4.1 (anthropic/claude-opus-4.1) appears in 1 published study. 2025-08-11, Models turning plain-English trading rules into strategy configs: 1.000 for median score. Each result belongs to its own task, date and grading method.
- Exact tested ID
- anthropic/claude-opus-4.1
- Published studies
- 1
- Provider
- anthropic
Inspect this exact model
Models turning plain-English trading rules into strategy configs
Claude Opus 4.1: source evidence dated 2025-08-11.
- Median score
- 1.000
- Avg score
- 0.945
- Success rate
- 100.0%
- Avg time (ms)
- 85,175
- Input cost
- $15.00/M
- Output cost
- $75.00/M
The displayed values belong to the identified model versions and this published task, with their original metric units.
How did this version perform on the job I need?
The first measured row below belongs to this model, not its provider's other models. Open that study to see the other arms and tested input.
2025-08-11: Models turning plain-English trading rules into strategy configsSelect a model for the specific tested task. A profile with one study does not establish performance on other jobs.
Test a strategy with Aurora
Select a model for the specific tested task. A profile with one study does not establish performance on other jobs.
Test a strategy with AuroraKeep reporting dates and units beside the answer, and inspect its original citations.
Models turning plain-English trading rules into strategy configs
See the complete models turning plain-english trading rules into strategy configs
Claude Opus 4.1 recorded 1.000 for median score in the 2025-08-11 publication. 14 models on one sample of strategy requests, this article does not state the count (the companion article of 2025-08-12 describes the same table as 12 financial questions).
| Published metric | Value |
|---|---|
| Median score | 1.000 |
| Avg score | 0.945 |
| Success rate | 100.0% |
| Avg time (ms) | 85,175 |
| Input cost | $15.00/M |
| Output cost | $75.00/M |
No matching rows. Clear the filter to see all records.
Models turning plain-English trading rules into strategy configs: read these measurements
View task, sample and measurement units
14 models on one sample of strategy requests, this article does not state the count (the companion article of 2025-08-12 describes the same table as 12 financial questions)
Convert a natural-language trading strategy request into a NexusTrade portfolio configuration of actions and conditions.
Scoring
LLM judges score each configuration from 0 to 1 using published guidelines (1.0 perfect match, 0.8 to 0.9 minor issues, 0.5 to 0.7 significant discrepancies, 0.2 to 0.4 major errors, 0.0 to 0.1 complete mismatch). Success rate is reported separately.
Cost units
The table lists each model's list price per million input and output tokens. It does not publish total run cost.
Time units
Average time per generation in milliseconds, as published in the table.
No comments yet.