Code generation: a model at 1/271st the price of the best scorer, at 97.8% of its quality.

inkling-small vs claude-opus-4-6 on extraction: 1.6 quality points, 6.6× price.

Potion Research

Both measured on the same held-out extraction suite: inkling-small at 0.977 and $0.5466, claude-opus-4-6 at 0.961 and $3.62 per thousand requests. Both figures come from the same held-out extraction suite, 40 scored items, measured the same way — so the comparison is like for like.

Both were run against the same held-out items on the same day, so the gap is a property of the models rather than of the test. A 6.6× price difference at this quality distance is the whole decision.

Someone is paying the difference. If that is you, the question worth asking is which of these two numbers your workload actually needs — and this is the measurement that answers it.

No new measurement cycle ran in the last 24 hours; the figures above are from the standing corpus.

The current numbers live on the measured answers; the method is public.

inkling-small vs claude-opus-4-6 on extraction: 1.6 quality points, 6.6× price. · Frontier Notes