inkling-small vs mistral-nemo for extraction
As of September 7, 2026, inkling-small measures 0.977 on information extraction vs 0.917 for mistral-nemo (+0.060), at 22.4× the price ($0.5466 vs $0.0244 per 1K requests).
same suite, same items, same scoring — frontier v5, measured 2026-09-07 · method
| model | vendor | measured quality | $ / 1K requests | p95 latency |
|---|---|---|---|---|
| inkling-small | thinkingmachines | 0.977 | $0.5466 | 4649 ms |
| mistral-nemo | mistralai | 0.917 | $0.0244 | 3848 ms |
Extraction — pulling fields out of documents, emails, and records into structured JSON — is scored field-by-field against known references, so the numbers below are deterministic, not judged. It is also the workload where reference-free LLM judging fails measurably (judges cannot see omissions), which is why extraction claims anywhere should be treated with suspicion unless the scoring method is stated.
These two are part of a larger measured frontier — what is the best model for data extraction shows every measured option for this workload, and other workloads rank these models differently: a model that wins here can lose on another kind of work, which is the whole argument for routing per workload rather than picking one model for everything.
Potion routes each request to the cheapest option measured at your quality bar — including picks this public page does not name. Get an API key or read the docs.