Code generation: a model at 1/271st the price of the best scorer, at 97.8% of its quality.

granite-4.0-h-micro vs mistral-nemo for extraction

the measured answer

As of September 7, 2026, mistral-nemo measures 0.917 on information extraction vs 0.904 for granite-4.0-h-micro (+0.012), at 1.7× the price ($0.0244 vs $0.0144 per 1K requests).

same suite, same items, same scoring — frontier v5, measured 2026-09-07 · method

modelvendormeasured quality$ / 1K requestsp95 latency
granite-4.0-h-microibm-granite0.904$0.01443105 ms
mistral-nemomistralai0.917$0.02443848 ms

Extraction — pulling fields out of documents, emails, and records into structured JSON — is scored field-by-field against known references, so the numbers below are deterministic, not judged. It is also the workload where reference-free LLM judging fails measurably (judges cannot see omissions), which is why extraction claims anywhere should be treated with suspicion unless the scoring method is stated.

These two are part of a larger measured frontier — what is the best model for data extraction shows every measured option for this workload, and other workloads rank these models differently: a model that wins here can lose on another kind of work, which is the whole argument for routing per workload rather than picking one model for everything.

the routed alternative

Potion routes each request to the cheapest option measured at your quality bar — including picks this public page does not name. Get an API key or read the docs.

granite-4.0-h-micro vs mistral-nemo for extraction — measured · Frontier Notes