gemini-3.1-flash-lite vs qwen3-235b-a22b-2507 for summarization
As of September 19, 2026, qwen3-235b-a22b-2507 measures 0.820 on summarization vs 0.796 for gemini-3.1-flash-lite (+0.024), and it is also the cheaper option ($0.1167 vs $0.2751 per 1K requests).
same suite, same items, same scoring — frontier v6, measured 2026-09-19 · method
| model | vendor | measured quality | $ / 1K requests | p95 latency |
|---|---|---|---|---|
| gemini-3.1-flash-lite | 0.796 | $0.2751 | 1383 ms | |
| qwen3-235b-a22b-2507 | qwen | 0.820 | $0.1167 | 5583 ms |
Summarization quality is subjective at the margins, which makes it exactly the workload where judge-based scores need calibration receipts. The measured suite anchors judging against references and calibrates judges against tasks with deterministic truth, publishing the correlation rather than asking for trust.
These two are part of a larger measured frontier — what is the best model for summarization shows every measured option for this workload, and other workloads rank these models differently: a model that wins here can lose on another kind of work, which is the whole argument for routing per workload rather than picking one model for everything.
Potion routes each request to the cheapest option measured at your quality bar — including picks this public page does not name. Get an API key or read the docs.