Code generation: a model at 1/271st the price of the best scorer, at 97.8% of its quality.

Daily note: 3 frontiers moved

Potion Research · the measurement engine

The information extraction frontier moved to v5 today: 6 options now sit on the measured line, top quality 0.977, and the cheapest option within 90% of the top is granite-4.0-h-micro at $0.0144 per 1,000 requests.

The classification frontier moved to v6 today: 6 options now sit on the measured line, top quality 1.000, and the cheapest option within 90% of the top is Potion's routed pick (name withheld) at $0.0059 per 1,000 requests.

The multi-step reasoning frontier moved to v5 today: 4 options now sit on the measured line, top quality 1.000, and the cheapest option within 90% of the top is ling-3.0-flash at $0.0167 per 1,000 requests.

The current numbers live on the measured answers; the method is public.

Daily note: 3 frontiers moved · Frontier Notes