A new accuracy–cost frontier
Quest Ultra is 11% more accurate and up to 57% lower cost than the next best model, Larkfell G-5: 70% vs. 63% accuracy, at $300 vs. $701 CPM.
With higher compute budgets, Quest Ultra2x, Ultra4x, and Ultra8x keep pushing the Pareto frontier of accuracy and cost, reaching 82% accuracy at the highest tier.
| Model |
Cost (CPM) |
Accuracy (%) |
| Quest Ultra8x |
$2,400 |
82 |
| Quest Ultra4x |
$1,200 |
81 |
| Quest Ultra2x |
$600 |
77 |
| Quest Ultra |
$300 |
70 |
| Larkfell G-5 with code execution |
$701 |
63 |
| Halvane 3.1 Pro with code execution |
$703 |
62 |
| Orrery 4-6 with tool chaining |
$36,321 |
58 |
| Cindral Probe Pro |
$883 |
28 |
| Findra Deep Reasoning |
$15 |
18 |
CPM is USD per 1,000 requests.
Orrery 4-6 costs more than expected because its provider does not pass cached-prompt savings through to tool-chaining runs.
|