Search Oryxen

Search tools, jump to categories, and open key destinations

All field notes
Field note 17Model selection

Reasoning effort is a cost dial, not a quality setting

Reasoning-effort settings let you choose how much deliberation a model does before answering. They move cost and latency alongside depth, which makes them a budget control rather than a quality dial: the right setting is the lowest one that clears your quality bar on the task in front of you. Several 2026 model releases support multiple effort levels on the same weights, and adaptive routing — where the model adjusts effort based on how hard a prompt looks — is a direction analysts expect to continue. Either way, the setting is a measured condition, not a default to inherit.

By Kaviyarasu Viswanathan

Bottom line up front

Reasoning-effort settings let you choose how much deliberation a model does before answering. They move cost and latency alongside depth, which makes them a budget control rather than a quality dial: the right setting is the lowest one that clears your quality bar on the task in front of you. Several 2026 model releases support multiple effort levels on the same weights, and adaptive routing — where the model adjusts effort based on how hard a prompt looks — is a direction analysts expect to continue. Either way, the setting is a measured condition, not a default to inherit.

01

What an effort setting actually changes

A reasoning-effort setting controls how much intermediate deliberation the model produces before its final answer. More deliberation generally means more output tokens, more latency, and a higher bill — and sometimes better results on tasks where the extra thinking helps. The key property is that all three move together, which is why treating the setting as a quality dial is the wrong frame.

Several of the models documented in this series expose multiple effort levels on the same weights: a 309-billion-parameter mobile-family model with a low and a high setting, a 550-billion-parameter reasoning model with a configurable inference-time reasoning budget, a 600-billion-parameter coding model with low, medium, and high, and a frontier model with low through max. The ranges differ, which means the level names are not comparable across models — a 'high' on one is not necessarily a 'high' on another.

  • Record which effort levels a specific model exposes, and that the names are not comparable across models.
  • Measure output tokens at each level, not just input, when estimating cost.
  • Treat the level as part of your recorded conditions, not a fixed default.
02

The right level is the cheapest one that clears your bar

The practical rule is to find your quality bar first and then use the lowest effort setting that clears it. That is a measurement, not a lookup: run the same task at two or three levels, record the outcomes and the failures, and pick the lowest level whose failure mode you can accept. Running everything at maximum effort is a way of paying for depth you may not be using.

There is a second reason to prefer the lowest sufficient level. Where a free gateway endpoint is involved, the effort setting is often the difference between a usable trial and an exhausted rate limit, because the cost that the operator absorbs scales with the deliberation you request.

  • Define the quality bar for the task before testing effort levels.
  • Run the same task at two or three levels and record failures at each.
  • Choose the lowest level whose failure mode is acceptable.
03

Adaptive effort is coming, and it moves the problem

Analysts describe adaptive reasoning as a direction for 2026: models that adjust their effort based on how difficult a prompt appears, reserving deep deliberation for problems that need it rather than spending tokens on a simple request. For a caller, that is attractive because it removes a dial you would otherwise have to tune.

It also removes a dial you were measuring. If a model adapts its effort automatically, your recorded conditions become incomplete unless you can observe what it did — which means the useful things to measure change from 'which level did I request' to 'how many tokens did it spend and did the effort match the task'. Where the platform exposes that, record it. Where it does not, the honest position is that the condition is unknown.

  • Record whether the model adapts effort automatically or takes a fixed setting.
  • Where adaptation is automatic, record tokens spent per request alongside the outcome.
  • Flag requests where the observed effort did not match the task's difficulty.
04

Effort is a per-request decision, not a per-model one

The most useful framing is that effort belongs to the request, not the model choice. A classification or extraction step does not need deep deliberation; a planning or debugging step might. Choosing one model at one effort level for an entire workflow is a way of paying a single average for a distribution of very different tasks.

That also means the model comparison and the effort comparison are separate experiments, and conflating them produces a result you cannot interpret. Comparing two models at one effort level tells you about that configuration. Comparing one model at two levels tells you about the model's cost curve. Run them separately and keep the records apart.

Questions this note can answer

Useful boundaries, stated plainly.

Should I always use the highest reasoning effort?

Not necessarily. The highest level costs more in tokens and latency and only helps where the extra deliberation changes the outcome. The useful approach is to find your quality bar for a task and use the lowest effort setting that clears it, measured on your own workload.

Are effort levels comparable across models?

No. Different models expose different ranges and different numbers of levels, and the names are not standardised. A given level on one model is not equivalent to the same named level on another, which is why the level belongs in your recorded conditions.

Oryxen method

Oryxen publishes public research frameworks and makes their sources, uncertainty, and update triggers visible. This field note does not replace direct provider documentation or a team’s own technical, legal, security, financial, or operational evaluation.

Read methodology and corrections