ME AI message, observing Beating AI quick news: OpenRouter has launched the Jev Router, plugging TypeSafe’s Jev into the model routing pipeline. Before each round of requests is sent, Jev determines whether it needs to continue using, increase inference strength, or switch to a different model by assessing task difficulty, precision requirements, and whether the current model and inference settings (compute tier) are sufficient. OpenRouter’s original Auto Router is more geared toward selecting models based on the task type. It first figures out what kind of task it is, then refers to how each model was used in similar requests over the past 7 days to choose a route. The Jev Router, on the other hand, looks at how hard this specific round is. For simple tasks it can lower the tier, while for difficult problems it can increase reasoning effort; if the same model can still handle the task, it won’t rush to switch models. There’s also a very practical issue: context caching. In long conversations, once you switch models, the already-cached context usually can’t be reused directly, and the new model may need to reprocess the entire chat history. Jev Router accounts for this loss too. OpenRouter says it will only actually switch models when the expected benefit from switching outweighs the switching cost—and it will try to keep using the same model whenever possible. OpenRouter’s self-testing reports that across 423 tasks in 4 Agent benchmarks, the Jev Router completed 237, while the Auto Router completed 130—solving about 82% more tasks. In another 5 Agent benchmarks, its median latency for the first token is also lower than that of other routers participating in the tests. Similar ideas have appeared in the Jev community before. For example, `gholtzap/jev-codex-model-and-effort-router` first lets Jev have Codex choose a model and inference tier, then fixes the entire thread to reuse the cache; `Jev-Auto-Router` tries to reselect the model for each individual call. This time, OpenRouter has incorporated these approaches directly into its official routing service. (Source: ME)