Code Mode and rtk were cheaper than plain Claude Code in every session
- Plain Claude Code$5.87
- Code Mode$4.40
- rtk$4.64
Code Mode and rtk were cheaper than plain Claude Code in every session
OpenAI Decisions API beats Jev on real-world checks
Frontier LLMs are up to 22 points more accurate than Jev, but cost over 100x more
Gemma 4 31B leaves the least PII in on the LangWatch policy test
Frontier LLMs beat Jev on 9 of 11 tasks
Open models caught up with Jev
Jev beats every tiny open model
Each bar is a score with its 95% interval. Orange: ahead alone. Green: tied for the lead. Gray: the rest. Hatched with *: trained on the test data, so not ranked. Average: the unweighted mean of a model's task scores; tasks use different metrics, so read it as a summary, not a ranking.