Benchmarks

Benchmark / 4 November 2026

Token Efficiency Frontier

A capability audit of eleven coding harnesses across 61 shell and read behaviors. Midas captures 98.2% of the 659,000 token-efficiency ceiling, with 58 of 61 capabilities shipped by default.

What this measures

This is a capability audit, not a task benchmark. Each row is a tool behavior, such as a bounded read window or a wait mode on a background process. Each row records whether a harness ships the behavior in its default configuration.

The rubric has 61 rows: 24 for the shell and 37 for the read. Every harness was scored against the same rows and the same weights. A full cell means the behavior ships, a half cell means partial or behind a flag, and an empty cell means the behavior was not found.

This page does not run GitHub issues, a repository, or a test suite.

The frontier

The x-axis ranks the 61 capabilities from the most modeled savings to the least. The y-axis adds them up as you move right, so each step is one capability's weight. It is a log scale on the gap to 100%, so the top of the field is readable. The dashed line at the top is 100%, or every capability shipped.

The leading line is the frontier: the most savings any harness captures at each step. Midas holds it and ends at 98.2%. Command Code is next at 95.9%. Hermes follows at 77.8%.

The distance between a line and the ceiling is the savings that harness leaves unclaimed. The log scale spreads the top of the field. The first capabilities carry most of the weight, so one missing expensive behavior costs more than several missing cheap ones. The gap between Midas and Command Code is the lead.

Token efficiency frontier

61 shell and read capabilities, ranked by modeled savings

Capability audit · Nov 04, 2026 · 11 harnesses · 659,000 token ceiling

CapabilitiesShare of ceilingLog scale
Series:MidasCommand CodeHermesClaude CodeSeven others
Token-efficiency frontier across 61 capabilitiesCumulative modeled tokens saved per million tokens of tool traffic for eleven coding harnesses, ranked by capability weight. The y-axis is a log scale on the gap to the 659,000 ceiling. Midas reaches 98.2 percent of the ceiling.UNCLAIMED SAVINGS99%98%95%90%75%50%0%100% CEILINGSHARE OF CEILINGMidas98.2%Command Code95.9%Hermes77.8%Claude Code62.6%161 CAPABILITIES, RANKED BY MODELED SAVINGS

Share of the 659,000 ceiling. Log scale on the gap to 100%.

Audit date: 4 November 2026

The weights estimate the tokens each behavior saves per million tokens of tool traffic.

The field

This ranked list uses the same scores. The bar is the share of the 659,000 ceiling each harness captures. The evidence table later splits the score into the shell and read tools.

  1. 01Midas98.2
  2. 02Command Code95.9
  3. 03Hermes77.8
  4. 04Claude Code62.6
  5. 05OpenClaw55.4
  6. 06Grok Build52.3
  7. 07Cline45.6
  8. 08Kilo Code44.9
  9. 09OpenCode34.9
  10. 10Codex27.6
  11. 11pi22.1

For task outcomes rather than tool-surface grades, see the Terminal-Bench 2.1 page.

Where the gap comes from

The matrix shows all 61 rows as cells. Midas is nearly solid. Codex is strong on the shell and almost empty on the read side, which is the large empty block in its row. That gap pulls its frontier line down.

Shell / 2424 capabilities
Midas
Command Code
Hermes
Claude Code
OpenClaw
Grok Build
Cline
Kilo Code
OpenCode
Codex
pi
Read / 3737 capabilities
Midas
Command Code
Hermes
Claude Code
OpenClaw
Grok Build
Cline
Kilo Code
OpenCode
Codex
pi
ShippedPartialNot found

The evidence

Every harness is pinned to a version and a commit. Open a version to read the evidence behind each cell.

HarnessVersionAllFull
Midas0.1.8598.258/61
Command Code1.88.295.954/61
Hermesdce2ecb77.840/61
Claude Code2.1.31162.629/61
OpenClaw0a6c01355.424/61
Grok Buildbc7f02e52.322/61
Cline48d638545.616/61
Kilo Code5e0282544.923/61
OpenCode10765ff34.915/61
Codex88f776527.610/61
pi853a80d22.110/61

How this was measured

The audit covers 61 capabilities across 11 harnesses, with a modeled ceiling of 659,000 tokens and zero model calls. This page grades whether a harness ships a tool behavior. It does not run a repository or a test suite.

Most public comparisons measure model quality. The harness is where the token bill is decided, so this audit grades the tool surface directly, with evidence a reader can check.

The rubric covers 61 capabilities: 24 for the shell and 37 for the read. Every harness was scored against the same rows and the same rules.

Each row carries a weight, the modeled tokens it saves per 1M tokens of tool traffic. The weights sum to 659,000, the ceiling. A harness that ships every row captures all of it.

Open harnesses were read at the pinned commits in the table. Two ship compiled bundles, so those columns come from the bundle and the published documentation.

Every positive cell in the raw sheets carries a file and line, a bundle offset, or a probe transcript, so you can check the score.

Row definitions follow Command Code's Token Efficiency Frontier benchmark, published in August 2026.

Run the audit

The rubric and all eleven score sheets are published with this page. The verifier recomputes every total from them and compares the result to the table above.

curl -fsSLO https://trymidas.io/benchmarks/verify.mjs
node verify.mjs

It reads rubric.json and the sheet behind each version, then prints the same shell, read, and all scores. A mismatch exits non-zero.

Node 20 or later. The script itself is verify.mjs.

Use Midas

This audit is not a product trial. To use Midas on your own repository, install it with one command, then start it in your project.

Audit date: 4 November 2026. The Midas row is version 0.1.85.