ULTRABENCH Created by Iternal Technologies, the AI Strategy Experts

SWE-Marathon v1.1 (Partial Score)

SWE-Marathon v1.1 (Partial Score): every model scored on it, ranked, with a source on every score, and the current models not yet covered.

Models scored
1 model
Unit
percent
Tier
provisional

All benchmarks