~ / evaluation / leaderboards-indexes / artificial-analysis-decision-index
Artificial Analysis Decision Index
The mainstream benchmarking site's index, rebuilt as v2.1 on Nov 8: 19 decision models over six weighted evals — AA-Paperclip (private documents, 30%), TypeSafe's O*NET, When2Call, a private AA-Omniscience adaptation, HLE-MultiChoice with an abstain option, and AA-Symmetry, which checks a decision holds when options move, reword, or the question negates (15%) — scored as accuracy-minus-Brier per answer. The Nov 11 standings put Nace's Drex Max v1.1 first, SubQ Snap 1.2 second, GLiDE v1.2 third, mammoth-1 fourth, d1-ultra fifth, and Jev 1.14 eighth, with Gemini Decision 1 ninth in its first independent row; language models shown as the trailing baseline.
- section
- Evaluation
- group
- Leaderboards & indexes
- source
- artificialanalysis.ai
- added to list
- oct 15