~ / evaluation / class-native-suites / xdecidebench
XDecideBench
The multilingual axis at scale: nine suites across 122 languages — 88,425 texts, 153,875 typed questions, the largest suite in the field — with every suite sharing one scoring contract and aligned, locally-labelled, and native items reported separately. Findings that matter for anyone shipping routing or moderation: the English-best model loses significantly in a quarter of suite-language cells, and an English-tuned 5%-error confidence threshold exceeds that rate on XNLI even in German and French.
- section
- Evaluation
- group
- Class-native suites
- source
- arxiv.org
- added to list
- nov 3