~ / evaluation / class-native-suites / opendecisions
OpenDecisions
2,352-question validation set built to mirror JevBench's task mix, released with Releasing the Inner Jev (Geuter, Cheng & Alvarez-Melis) — the paper showing plain instruction-tuned Gemma 4 31B, read through its output logits with no training, already scores 79.6 to Jev's 80.1, and that a simple fine-tuning recipe lifts it to 84.4 here and 81.5 on JevBench v1.7, past Jev. Models and serving code ship with the set.
- section
- Evaluation
- group
- Class-native suites
- source
- arxiv.org
- added to list
- oct 29