▌system-one

~ / evaluation / class-native-suites / opendecisions

OpenDecisions

2,352-question validation set built to mirror JevBench's task mix, released with Releasing the Inner Jev (Geuter, Cheng & Alvarez-Melis) — the paper showing plain instruction-tuned Gemma 4 31B, read through its output logits with no training, already scores 79.6 to Jev's 80.1, and that a simple fine-tuning recipe lifts it to 84.4 here and 81.5 on JevBench v1.7, past Jev. Models and serving code ship with the set.

section
Evaluation
group
Class-native suites
source
arxiv.org
added to list
oct 29

also in Class-native suites