~ / reading / jev-under-the-microscope / jev-vs-llms-as-rubric-judges-cheaper-faster-and
JEV vs. LLMs as Rubric Judges: Cheaper, Faster, and Wrong in the Same Places
Rao & Callison-Burch (2026). The counterpoint to the cascade story: Jev is 29–325× cheaper and competitive on binary criteria, but LLM judges repeat nearly all of its most confident errors, capping escalation gains at ~1.5 points.
- section
- Reading
- group
- Jev under the microscope
- source
- arxiv.org
- added to list
- sep 26