MMDM

Massive Multitask Decision Making (Nov 10): 5,448 fresh questions across 16 categories built to dodge prior benchmark exposure — contexts to 64,817 tokens, option spaces from 2 to 1,024. Headline findings: hard single-select tops out at 76% (WeMM-JEV 27B), and no model exceeds 36.81% on hard multi-select — first hard evidence of a multi-select ceiling in the class.