▌system-one

~ / evaluation / class-native-suites / decisionpivot

DecisionPivot

StartLux's diagnostic benchmark (renamed from DecideBench on Oct 14, item hashes preserved) for the control points where decision models sit in LLM systems: contrast groups of 2–4 items identical except one decisive detail, scored on pair accuracy, confident errors, calibration, and automation at a fixed 5% error rate, with accuracy also read at a 0.90 probability threshold. Releases ship SHA-256 item hashes and items found in StartLux-Decision's own training data are removed from the reference track — first-party, but built with the contamination discipline of an independent bench. Paper.

section
Evaluation
group
Class-native suites
source
github.com
repo
startluxlabs/decisionpivot
stars
154 ▕██████░░░░░░▏
7-day gain
0
forks
3
language
Python
license
Apache-2.0
last pushed
oct 21
added to list
oct 27

## history

2026-10-110 → 154 stars2026-11-14
2026-10-272 → 3 forks2026-11-14
2026-10-270 → 0 open issues2026-11-14

also in Class-native suites