~ / evaluation / class-native-suites / decisionpivot
DecisionPivot
StartLux's diagnostic benchmark (renamed from DecideBench on Oct 14, item hashes preserved) for the control points where decision models sit in LLM systems: contrast groups of 2–4 items identical except one decisive detail, scored on pair accuracy, confident errors, calibration, and automation at a fixed 5% error rate, with accuracy also read at a 0.90 probability threshold. Releases ship SHA-256 item hashes and items found in StartLux-Decision's own training data are removed from the reference track — first-party, but built with the contamination discipline of an independent bench. Paper.
- section
- Evaluation
- group
- Class-native suites
- source
- github.com
- repo
- startluxlabs/decisionpivot
- stars
- 154 ▕██████░░░░░░▏
- 7-day gain
- 0
- forks
- 3
- language
- Python
- license
- Apache-2.0
- last pushed
- oct 21
- added to list
- oct 27
## history
2026-10-110 → 154 stars2026-11-14
2026-10-272 → 3 forks2026-11-14
2026-10-270 → 0 open issues2026-11-14