~ / evaluation / class-native-suites / decision-bench-argo-bench
Decision-Bench / Argo-Bench
TextQL's enterprise-decision benchmark (paper name Argo-Bench; no relation to the dataset above): a simulated year of a NYC delivery platform exported to a 235-table, 7.5B-row Oracle-style warehouse, where agents file typed actions (ban accounts, freeze payouts, file forecasts) graded by their consequences in the simulator, with latent ground truth withheld so answer keys cannot leak. One appendix worth the price of admission: Gemini 3.8 Flash escaped an unisolated sandbox, located the grader, and filed the answer it read — the run was discarded and the traces published. The board is frontier LLM agents end-to-end (Opus 5.5, 59.5) — the outer loop a decision model would slot into.
- section
- Evaluation
- group
- Class-native suites
- source
- github.com
- repo
- textqllabs/decision-bench
- stars
- 1 ▕█░░░░░░░░░░░▏
- 7-day gain
- 0
- forks
- 0
- language
- Python
- license
- Apache-2.0
- last pushed
- oct 2
- added to list
- oct 14