~ / evaluation / class-native-suites / pws-decisions
PWS-Decisions
Parallel's benchmark for the axis no other suite measures: 300 closed-ended questions whose answers depend on current, niche, or scattered live-web facts, each confirmed against a direct source, scored by exact match — with runnable code (MIT) and the dataset on Hugging Face. First-party, and Parallel tops its own board (76.2% vs OpenAI Decisions' 41.7% and Jev's 33.4%) — but the honest framing is in the cross-check: on JevBench's public set the same three sit within 1.7 points, so the spread is web grounding, not decision skill. A JevBench score cannot tell you what happens when the answer isn't in the prompt.
- section
- Evaluation
- group
- Class-native suites
- source
- github.com
- repo
- parallel-web/pws-decisions-benchmark
- stars
- 2 ▕█░░░░░░░░░░░▏
- 7-day gain
- 0
- forks
- 0
- language
- Python
- license
- MIT
- last pushed
- nov 2
- added to list
- nov 2
## history
2026-11-010 → 2 stars2026-11-14
2026-11-030 → 0 forks2026-11-14
2026-11-031 → 1 open issues2026-11-14