▌system-one

~ / evaluation / class-native-suites / pws-decisions

PWS-Decisions

Parallel's benchmark for the axis no other suite measures: 300 closed-ended questions whose answers depend on current, niche, or scattered live-web facts, each confirmed against a direct source, scored by exact match — with runnable code (MIT) and the dataset on Hugging Face. First-party, and Parallel tops its own board (76.2% vs OpenAI Decisions' 41.7% and Jev's 33.4%) — but the honest framing is in the cross-check: on JevBench's public set the same three sit within 1.7 points, so the spread is web grounding, not decision skill. A JevBench score cannot tell you what happens when the answer isn't in the prompt.

section
Evaluation
group
Class-native suites
source
github.com
repo
parallel-web/pws-decisions-benchmark
stars
2 ▕█░░░░░░░░░░░▏
7-day gain
0
forks
0
language
Python
license
MIT
last pushed
nov 2
added to list
nov 2

## history

2026-11-010 → 2 stars2026-11-14
2026-11-030 → 0 forks2026-11-14
2026-11-031 → 1 open issues2026-11-14

also in Class-native suites