▌system-one

~ / serving-runtimes / serve-any-open-model / sglang

SGLang

Native decision-model serving since v0.5.21 (Oct 2, merged upstream Sept 25): both a /v1/decisions endpoint that converts any Jinja-templated chat model into a decision model and a /v1/systemone endpoint speaking the exact TypeSafe wire — official SDKs work by repointing the base URL. Any served generation model qualifies (validated on Qwen3.8-27B and Qwen3.5-35B-A3B, sub-100 ms decisions), no decision-specific training required. At ~38.6K stars the largest runtime the list covers; the stack xor pins its serving bundle to and openjev-sglang wraps, now first-class.

section
Serving & runtimes
group
Serve any open model
source
lmsysorg.mintlify.app
added to list
nov 10

also in Serve any open model