▌system-one

~ / serving-runtimes / serve-any-open-model / llama-cpp

llama.cpp

Native decision-model serving since PR #29818 (Oct 2): llama-server exposes /v1/systemone over GGUF checkpoints — Julia-1, Laya, Kev-4B, Lev, OpenJev 27B, with vision via Clef and later additions — one llama serve -hf ggml-org/Kev-4B-GGUF away on a laptop or CPU box. The inference stack underneath Ollama, now speaking the wire itself. Launch post

section
Serving & runtimes
group
Serve any open model
source
github.com
added to list
oct 29

No history yet: this chart appears once there are a few daily snapshots.

also in Serve any open model