~ / serving-runtimes / serve-any-open-model / llama-cpp
llama.cpp
Native decision-model serving since PR #29818 (Oct 2): llama-server exposes /v1/systemone over GGUF checkpoints — Julia-1, Laya, Kev-4B, Lev, OpenJev 27B, with vision via Clef and later additions — one llama serve -hf ggml-org/Kev-4B-GGUF away on a laptop or CPU box. The inference stack underneath Ollama, now speaking the wire itself. Launch post
- section
- Serving & runtimes
- group
- Serve any open model
- source
- github.com
- added to list
- oct 29
No history yet: this chart appears once there are a few daily snapshots.