~ / serving-runtimes / serve-any-open-model / ollama
Ollama
Native decision-model support since 0.35.0: /v1/systemone on localhost speaks the Jev API shape, so the official TypeSafe SDK works by repointing it. ollama pull serves Nimble 9B, Tev1, d1, Clef and Clef-Flash, and pplx-decider, with base64 images on the multimodal ones; the honest limits are published too — a 64 KiB request cap, no streaming, and a confidence score that measures distribution peakedness, not calibrated correctness. The launch post demos Pac-Man on Nimble at ~91 ms per decision on a laptop.
- section
- Serving & runtimes
- group
- Serve any open model
- source
- docs.ollama.com
- added to list
- oct 24