Flide

Decision-model inference engine from the OneJev authors, now with the class's first serving paper (arXiv 2610.42148, NUS): exact state forking — each question reuses the shared state's computation in a separate forward pass, giving up to 9.5× over vLLM and SGLang with answers bit-identical to the question alone, and flide verify checks that on your own model. Serves 30+ model families through /v1/systemone with per-model speed tables published (Clef 1.3× through Kev ~7.9× and OneJev ~6.8×; multi-request batching, session caching for agents, FP8). The email triage demo is the class's best throughput number: 10,000 emails × 8 questions in 28 s on one H200. Apache 2.0, pip install flide, ~318 stars.