Jev Gguf
4 curated entries tagged gguf.
All 4 Jev Gguf
Filter these entries by what they are called or what they do.
No entries match those filters.
None of the entries shown here match. 0 more carry this tag — browse all 4 in the directory.
- GGUF builds of the Jev-Style v3 decision model on Qwen3.5-0.8B: a 0.53 GB Q4_K_M file the card says is decision-identical to FP32 on 240/240 parity rows, served through a pinned llama.cpp scorer.Jev Models & Reimplementations#community#open-models#localCommunity
- An ultra-light Italian decision model: 400M Llama-based, a 465 MB Q8_0 GGUF, answering multiple choice with A–D tokens and booleans with TRUE/FALSE for edge and Rust use.Jev Models & Reimplementations#community#open-models#localCommunity
- An Apache-2.0 0.8B decision model that returns calibrated probabilities for yes/no, choice and score questions on CPU. Distributed as GGUF for llama.cpp and served behind a Jev-style /v1/systemone API, so existing Jev clients mostly need only a new base URL.Jev Models & Reimplementations#community#gguf#local-inferenceCommunity
kouhxp/gutsyHTML
- ggml's announcement that llama.cpp server supports decision models through a /v1/systemone endpoint: send a state and typed questions, get a probability per option from one forward pass. It lists six GGUF decision models from Julia-1 (144M) to OpenJev (27B) with single-question latencies.Jev Tools & CLIsArticle#community#llama-cpp#ggufCommunity
Jev articles
Original guides that mention Gguf.
Taking a decision checkpoint out of Python: what the GGUF and browser WebGPU exports preserve, what they change, and the parity evidence the model cards publish.
Jev Tools & CLIs#open-models#local#onnx
Read article