ollama/x/mlxrunner/sample
Jesse Gross 24e038d56a mlxrunner: add logprobs support
Match the ollamarunner and OpenAI semantics: raw, full-vocab log-softmax
with the top-K ranked by probability. Skipped on the GPU when the request
doesn't ask for logprobs so decode doesn't pay for it otherwise.
2026-04-20 17:43:00 -07:00
..
logprob_test.go mlxrunner: add logprobs support 2026-04-20 17:43:00 -07:00
sample.go mlxrunner: add logprobs support 2026-04-20 17:43:00 -07:00
sample_test.go mlxrunner: add logprobs support 2026-04-20 17:43:00 -07:00