ollama/runner
Dhiraj Lochib 3590fbfa76
runner: fix typo 'baackend' -> 'backend' in error messages (#13645)
Fix typo in three error messages where 'baackend' was written instead
of 'backend' in the /health endpoint handler when initializing the
dummy model load.
2026-01-31 13:26:20 -08:00
..
common server: add logprobs and top_logprobs support to Ollama's API (#12899) 2025-11-11 08:49:50 -08:00
llamarunner flash attn: add auto mode for llama engine (#13052) 2025-12-12 13:27:19 -08:00
ollamarunner runner: fix typo 'baackend' -> 'backend' in error messages (#13645) 2026-01-31 13:26:20 -08:00
README.md Runner for Ollama engine 2025-02-13 17:09:26 -08:00
runner.go Add z-image image generation prototype (#13659) 2026-01-09 21:09:46 -08:00

runner

Note: this is a work in progress

A minimial runner for loading a model and running inference via a http web server.

./runner -model <model binary>

Completion

curl -X POST -H "Content-Type: application/json" -d '{"prompt": "hi"}' http://localhost:8080/completion

Embeddings

curl -X POST -H "Content-Type: application/json" -d '{"prompt": "turn me into an embedding"}' http://localhost:8080/embedding