mirror of
https://github.com/ollama/ollama
synced 2026-04-23 08:45:14 +00:00
The CLI now links to the lazy-load MLX code, but that still happens in init functions. On internal MLX errors, the CLI exits before it has a chance to start. This change re-wires the MLX error handling so it doesn't exit by default. The MLX based runners currently expect exits on failure, so they re-initialize the default error handling. We can refine error handling for better go stack traces in the future. |
||
|---|---|---|
| .. | ||
| generate.go | ||
| image.go | ||
| main.go | ||
| README.md | ||
| sample.go | ||
MLX Engine
Experimental MLX backend for running models on Apple Silicon and CUDA.
Build
go build -o engine ./x/imagegen/cmd/engine
Text Generation
Text generation models are no longer supported by this engine.
Image Generation
./engine -zimage -model /path/to/z-image -prompt "a cat" -output cat.png
Options:
-width,-height- image dimensions (default 1024x1024)-steps- denoising steps (default 9)-seed- random seed (default 42)