ollama/x/mlxrunner/mlx
Daniel Hiltgen 8968740836
mlx: Improve M5 performance with NAX (#15345)
* mlx: Improve M5 performance with NAX

This modifies the Mac release to now have 2 builds of MLX for broader
compatibility while supporting the latest M5 hardware features.  NAX requires
building with xcode 26.2 and targetting support only for OS v26 and up.  Since
we want to support older MacOS versions as well, we now need 2 different MLX
builds and runtime detection logic to select the optimal version.  The newer
build will detect NAX missing at runtime, so it is safe to run on pre M5 macs.

* mac: prevent generate on cross-compiles

For some versions of Xcode, cmake builds are failing due to header problems in
cross-compiling during the generate phase.  Since generate is producing arch
independent generated output, we can skip this during cross-compiling.
2026-04-07 08:12:24 -07:00
..
generator ci: Fix windows build (#14754) 2026-03-09 19:27:59 -07:00
include/mlx/c mlx: update as of 3/23 (#14789) 2026-03-23 11:28:44 -07:00
.gitignore Add MLX runner with GLM4-MoE-Lite model support (#14185) 2026-02-10 14:57:57 -08:00
act.go MLX: add header vendoring and remove go build tag (#14642) 2026-03-09 17:24:45 -07:00
array.go mlx: fix KV cache snapshot memory leak 2026-03-25 17:26:34 -07:00
array_test.go MLX: add header vendoring and remove go build tag (#14642) 2026-03-09 17:24:45 -07:00
CMakeLists.txt mlx: update as of 3/23 (#14789) 2026-03-23 11:28:44 -07:00
dtype.go MLX: add header vendoring and remove go build tag (#14642) 2026-03-09 17:24:45 -07:00
dynamic.c mlx: remove noisy error output from dynamic library loading (#14346) 2026-02-20 23:46:07 -08:00
dynamic.go mlx: Improve M5 performance with NAX (#15345) 2026-04-07 08:12:24 -07:00
dynamic.h MLX: add header vendoring and remove go build tag (#14642) 2026-03-09 17:24:45 -07:00
dynamic_darwin.go mlx: Improve M5 performance with NAX (#15345) 2026-04-07 08:12:24 -07:00
dynamic_other.go mlx: Improve M5 performance with NAX (#15345) 2026-04-07 08:12:24 -07:00
fast.go MLX: add header vendoring and remove go build tag (#14642) 2026-03-09 17:24:45 -07:00
gated_delta.go mlx: update as of 3/23 (#14789) 2026-03-23 11:28:44 -07:00
generated.c mlx: update as of 3/23 (#14789) 2026-03-23 11:28:44 -07:00
generated.h mlx: update as of 3/23 (#14789) 2026-03-23 11:28:44 -07:00
io.go mlx: add mxfp4/mxfp8/nvfp4 importing (#15015) 2026-03-24 13:45:44 -07:00
memory.go MLX: add header vendoring and remove go build tag (#14642) 2026-03-09 17:24:45 -07:00
mlx.go mlx: update as of 3/23 (#14789) 2026-03-23 11:28:44 -07:00
nn.go MLX: add header vendoring and remove go build tag (#14642) 2026-03-09 17:24:45 -07:00
ops.go MLX: add header vendoring and remove go build tag (#14642) 2026-03-09 17:24:45 -07:00
ops_extra.go mlx: fix KV cache snapshot memory leak 2026-03-25 17:26:34 -07:00
random.go MLX: add header vendoring and remove go build tag (#14642) 2026-03-09 17:24:45 -07:00
slice.go mlxrunner: fix Slice(0, 0) returning full dimension instead of empty 2026-03-18 16:06:33 -07:00
stream.go MLX: add header vendoring and remove go build tag (#14642) 2026-03-09 17:24:45 -07:00