ollama/server
Daniel Hiltgen 3258a89b6e
DRY out the runner lifecycle code (#12540)
* DRY out the runner lifecycle code

Now that discovery uses the runners as well, this unifies the runner spawning code
into a single place.  This also unifies GPU discovery types with the newer ml.DeviceInfo

* win: make incremental builds better

Place build artifacts in discrete directories so incremental builds don't have to start fresh

* Adjust sort order to consider iGPUs

* handle cpu inference oom scenarios

* review comments
2025-10-23 11:20:02 -07:00
..
internal refactor: use the built-in max/min to simplify the code (#12280) 2025-09-16 17:14:21 -07:00
auth.go
create.go engine: add remote proxy (#12307) 2025-09-17 14:40:53 -07:00
create_test.go engine: add remote proxy (#12307) 2025-09-17 14:40:53 -07:00
download.go server: abort download on empty digest 2025-05-27 11:28:48 -07:00
fixblobs.go
fixblobs_test.go
images.go templates: fix crash in improperly defined templates (#12483) 2025-10-02 17:25:55 -07:00
images_test.go Reapply "feat: incremental gguf parser (#10822)" (#11114) (#11119) 2025-06-20 11:11:40 -07:00
layer.go
manifest.go
manifest_test.go
model.go tools: refactor tool call parsing and enable streaming (#10415) 2025-05-23 14:19:31 -07:00
modelpath.go server: add hint to the error message when model path access fails (#10843) 2025-05-24 13:17:04 -07:00
modelpath_test.go lint: enable usetesting, disable tenv (#10594) 2025-05-08 11:42:14 -07:00
prompt.go add registries for parsers/renderers 2025-10-14 01:13:54 -07:00
prompt_test.go Reapply "add truncate and shift parameters" (#12582) 2025-10-11 16:06:14 -07:00
quantization.go skip quantizing per_layer_token_embd (#11207) 2025-06-26 21:49:35 -07:00
quantization_test.go Reapply "feat: incremental gguf parser (#10822)" (#11114) (#11119) 2025-06-20 11:11:40 -07:00
routes.go cloud: don't error sending empty messages (#12724) 2025-10-21 18:12:14 -07:00
routes_create_test.go fs(ggml): fill in arch prefix if necessary (#12646) 2025-10-20 16:42:18 -07:00
routes_debug_test.go DRY out the runner lifecycle code (#12540) 2025-10-23 11:20:02 -07:00
routes_delete_test.go fs(ggml): fill in arch prefix if necessary (#12646) 2025-10-20 16:42:18 -07:00
routes_generate_renderer_test.go DRY out the runner lifecycle code (#12540) 2025-10-23 11:20:02 -07:00
routes_generate_test.go DRY out the runner lifecycle code (#12540) 2025-10-23 11:20:02 -07:00
routes_harmony_streaming_test.go DRY out the runner lifecycle code (#12540) 2025-10-23 11:20:02 -07:00
routes_list_test.go
routes_test.go engine: add remote proxy (#12307) 2025-09-17 14:40:53 -07:00
sched.go DRY out the runner lifecycle code (#12540) 2025-10-23 11:20:02 -07:00
sched_test.go DRY out the runner lifecycle code (#12540) 2025-10-23 11:20:02 -07:00
sparse_common.go
sparse_windows.go
upload.go