ihateninjas/ollama
1
0
Fork 0
mirror of https://github.com/ollama/ollama synced 2026-05-12 18:16:01 +00:00
Code Issues Actions 5 Packages Projects Releases Wiki Activity
4950 commits 397 branches 540 tags 374 MiB
Commit graph

421 commits

Author SHA1 Message Date
Bruce MacDonald f5e2e150b8 allow overriding default generate options 2023-07-10 20:58:02 +02:00
Jeffrey Morgan 74e92d1258 add basic / route for server 2023-07-07 23:46:15 -04:00
Bruce MacDonald f533f85d44 pr feedback 
- move error check to api client pull
- simplify error check in generate
- return nil on any pull error
 2023-07-07 17:12:02 -04:00
Bruce MacDonald 61dd87bd90 if directory cannot be resolved, do not fail 2023-07-07 15:27:43 -04:00
Patrick Devine 3f1b7177f2 pass model and predict options 2023-07-07 09:34:05 -07:00
Michael Yang b0618a466e generate progress 2023-07-06 17:07:40 -07:00
Michael Yang 15c114decb fix prompt templates 2023-07-06 17:03:18 -07:00
Michael Yang 0637632258 simple pull response 2023-07-06 16:34:44 -04:00
Michael Yang dd960d1d5e update generate response 2023-07-06 16:34:44 -04:00
Michael Yang 9b8a456c7d embed templates 2023-07-06 16:34:44 -04:00
Bruce MacDonald 7cf5905063 display pull progress 2023-07-06 16:34:44 -04:00
Michael Yang 580fe8951c free llama model 2023-07-06 16:34:44 -04:00
Michael Yang 68e6b4550c use prompt templates 2023-07-06 16:34:44 -04:00
Bruce MacDonald a6494f8211 pull models 2023-07-06 16:34:44 -04:00
Michael Yang 1b7183c5a1 enable metal gpu acceleration 
ggml-metal.metal must be in the same directory as the ollama binary
otherwise llama.cpp will not be able to find it and load it.

1. go generate llama/llama_metal.go
2. go build .
3. ./ollama serve
 2023-07-06 16:34:44 -04:00
Jeffrey Morgan 0998d4f0a4 remove debug print statements 2023-07-06 16:34:44 -04:00
Bruce MacDonald 8ea5e5e147 separate routes 2023-07-06 16:34:44 -04:00
Jeffrey Morgan fd962a36e5 client updates 2023-07-06 16:34:44 -04:00
Jeffrey Morgan 9164981d72 move prompt templates out of python bindings 2023-07-06 16:34:44 -04:00
Jeffrey Morgan 6093a88c1a add llama.cpp go bindings 2023-07-06 16:34:44 -04:00
Jeffrey Morgan 76cb60d496 wip go engine 
Co-authored-by: Patrick Devine <pdevine@sonic.net>
 2023-07-06 16:34:44 -04:00