ihateninjas/ollama
1
0
Fork 0
mirror of https://github.com/ollama/ollama synced 2026-04-26 02:04:29 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
4950 commits 388 branches 511 tags 363 MiB
Commit graph

229 commits

Author SHA1 Message Date
Michael Yang b71c67b6ba allocate a large enough tokens slice 2023-07-21 23:05:15 -07:00
Michael Yang 8526e1f5f1 add llama.cpp mpi, opencl files 2023-07-20 14:19:55 -07:00
Michael Yang a83eaa7a9f update llama.cpp to e782c9e735f93ab4767ffc37462c523b73a17ddc 2023-07-20 11:55:56 -07:00
Michael Yang 5156e48c2a add script to update llama.cpp 2023-07-20 11:54:59 -07:00
Michael Yang 40c9dc0a31 fix multibyte responses 2023-07-14 20:11:44 -07:00
Michael Yang 0142660bd4 size_t 2023-07-14 17:29:16 -07:00
Michael Yang 1775647f76 continue conversation 
feed responses back into the llm
 2023-07-13 17:13:00 -07:00
Michael Yang 05e08d2310 return more info in generate response 2023-07-13 09:37:32 -07:00
Michael Yang e1f0a0dc74 fix eof error in generate 2023-07-12 09:36:16 -07:00
Jeffrey Morgan c63f811909 return error if model fails to load 2023-07-11 20:32:26 -07:00
Jeffrey Morgan 7c71c10d4f fix compilation issue in Dockerfile, remove from README.md until ready 2023-07-11 19:51:08 -07:00
Jeffrey Morgan e64ef69e34 look for ggml-metal in the same directory as the binary 2023-07-11 15:58:56 -07:00
Michael Yang 442dec1c6f vendor llama.cpp 2023-07-11 11:59:18 -07:00
Michael Yang fd4792ec56 call llama.cpp directly from go 2023-07-11 11:59:18 -07:00
Jeffrey Morgan 268e362fa7 fix binding build 2023-07-10 11:33:43 -07:00
Jeffrey Morgan a18e6b3a40 llama: remove unnecessary std::vector 2023-07-09 10:51:45 -04:00
Jeffrey Morgan 5fb96255dc llama: remove unused helper functions 2023-07-09 10:25:07 -04:00
Patrick Devine 3f1b7177f2 pass model and predict options 2023-07-07 09:34:05 -07:00
Michael Yang 5dc9c8ff23 more free 2023-07-06 17:08:03 -07:00
Bruce MacDonald da74384a3e remove prompt cache 2023-07-06 17:49:05 -04:00
Michael Yang 2c80eddd71 more free 2023-07-06 16:34:44 -04:00
Jeffrey Morgan 9fe018675f use Makefile for dependency building instead of go generate 2023-07-06 16:34:44 -04:00
Michael Yang 1b7183c5a1 enable metal gpu acceleration 
ggml-metal.metal must be in the same directory as the ollama binary
otherwise llama.cpp will not be able to find it and load it.

1. go generate llama/llama_metal.go
2. go build .
3. ./ollama serve
 2023-07-06 16:34:44 -04:00
Jeffrey Morgan 0998d4f0a4 remove debug print statements 2023-07-06 16:34:44 -04:00
Jeffrey Morgan 79a999e95d fix crash in bindings 2023-07-06 16:34:44 -04:00
Jeffrey Morgan fd962a36e5 client updates 2023-07-06 16:34:44 -04:00
Jeffrey Morgan 0240165388 fix llama.cpp build 2023-07-06 16:34:44 -04:00
Jeffrey Morgan 9164981d72 move prompt templates out of python bindings 2023-07-06 16:34:44 -04:00
Jeffrey Morgan 6093a88c1a add llama.cpp go bindings 2023-07-06 16:34:44 -04:00