ihateninjas/ollama
1
0
Fork 0
mirror of https://github.com/ollama/ollama synced 2026-04-24 09:14:37 +00:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity
4950 commits 387 branches 510 tags 354 MiB
Commit graph

5 commits

Author SHA1 Message Date
Michael Yang 440a3823a6
fix(tokenizer): add special tokens to empty inputs (#13091) 2025-11-18 11:16:56 -08:00
Michael Yang 3f6642f6fc
model: implement bert in ollama engine (#9080) 
* fix truncate

* s/SentencePieceModel/SentencePiece/

* bert

* wordpiece

* refactor pooling

* more tokenizers

* normalize embeddings
 2025-09-15 15:35:59 -07:00
Michael Yang 5994e8e8fd
embedding gemma model (#12181) 
* ollama: add embeddings
 2025-09-04 09:09:07 -07:00
Michael Yang fb92b61754
logutil: add Trace and TraceContext helpers (#12110) 2025-09-02 13:09:12 -07:00
Michael Yang 333e360422
model: handle multiple eos tokens (#10577) 
* get eos_token_id from generation_config.json

* refactor

* include both ids and strings in trace

* comments

* remove special case for gemma3 special vocab (#10743)
 2025-05-16 13:40:23 -07:00
Renamed from model/process_text_spm.go (Browse further)