File size: 186 Bytes
b4ed5ff
b40e25f
 
 
 
 
1
2
3
4
5
6
https://github.com/ggerganov/llama.cpp/releases/tag/b3389

 re-conversion 

 makes Gemma and Gemma-2 tokenize pretty much EVERYTHING correctly,
including HTML tags and consecutive spaces