Hugging Face's logo

NousResearch
/
Hermes-2-Pro-Llama-3-8B-GGUF

GGUF
English
Llama-3
instruct
finetune
chatml
DPO
RLHF
gpt4
synthetic data
distillation
function calling
json mode
Inference Endpoints
conversational
Model card Files Community
4

Bug with GGUF and Llama3

#3
by synbiotik - opened
Discussion
synbiotik

llama 3 bug found with gguf losing data part 1
part 2
part 3
github ticket

bartowski

You forgot part 4:

https://www.reddit.com/r/LocalLLaMA/comments/1cn1398/part_4_theres_likely_no_llamacpp_gguf_tokenizer/

quanthunter

Does reconverting into gguf with latest llama.cpp solve this issue?

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment