no metadata for merging

#1
by fuckfuckyou11 - opened

When I try to merge Q8 in one file by command:

./gguf-split --merge Qwen2-VL-72B-Instruct-abliterated.Q8_0.gguf.part1of2 outputfile.gguf

it says:
gguf_merge: reading metadata Qwen2-VL-72B-Instruct-abliterated.Q8_0.gguf.part1of2 ...
gguf_merge: input file does not contain split.count metadata

This command worked before with many split files but not with yours, why?

You need to use cat or some equivalent, as explained in the model card. The files are not gguf-splits, but literally split files. You can also use our downloader which concatenates the parts for you while downloading (we'll put a link to it into the model cards soon): https://hf.tst.eu/model#Qwen2-VL-72B-Instruct-abliterated-i1-GGUF

mradermacher changed discussion status to closed

Sign up or log in to comment