mradermacher
/

Llama-3.1-Nemotron-70B-Instruct-HF-abliterated-GGUF

Inference Endpoints

Model card Files Files and versions Community

mradermacher commited on 21 days ago

Commit

249a3fa

•

1 Parent(s): 8c71c41

auto-patch README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -21,7 +21,7 @@ tags:
 static quants of https://huggingface.co/huihui-ai/Llama-3.1-Nemotron-70B-Instruct-HF-abliterated
 <!-- provided-files -->
-weighted/imatrix quants seem not to be available (by me) at this time. If they do not show up a week or so after the static ones, I have probably not planned for them. Feel free to request them by opening a Community Discussion.
 ## Usage
 If you are unsure how to use GGUF files, refer to one of [TheBloke's

 static quants of https://huggingface.co/huihui-ai/Llama-3.1-Nemotron-70B-Instruct-HF-abliterated
 <!-- provided-files -->
+weighted/imatrix quants are available at https://huggingface.co/mradermacher/Llama-3.1-Nemotron-70B-Instruct-HF-abliterated-i1-GGUF
 ## Usage
 If you are unsure how to use GGUF files, refer to one of [TheBloke's