Crataco
/

phi-2-orange-v2-imatrix-GGUF

Inference Endpoints

Model card Files Files and versions Community

Crataco commited on Mar 21

Commit

ebcaf4f

•

1 Parent(s): 6aeba65

Update README.md

Files changed (1) hide show

README.md +0 -2

README.md CHANGED Viewed

@@ -121,8 +121,6 @@ model-index:
       name: Open LLM Leaderboard
 ---
-[Still uploading...]
 This is [rhysjones/phi-2-orange-v2](https://huggingface.co/rhysjones/phi-2-orange-v2), quantized with the help of an importance matrix so it could offer better performance for being quantized, and have quantization levels available for lower-memory devices to run.
 [Kalomaze's "groups_merged.txt"](https://github.com/ggerganov/llama.cpp/discussions/5263#discussioncomment-8395384) was used for the importance matrix, with context set to 2,048.

       name: Open LLM Leaderboard
 ---
 This is [rhysjones/phi-2-orange-v2](https://huggingface.co/rhysjones/phi-2-orange-v2), quantized with the help of an importance matrix so it could offer better performance for being quantized, and have quantization levels available for lower-memory devices to run.
 [Kalomaze's "groups_merged.txt"](https://github.com/ggerganov/llama.cpp/discussions/5263#discussioncomment-8395384) was used for the importance matrix, with context set to 2,048.