ThomasBaruzier
/

Qwen2.5-0.5B-Instruct-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

ThomasBaruzier commited on Sep 19

Commit

a8cf9a4

•

1 Parent(s): b5bd8e9

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -13,11 +13,11 @@ tags:
 # Llama.cpp imatrix quantizations of Qwen/Qwen2.5-0.5B-Instruct
-<img src="https://cdn-uploads.huggingface.co/production/uploads/646410e04bf9122922289dc7/gDUbZOu1ND0j-th4Q6tep.jpeg" alt="llama" width="60%"/>
 Using llama.cpp commit [eca0fab](https://github.com/ggerganov/llama.cpp/commit/eca0fab) for quantization.
-Original model: [Qwen/Qwen2.5-0.5B-Instruct](https://huggingface.co/meta-llama/Qwen/Qwen2.5-0.5B-Instruct)
 All quants were made using the imatrix option and Bartowski's [calibration file](https://gist.github.com/bartowski1182/eb213dccb3571f863da82e99418f81e8).

 # Llama.cpp imatrix quantizations of Qwen/Qwen2.5-0.5B-Instruct
+<img src="https://cdn-uploads.huggingface.co/production/uploads/646410e04bf9122922289dc7/gDUbZOu1ND0j-th4Q6tep.jpeg" alt="qwen" width="60%"/>
 Using llama.cpp commit [eca0fab](https://github.com/ggerganov/llama.cpp/commit/eca0fab) for quantization.
+Original model: [Qwen/Qwen2.5-0.5B-Instruct](https://huggingface.co/Qwen/Qwen2.5-0.5B-Instruct)
 All quants were made using the imatrix option and Bartowski's [calibration file](https://gist.github.com/bartowski1182/eb213dccb3571f863da82e99418f81e8).