ThomasBaruzier
/

Qwen2.5-0.5B-Instruct-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Qwen2.5-0.5B-Instruct-GGUF

Commit History

Upload Qwen2.5-0.5B-Instruct-F16.gguf

022269e
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-0.5B-Instruct-Q6_K.gguf

156ddb0
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-0.5B-Instruct-Q5_K_M.gguf

6469095
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-0.5B-Instruct-Q5_K_S.gguf

0fa6722
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-0.5B-Instruct-Q4_K_S.gguf

01c97dd
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-0.5B-Instruct-IQ4_XS.gguf

a3991dd
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-0.5B-Instruct-Q4_K_M.gguf

d50bff7
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-0.5B-Instruct-IQ4_NL.gguf

f82154b
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-0.5B-Instruct-IQ3_XS.gguf

990723b
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-0.5B-Instruct-IQ3_S.gguf

b49091a
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-0.5B-Instruct-Q3_K_S.gguf

73af8fc
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-0.5B-Instruct-Q3_K_M.gguf

1b99d64
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-0.5B-Instruct-Q3_K_L.gguf

d7a97e2
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-0.5B-Instruct-IQ3_M.gguf

220c668
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-0.5B-Instruct-IQ3_XXS.gguf

117e142
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-0.5B-Instruct-IQ2_M.gguf

3923763
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-0.5B-Instruct-IQ2_S.gguf

9cfa00c
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-0.5B-Instruct-Q2_K.gguf

1c350ad
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-0.5B-Instruct-Q2_K_S.gguf

1291869
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-0.5B-Instruct-IQ2_XS.gguf

d19a94c
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-0.5B-Instruct-IQ2_XXS.gguf

7bddeec
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-0.5B-Instruct-IQ1_M.gguf

fc06d32
verified

ThomasBaruzier commited on Sep 19

Upload Qwen2.5-0.5B-Instruct-IQ1_S.gguf

aaac5db
verified

ThomasBaruzier commited on Sep 19

Upload perplexity.md

43933b7
verified

ThomasBaruzier commited on Sep 19

Upload imatrix.dat

d3b9250
verified

ThomasBaruzier commited on Sep 19

Upload calibration_datav3.txt

08e95cf
verified

ThomasBaruzier commited on Sep 19

Update README.md

0093fc4
verified

ThomasBaruzier commited on Sep 19

Create README.md

95f9e03
verified

ThomasBaruzier commited on Sep 19

initial commit

f7533f4
verified

ThomasBaruzier commited on Sep 19