xaskasdf
/

phi-3-mini-128k-instruct-gguf

Inference Endpoints

Model card Files Files and versions Community

phi-3-mini-128k-instruct-gguf

1 contributor

History: 2 commits

xaskasdf's picture

Upload converted and quantized weights

1bab945 verified 5 months ago

.gitattributes

2.16 kB

Upload converted and quantized weights 5 months ago
phi-3-mini-128k-instruct-f16.gguf

7.64 GB
LFS

Upload converted and quantized weights 5 months ago
phi-3-mini-128k-instruct-q2_k.gguf

1.53 GB
LFS

Upload converted and quantized weights 5 months ago
phi-3-mini-128k-instruct-q3_k.gguf

2.07 GB
LFS

Upload converted and quantized weights 5 months ago
phi-3-mini-128k-instruct-q4_0.gguf

2.29 GB
LFS

Upload converted and quantized weights 5 months ago
phi-3-mini-128k-instruct-q4_k.gguf

2.51 GB
LFS

Upload converted and quantized weights 5 months ago
phi-3-mini-128k-instruct-q5_0.gguf

2.76 GB
LFS

Upload converted and quantized weights 5 months ago
phi-3-mini-128k-instruct-q5_k.gguf

2.93 GB
LFS

Upload converted and quantized weights 5 months ago
phi-3-mini-128k-instruct-q6_k.gguf

3.25 GB
LFS

Upload converted and quantized weights 5 months ago
phi-3-mini-128k-instruct-q8_0.gguf

4.15 GB
LFS

Upload converted and quantized weights 5 months ago