Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
xaskasdf
/
phi-3-medium-4k-instruct-gguf
like
0
GGUF
Inference Endpoints
conversational
Model card
Files
Files and versions
Community
Deploy
Use this model
main
phi-3-medium-4k-instruct-gguf
1 contributor
History:
5 commits
xaskasdf
Upload q3, q2 quantized model weights
0030274
verified
5 months ago
.gitattributes
2.82 kB
Upload q3, q2 quantized model weights
5 months ago
Phi-3-medium-4k-instruct-Q2_K.gguf
5.34 GB
LFS
Upload q3, q2 quantized model weights
5 months ago
Phi-3-medium-4k-instruct-Q3_K.gguf
7.12 GB
LFS
Upload q3, q2 quantized model weights
5 months ago
Phi-3-medium-4k-instruct-Q3_K_L.gguf
7.68 GB
LFS
Upload q3, q2 quantized model weights
5 months ago
Phi-3-medium-4k-instruct-Q3_K_S.gguf
6.26 GB
LFS
Upload q3, q2 quantized model weights
5 months ago
Phi-3-medium-4k-instruct-Q4_0.gguf
8.09 GB
LFS
Upload q4 models
5 months ago
Phi-3-medium-4k-instruct-Q4_0_4_4.gguf
8.09 GB
LFS
Upload q4 models
5 months ago
Phi-3-medium-4k-instruct-Q4_0_4_8.gguf
8.09 GB
LFS
Upload q4 models
5 months ago
Phi-3-medium-4k-instruct-Q4_0_8_8.gguf
8.09 GB
LFS
Upload q4 models
5 months ago
Phi-3-medium-4k-instruct-Q4_1.gguf
8.95 GB
LFS
Upload q4 models
5 months ago
Phi-3-medium-4k-instruct-Q4_K.gguf
8.76 GB
LFS
Upload q4 models
5 months ago
Phi-3-medium-4k-instruct-Q4_K_S.gguf
8.15 GB
LFS
Upload q4, q5, q6 quantized weights
5 months ago
Phi-3-medium-4k-instruct-Q5_0.gguf
9.82 GB
LFS
Upload q4, q5, q6 quantized weights
5 months ago
Phi-3-medium-4k-instruct-Q5_1.gguf
10.7 GB
LFS
Upload q4, q5, q6 quantized weights
5 months ago
Phi-3-medium-4k-instruct-Q5_K.gguf
10.3 GB
LFS
Upload q4, q5, q6 quantized weights
5 months ago
Phi-3-medium-4k-instruct-Q5_K_S.gguf
9.82 GB
LFS
Upload converted model weight and q5,q8 quants
5 months ago
Phi-3-medium-4k-instruct-Q6_K.gguf
11.6 GB
LFS
Upload q4, q5, q6 quantized weights
5 months ago
Phi-3-medium-4k-instruct-Q8_0.gguf
15 GB
LFS
Upload converted model weight and q5,q8 quants
5 months ago
Phi-3-medium-4k-instruct-f16.gguf
27.9 GB
LFS
Upload converted model weight and q5,q8 quants
5 months ago