Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
bartowski
/
K2-Chat-GGUF
like
5
Text Generation
GGUF
Inference Endpoints
imatrix
License:
apache-2.0
Model card
Files
Files and versions
Community
Deploy
Use this model
main
K2-Chat-GGUF
1 contributor
History:
2 commits
bartowski
Llamacpp quants
28c5e76
verified
4 months ago
K2-Chat-Q8_0.gguf
Llamacpp quants
4 months ago
K2-Chat-f16.gguf
Llamacpp quants
4 months ago
.gitattributes
2.7 kB
Llamacpp quants
4 months ago
K2-Chat-IQ1_M.gguf
15.4 GB
LFS
Llamacpp quants
4 months ago
K2-Chat-IQ2_M.gguf
22.4 GB
LFS
Llamacpp quants
4 months ago
K2-Chat-IQ2_XXS.gguf
17.5 GB
LFS
Llamacpp quants
4 months ago
K2-Chat-IQ3_M.gguf
29.8 GB
LFS
Llamacpp quants
4 months ago
K2-Chat-IQ3_XXS.gguf
24.7 GB
LFS
Llamacpp quants
4 months ago
K2-Chat-IQ4_XS.gguf
34.8 GB
LFS
Llamacpp quants
4 months ago
K2-Chat-Q2_K.gguf
24.1 GB
LFS
Llamacpp quants
4 months ago
K2-Chat-Q3_K_M.gguf
31.6 GB
LFS
Llamacpp quants
4 months ago
K2-Chat-Q3_K_S.gguf
28.2 GB
LFS
Llamacpp quants
4 months ago
K2-Chat-Q4_K_M.gguf
39.3 GB
LFS
Llamacpp quants
4 months ago
K2-Chat-Q5_K_M.gguf
46.2 GB
LFS
Llamacpp quants
4 months ago
K2-Chat.imatrix
22.8 MB
LFS
Llamacpp quants
4 months ago
README.md
5.35 kB
Llamacpp quants
4 months ago