Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Yi-1.5-9B-Chat-GGUF
like
5
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
llama
conversational
arxiv:2403.04652
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
refs/pr/1
Yi-1.5-9B-Chat-GGUF
1 contributor
History:
11 commits
MaziyarPanahi
5cbe4a0d582f9afa66b9ff39ec02632cf76ad15735b286d5a63c6d450c55daff
c49423b
verified
6 months ago
.gitattributes
Safe
2.08 kB
19dd34bcbe1c8b65cc2eec578c0f761cf132a5997286a740d9517984390932cd
6 months ago
README.md
Safe
3.08 kB
5cbe4a0d582f9afa66b9ff39ec02632cf76ad15735b286d5a63c6d450c55daff
6 months ago
Yi-1.5-9B-Chat.Q2_K.gguf
Safe
3.35 GB
LFS
d6e53580be73e90d10d44dab369dad7c5b9c8ff348f5d14336a9501945cb9d1e
6 months ago
Yi-1.5-9B-Chat.Q3_K_L.gguf
Safe
4.69 GB
LFS
9f45a0598c0068640a5d3913a4963b0166a1e9f6038ca8212c2b2c3e06eb6e54
6 months ago
Yi-1.5-9B-Chat.Q3_K_M.gguf
Safe
4.32 GB
LFS
ffa651ba29fee1844dcc28b3e8c658c1584075e90177c16f67e4de31f87463ec
6 months ago
Yi-1.5-9B-Chat.Q3_K_S.gguf
Safe
3.9 GB
LFS
a34fd32e3a2fa08cbce4161e90b507b6221b25add6b218c6d04d3e1280e71a1f
6 months ago
Yi-1.5-9B-Chat.Q4_K_M.gguf
Safe
5.33 GB
LFS
98cfdb952d2495583439c8be8ad9ffc0e6c720ab6c382b45b037a7c832bd98f9
6 months ago
Yi-1.5-9B-Chat.Q4_K_S.gguf
Safe
5.07 GB
LFS
1e7391d52af55a182335d750f9b85b1bc4b5318840d8fb91ecafa6cdc91c0669
6 months ago
Yi-1.5-9B-Chat.Q5_K_M.gguf
Safe
6.26 GB
LFS
84d791dbd0ccf96729f6e855f92a71fdac87d6734c1a2ccf50e3bff5787efae9
6 months ago
Yi-1.5-9B-Chat.Q5_K_S.gguf
Safe
6.11 GB
LFS
b6925d958fe42a5e3840d10068f77126f2c6bfc0519c4a80003bc2e5a1a5cd5c
6 months ago
Yi-1.5-9B-Chat.Q6_K.gguf
Safe
7.25 GB
LFS
19dd34bcbe1c8b65cc2eec578c0f761cf132a5997286a740d9517984390932cd
6 months ago
