Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
yi-super-9B-GGUF
like
4
Text Generation
Transformers
GGUF
PyTorch
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
llama
dataset:teknium/OpenHermes-2.5
Inference Endpoints
text-generation-inference
Model card
Files
Files and versions
Community
2
Train
Deploy
Use this model
ab6b496
yi-super-9B-GGUF
1 contributor
History:
10 commits
MaziyarPanahi
e1911520a529e4d7405a68a96dbfdd920c334ddb46ca82e0b3d018b77a9520c8
ab6b496
verified
9 months ago
.gitattributes
2.06 kB
e1911520a529e4d7405a68a96dbfdd920c334ddb46ca82e0b3d018b77a9520c8
9 months ago
yi-super-9B.IQ4_XS.gguf
4.83 GB
LFS
48e04a57db1e8ece76e5587062c7ecc68835e71ee5798bd297fcdf9a1babeeaf
9 months ago
yi-super-9B.Q2_K.gguf
3.35 GB
LFS
5071e2dd35dd92d3d214b234d62070580137374e07d3a55f1021f94d78546855
9 months ago
yi-super-9B.Q3_K_L.gguf
4.69 GB
LFS
337ba3fa66a7223b2aa6d1a40f937cf522c2af760679657e3873e47a0e6c7649
9 months ago
yi-super-9B.Q3_K_M.gguf
4.32 GB
LFS
87fd5e3f1d787a00586414e77ae99df90ceb06d5a12e834d735ff8022e51c574
9 months ago
yi-super-9B.Q3_K_S.gguf
3.9 GB
LFS
b01dbd37e69b7ffa026e6d7fbf71014a0fd7208cbc1b1fc40b3e57f24a9ae704
9 months ago
yi-super-9B.Q4_K_M.gguf
5.33 GB
LFS
3eccafc77493cb4af36babad5b02546e0b99d594c00178c4c8e5c63e27446eec
9 months ago
yi-super-9B.Q4_K_S.gguf
5.07 GB
LFS
2b042fbaa61be047de4a8362805ac3c4a076741894b222da0eba8d57e0c5cd79
9 months ago
yi-super-9B.Q5_K_M.gguf
6.26 GB
LFS
164ba3032287a4b291e24bce68999f2a261b6ac8f492107978667e7d9d24645b
9 months ago
yi-super-9B.Q5_K_S.gguf
6.11 GB
LFS
e1911520a529e4d7405a68a96dbfdd920c334ddb46ca82e0b3d018b77a9520c8
9 months ago
