Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
mergekit-ties-jnhzatj-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
llama
mergekit
Merge
arxiv:2306.01708
Inference Endpoints
text-generation-inference
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
refs/pr/1
mergekit-ties-jnhzatj-GGUF
1 contributor
History:
12 commits
MaziyarPanahi
72177c22294be2830a1e0c1fc6fa471bf5d25995618d7d51fe137e80de219745
6a9f489
verified
5 months ago
.gitattributes
2.21 kB
d615b8c9f767943229c478a57557932d6aa7c59a593e88f749cffee0aa2ef824
5 months ago
README.md
3.35 kB
72177c22294be2830a1e0c1fc6fa471bf5d25995618d7d51fe137e80de219745
5 months ago
mergekit-ties-jnhzatj.Q2_K.gguf
2.53 GB
LFS
aeab446ebe1e2e46f47debdd9b68d5c35ea6d7626fc6407950a4ab2d5bb3965d
5 months ago
mergekit-ties-jnhzatj.Q3_K_L.gguf
3.6 GB
LFS
643717eb33e2a448394b0c44ea05ead7831bd3fe6c3054faa1c5111499c0ff19
5 months ago
mergekit-ties-jnhzatj.Q3_K_M.gguf
3.3 GB
LFS
a9d3d8e6dcfd2d7ddde5b632237d58750ddb4a6d1739c910eda3787b2260182c
5 months ago
mergekit-ties-jnhzatj.Q3_K_S.gguf
2.95 GB
LFS
9d426b994eaa581c8368a31ddb2b766f01d9e23b9aa34c9b5732cf043f57735d
5 months ago
mergekit-ties-jnhzatj.Q4_K_M.gguf
4.08 GB
LFS
dcf63d33e19e89bfaa54f15e128b98827551c82f734f6493e0b184b1bbd67504
5 months ago
mergekit-ties-jnhzatj.Q4_K_S.gguf
3.86 GB
LFS
bc8f79af5e483988a7502f1dca7e1517e2c6b0fb9a6d907ba5edec88d55f3798
5 months ago
mergekit-ties-jnhzatj.Q5_K_M.gguf
4.78 GB
LFS
0a967d8479a7fadcf7b4b429e9ba90a7de15e9c18d553c063d05a8b874e5959a
5 months ago
mergekit-ties-jnhzatj.Q5_K_S.gguf
4.65 GB
LFS
3d32924de3f838a2a5480b65b74b5d1be3a1fb558a02d50498a4cdb53c8b7d0b
5 months ago
mergekit-ties-jnhzatj.Q6_K.gguf
5.53 GB
LFS
5b56ef5ae54acd8674133a2a2f8d7c04e59531d4eab9734257a05e4ea61e026b
5 months ago
mergekit-ties-jnhzatj.Q8_0.gguf
7.16 GB
LFS
d615b8c9f767943229c478a57557932d6aa7c59a593e88f749cffee0aa2ef824
5 months ago
