Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
ChatMusician-GGUF
like
13
Text Generation
Transformers
GGUF
PyTorch
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
llama
en
arxiv:2402.16153
Inference Endpoints
text-generation-inference
License:
mit
Model card
Files
Files and versions
Community
2
Train
Deploy
Use this model
bc228e1
ChatMusician-GGUF
1 contributor
History:
10 commits
MaziyarPanahi
7b03f073d6e62402f659ee87c6ca698e363bb0b7252575bb4a7445888a43fe4a
bc228e1
verified
10 months ago
.gitattributes
2.06 kB
7b03f073d6e62402f659ee87c6ca698e363bb0b7252575bb4a7445888a43fe4a
10 months ago
ChatMusician.Q2_K.gguf
2.53 GB
LFS
94edf840f50f3977600b3d71df72106390471b38b7f149ccc3cd7afd089a7829
10 months ago
ChatMusician.Q3_K_L.gguf
3.6 GB
LFS
7fa0d4f2628cb046e083b576a8b5ad998e43a4816eeac23272f19c68e1e85811
10 months ago
ChatMusician.Q3_K_M.gguf
3.3 GB
LFS
fa3910b2ab41919b34d6979feee07854ba7beb26abb099d8b131c11c00fc57db
10 months ago
ChatMusician.Q3_K_S.gguf
2.95 GB
LFS
a64b2541622923114895bcd77dd4b0cb41a7b501582495815bfa7edc073ea6f7
10 months ago
ChatMusician.Q4_K_M.gguf
4.08 GB
LFS
f64434c7730337935a1e726ddc7831db16f850d0f979e9dc700602de4e1bd7a5
10 months ago
ChatMusician.Q4_K_S.gguf
3.86 GB
LFS
f162b5c49b9960c3439b17a326a72e64df85fe35d7e16cb0abac0cb66b830cdd
10 months ago
ChatMusician.Q5_K_M.gguf
4.78 GB
LFS
d6d995704ba3dae491063029ec0bccf5971e0ab88ce02f17629bdd86ae458a65
10 months ago
ChatMusician.Q5_K_S.gguf
4.65 GB
LFS
a7181b07e33b58395cb036f7822d39a33f19ea8f79fe222a1e4e398483210bb7
10 months ago
ChatMusician.Q6_K.gguf
5.53 GB
LFS
7b03f073d6e62402f659ee87c6ca698e363bb0b7252575bb4a7445888a43fe4a
10 months ago