Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
AlloyingotneoyYam-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
mergekit
Merge
Inference Endpoints
text-generation-inference
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
90339ac
AlloyingotneoyYam-7B-GGUF
1 contributor
History:
11 commits
MaziyarPanahi
9dfe394ff8d1ea1ed6254b666fbf8b9aefa5355ff5b7e1050b73b94417360824
90339ac
verified
7 months ago
.gitattributes
2.21 kB
9dfe394ff8d1ea1ed6254b666fbf8b9aefa5355ff5b7e1050b73b94417360824
7 months ago
AlloyingotneoyYam-7B.IQ3_XS.gguf
3.02 GB
LFS
99ac2dcb114a2fd20740dcf2024c999e7cf447fb1d019fd09d0e19d92b4669d7
7 months ago
AlloyingotneoyYam-7B.IQ4_XS.gguf
3.94 GB
LFS
1a32e917f6f206b52b1d9ec9dd0aa8a2234fb544e6008ee82a8be5850d03e177
7 months ago
AlloyingotneoyYam-7B.Q2_K.gguf
2.72 GB
LFS
74fa92f305ac13c6e564dea430a66a495b88f9e16b543cc15eaadca2f804fd2d
7 months ago
AlloyingotneoyYam-7B.Q3_K_L.gguf
3.82 GB
LFS
0956e9bfdd6662b76c0e00271079e1a1d8fa7073f56e0ce2725940b420e95f50
7 months ago
AlloyingotneoyYam-7B.Q3_K_M.gguf
3.52 GB
LFS
ac77ddf40f09d0706e3083806531c204fa08e58eb89cad616a2b2dc95ad1f051
7 months ago
AlloyingotneoyYam-7B.Q3_K_S.gguf
3.16 GB
LFS
c75e797c2e96bc248ff6980c85d252158d09535bfd8aed22c8a511be59b02d78
7 months ago
AlloyingotneoyYam-7B.Q4_K_M.gguf
4.37 GB
LFS
89b13dd4fd01f5a723a5268bdcc0d2780240df4d23f4d7e557f7e51a9db1ec7f
7 months ago
AlloyingotneoyYam-7B.Q4_K_S.gguf
4.14 GB
LFS
907ef2785a10fdf98ef9bb42ad8549ae378488d95716777f71b9fa8a27d0f4da
7 months ago
AlloyingotneoyYam-7B.Q5_K_M.gguf
5.13 GB
LFS
eb68da009325df36918d28b853b708dd4bbc3ae82924edbb12c59d2dbb47138a
7 months ago
AlloyingotneoyYam-7B.Q5_K_S.gguf
5 GB
LFS
9dfe394ff8d1ea1ed6254b666fbf8b9aefa5355ff5b7e1050b73b94417360824
7 months ago