Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Experiment28Strangemerges_32-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
b4625be
Experiment28Strangemerges_32-7B-GGUF
1 contributor
History:
12 commits
MaziyarPanahi
daa04b5b014479028d790d13e14f7492314de73c2960888533e664962a6b5d71
b4625be
verified
7 months ago
.gitattributes
2.4 kB
daa04b5b014479028d790d13e14f7492314de73c2960888533e664962a6b5d71
7 months ago
Experiment28Strangemerges_32-7B.IQ3_XS.gguf
3.02 GB
LFS
51a58339d0b05b5bf7e776fa5adfa4b673fa5067d0914233c128849a4a3aae42
7 months ago
Experiment28Strangemerges_32-7B.IQ4_XS.gguf
3.94 GB
LFS
4bd8e0f758e5feeaceab326ee6f430786beb8507ae3a121d47802c361a84070d
7 months ago
Experiment28Strangemerges_32-7B.Q2_K.gguf
2.72 GB
LFS
f57b3f850d8b2ca91d565195dc3187803662f10a1e1177e9cc5327d76174bf5c
7 months ago
Experiment28Strangemerges_32-7B.Q3_K_L.gguf
3.82 GB
LFS
bcb0c0ea65ccf49f6db93528b21848c14a0b02ebe522e11de5e2784a7deab29e
7 months ago
Experiment28Strangemerges_32-7B.Q3_K_M.gguf
3.52 GB
LFS
ec4d23bb99ed1ebb1fd0c41b645767d1c2f8a339368558250bd6378bd2d52269
7 months ago
Experiment28Strangemerges_32-7B.Q3_K_S.gguf
3.16 GB
LFS
16e8aa12a462adf13aea203b70addc39c64daa395023af793ae161664bf3dd61
7 months ago
Experiment28Strangemerges_32-7B.Q4_K_M.gguf
4.37 GB
LFS
8a52342f764988356ee733e5d04fd66332b299be29d4efcf66132f28e81e17f9
7 months ago
Experiment28Strangemerges_32-7B.Q4_K_S.gguf
4.14 GB
LFS
5454dc08c9ef70e3c1ed3ede8f65c41d30305742ea8b72f13f04982507b302fb
7 months ago
Experiment28Strangemerges_32-7B.Q5_K_M.gguf
5.13 GB
LFS
be1f1019c44c9e51d2c250d212db0648302f65e7e930a3eac56d5ad3fd40f1bd
7 months ago
Experiment28Strangemerges_32-7B.Q5_K_S.gguf
5 GB
LFS
750f4174ede7cd4aa9485fe69b2ceff503b496e0676f452340833e06127a2e8f
7 months ago
Experiment28Strangemerges_32-7B.Q6_K.gguf
5.94 GB
LFS
daa04b5b014479028d790d13e14f7492314de73c2960888533e664962a6b5d71
7 months ago