Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
T3qM7-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
ef6e26d
T3qM7-7B-GGUF
1 contributor
History:
8 commits
MaziyarPanahi
6fe53f5ba3ed946c33ef9b36ed2ae50a4b34df0a84141885baa964badbd002a0
ef6e26d
verified
12 months ago
.gitattributes
1.92 kB
6fe53f5ba3ed946c33ef9b36ed2ae50a4b34df0a84141885baa964badbd002a0
12 months ago
T3qM7-7B.IQ3_XS.gguf
3.02 GB
LFS
06d27a57ae4faa630d37db371ca496489e0b8f8cc8e7d3e6734058de1a9cdfbe
12 months ago
T3qM7-7B.IQ4_XS.gguf
3.94 GB
LFS
2f490240ad21a2c6c70a613bc948b028e44390d59f2b8a7a5eda169105c8ced5
12 months ago
T3qM7-7B.Q2_K.gguf
2.72 GB
LFS
1074a2f9a67ccbd1551a6661a8f3694678680ae838723c375dbca6db35b3a029
12 months ago
T3qM7-7B.Q3_K_L.gguf
3.82 GB
LFS
847fb60ae3fb601682e45a0c46a9df19f227ad08bae44ab6eb55ac18a5a86bdf
12 months ago
T3qM7-7B.Q3_K_M.gguf
3.52 GB
LFS
1763c1b38b13a0dda4c562eb7d4eb0fe6d2846436224cf6caff03013c1ca168d
12 months ago
T3qM7-7B.Q3_K_S.gguf
3.16 GB
LFS
7054f84fee3043ec6f033e788cc915039c85e99a6255d0159351c2bd6049b679
12 months ago
T3qM7-7B.Q4_K_M.gguf
4.37 GB
LFS
6fe53f5ba3ed946c33ef9b36ed2ae50a4b34df0a84141885baa964badbd002a0
12 months ago
