Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
alpindale
/
Mistral-7B-Instruct-v0.2-EETQ
like
0
Text Generation
Transformers
Safetensors
mistral
conversational
Inference Endpoints
text-generation-inference
8-bit precision
eetq
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
alpindale
commited on
Apr 15
Commit
0ea83af
•
1 Parent(s):
938772c
Create README.md
Browse files
Files changed (1)
hide
show
README.md
+4
-0
README.md
ADDED
Viewed
@@ -0,0 +1,4 @@
1
+
Model quantized using a modified [EETQ](https://github.com/NetEase-FuXi/EETQ) repo. Currently working on
2
+
decoupling its kernels from CUTLASS to make this a bit easier to use.
3
+
4
+
8bits.