Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
venketh
/
Mixtral-8x7B-Instruct-v0.1-GGUF-imatrix
like
2
GGUF
Inference Endpoints
conversational
Model card
Files
Files and versions
Community
1
Deploy
Use this model
main
Mixtral-8x7B-Instruct-v0.1-GGUF-imatrix
Commit History
Import IQ2_S quantization (2.5 bpw)
324f559
venketh
commited on
Mar 5
Import IQ3_S quantization (3.44 bpw)
3e3272a
venketh
commited on
Mar 5
Import IQ3_M quantization (3.66 bpw, 20 GB)
7d6ea65
venketh
commited on
Mar 5
Import Q5_K_M quantization (31 GB)
4e52c4e
venketh
commited on
Mar 4
Import IQ4_XS quantization (4.25 bpw, 24 GB)
4a8ea59
venketh
commited on
Feb 29
Import source and imatrix.dat
11f6605
Venkatesh Srinivas
commited on
Feb 29
Track imatrix.dat and *.gguf
18759df
Venkatesh Srinivas
commited on
Feb 29
initial commit
a804198
verified
venketh
commited on
Feb 29