Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Inference status
Reset Inference status
Warm
Cold
Frozen
Misc
Reset Misc
quantization
Inference Endpoints
AutoTrain Compatible
text-generation-inference
4-bit precision
8-bit precision
custom_code
Eval Results
Misc with no match
Merge
text-embeddings-inference
Carbon Emissions
Mixture of Experts
Apply filters
Models
182
Full-text search
Edit filters
Sort: Trending
Active filters:
quantization
Clear all
DRXD1000/Phoenix-AWQ
Text Generation
•
Updated
Feb 12
•
14
•
1
Nan-Do/FusionNet_7Bx2_MoE_14B-GGUF
Updated
Jan 21
•
85
•
10
Nan-Do/Truthful_DPO_TomGrc_FusionNet_7Bx2_MoE_13B-GGUF
Updated
Jan 21
•
147
•
11
BioMistral/BioMistral-7B-AWQ-QGS128-W4-GEMM
Text Generation
•
Updated
Feb 19
•
132
•
3
BioMistral/BioMistral-7B-AWQ-QGS128-W4-GEMV
Text Generation
•
Updated
Feb 19
•
20
•
1
yujiepan/mpt-7b-gsm8k-dummy
Text Generation
•
Updated
Feb 4
•
1
shuvom/yuj-v1-GGUF
Text Generation
•
Updated
Feb 13
•
6
•
1
LoftQ/CodeLlama-7b-hf-4bit-64rank
Text Generation
•
Updated
Apr 20
•
10
LoftQ/CodeLlama-13b-hf-4bit-64rank
Text Generation
•
Updated
Apr 20
•
10
SweatyCrayfish/llama-3-8b-quantized
Text Generation
•
Updated
Apr 20
•
3.64k
•
9
SweatyCrayfish/Llama-3-8B-Quantized-Instruct
Text Generation
•
Updated
Apr 20
avans06/Meta-Llama-3-8B-Instruct-ct2-int8_float16
Text Generation
•
Updated
Apr 25
•
35
Anoop03031988/Code-Llama-2-7B-instruct-text2sql.gguf
Updated
May 4
Anoop03031988/Code-Llama-2-7B-instruct-text2sql-GGUF
Updated
May 4
•
6
nics-efc/MixDQ
Text-to-Image
•
Updated
Jun 4
•
10
Anoop03031988/Phi-3-mini-4k-instruct-text-to-sql-GGUF
Updated
10 days ago
•
14
•
1
legraphista/Phi-3-mini-4k-instruct-IMat-GGUF
Text Generation
•
Updated
May 26
•
187
legraphista/RoLlama2-7b-Base-IMat-GGUF
Text Generation
•
Updated
May 25
•
192
legraphista/RoLlama2-7b-Chat-IMat-GGUF
Text Generation
•
Updated
May 25
•
289
legraphista/RoLlama2-7b-Instruct-IMat-GGUF
Text Generation
•
Updated
May 25
•
268
legraphista/RoMistral-7b-Instruct-IMat-GGUF
Text Generation
•
Updated
May 25
•
816
legraphista/aya-23-8B-IMat-GGUF
Text Generation
•
Updated
May 26
•
341
legraphista/aya-23-35B-IMat-GGUF
Text Generation
•
Updated
May 26
•
151
legraphista/Phi-3-medium-4k-instruct-IMat-GGUF
Text Generation
•
Updated
May 26
•
251
legraphista/DeepSeek-V2-Lite-Chat-IMat-GGUF
Text Generation
•
Updated
May 26
•
908
•
6
legraphista/DeepSeek-V2-Lite-IMat-GGUF
Text Generation
•
Updated
May 26
•
258
legraphista/Mistral-7B-Instruct-v0.3-IMat-GGUF
Text Generation
•
Updated
May 26
•
168
legraphista/Mistral-7B-v0.3-IMat-GGUF
Text Generation
•
Updated
May 26
•
185
legraphista/Phi-3-mini-128k-instruct-IMat-GGUF
Text Generation
•
Updated
May 26
•
127
legraphista/Hermes-2-Theta-Llama-3-8B-IMat-GGUF
Text Generation
•
Updated
May 26
•
605
Previous
1
2
3
4
...
7
Next