-
-
-
-
-
-
Inference status
Active filters:
4bit
legraphista/c4ai-command-r-plus-08-2024-IMat-GGUF
Text Generation
•
Updated
•
594
•
4
speakleash/Bielik-11B-v2.2-Instruct-MLX-4bit
Text Generation
•
Updated
•
30
•
3
speakleash/Bielik-11B-v2.2-Instruct-Quanto-4bit
Text Generation
•
Updated
•
40
•
3
legraphista/Llama-3.1-Minitron-4B-Width-Base-GGUF
Text Generation
•
Updated
•
4.08k
•
12
legraphista/Qwen2-1.5B-Instruct-IMat-GGUF
Text Generation
•
Updated
•
6.21k
•
1
legraphista/glm-4-9b-chat-GGUF
Text Generation
•
Updated
•
7.41k
•
16
legraphista/gemma-2-27b-it-IMat-GGUF
Text Generation
•
Updated
•
4.39k
•
19
ModelCloud/Mistral-Nemo-Instruct-2407-gptq-4bit
Text Generation
•
Updated
•
914
•
2
ModelCloud/gemma-2-27b-it-gptq-4bit
Text Generation
•
Updated
•
1.76k
•
7
ModelCloud/Meta-Llama-3.1-8B-Instruct-gptq-4bit
Text Generation
•
Updated
•
1.11k
•
3
legraphista/Mistral-Large-Instruct-2407-IMat-GGUF
Text Generation
•
Updated
•
2.72k
•
26
legraphista/Minitron-8B-Base-GGUF
Text Generation
•
Updated
•
823
•
1
jhangmez/CHATPRG-v1-Meta-Llama-3.1-8B-bnb-4bit-q4_k_m
Text Generation
•
Updated
•
232
•
1
alexwww94/glm-4v-9b-gptq-4bit
Updated
•
136
•
1
jhangmez/CHATPRG-v1.2-Meta-Llama-3.1-8B-Instruct-GGUF
Text Generation
•
Updated
•
151
•
1
jhangmez/CHATPRG-v1.2-tinyllama-chat-GGUF
Text Generation
•
Updated
•
82
•
1
jhangmez/CHATPRG-v1.2-Phi-3.5-mini-instruct-GGUF
Text2Text Generation
•
Updated
•
443
•
1
legraphista/xLAM-8x7b-r-IMat-GGUF
Text Generation
•
Updated
•
210
•
1
mayaeary/pygmalion-6b-4bit-128g
Text Generation
•
Updated
•
47
•
39
mayaeary/pygmalion-6b_dev-4bit-128g
Text Generation
•
Updated
•
125
•
121
mayaeary/PPO_Pygway-V8p4_Dev-6b-4bit-128g
Text Generation
•
Updated
•
7
•
2
mayaeary/PPO_Pygway-6b-Mix-4bit-128g
Text Generation
•
Updated
•
11
•
2
Ancestral/Dolly_Shygmalion-6b-4bit-128g
Text Generation
•
Updated
•
8
•
5
Ancestral/PPO_Shygmalion-6b-4bit-128g
Text Generation
•
Updated
•
9
Ancestral/Dolly_Malion-6b-4bit-128g
Text Generation
•
Updated
•
7
4bit/pygmalion-6b-4bit-128g
Text Generation
•
Updated
•
12
•
3
mlabonne/gpt2-GPTQ-4bit
Text Generation
•
Updated
•
7
seonglae/opt-125m-4bit-gptq
Text Generation
•
Updated
•
8
seonglae/wizardlm-7b-uncensored-gptq
Text Generation
•
Updated
•
7
seonglae/llama-2-7b-chat-hf-gptq
Text Generation
•
Updated
•
6