Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Reset Other
quantization
Inference Endpoints
AutoTrain Compatible
text-generation-inference
4-bit precision
8-bit precision
custom_code
Other with no match
Eval Results
Merge
text-embeddings-inference
Carbon Emissions
Mixture of Experts
Apply filters
Models
113
Full-text search
Edit filters
Sort: Trending
Active filters:
quantization
Clear all
legraphista/gemma-2-27b-it-IMat-GGUF
Text Generation
•
Updated
3 days ago
•
135k
•
14
legraphista/glm-4-9b-chat-1m-GGUF
Text Generation
•
Updated
13 days ago
•
15.6k
•
14
legraphista/glm-4-9b-chat-GGUF
Text Generation
•
Updated
13 days ago
•
16.8k
•
7
legraphista/gemma-2-9b-it-IMat-GGUF
Text Generation
•
Updated
3 days ago
•
51.8k
•
2
legraphista/llm-compiler-13b-IMat-GGUF
Text Generation
•
Updated
5 days ago
•
48.7k
•
2
limcheekin/flan-t5-xxl-ct2
Updated
May 30, 2023
•
1
clibrain/Llama-2-7b-ft-instruct-es-gptq-4bit
Text Generation
•
Updated
Sep 1, 2023
•
90
•
8
SweatyCrayfish/llama-3-8b-quantized
Text Generation
•
Updated
Apr 20
•
5.47k
•
2
nics-efc/MixDQ
Text-to-Image
•
Updated
29 days ago
•
8
Anoop03031988/Phi-3-mini-4k-instruct-text-to-sql-GGUF
Updated
May 6
•
54
•
1
legraphista/DeepSeek-V2-Lite-Chat-IMat-GGUF
Text Generation
•
Updated
May 26
•
3.51k
•
5
legraphista/Phi-3-medium-128k-instruct-IMat-GGUF
Text Generation
•
Updated
May 26
•
2.27k
•
1
legraphista/Llama3-ChatQA-1.5-8B-IMat-GGUF
Text Generation
•
Updated
May 27
•
1.98k
•
1
legraphista/dolphin-2.9.1-llama-3-70b-IMat-GGUF
Text Generation
•
Updated
May 27
•
1.98k
•
1
legraphista/Codestral-22B-v0.1-IMat-GGUF
Text Generation
•
Updated
May 30
•
4k
•
11
legraphista/K2-Chat-IMat-GGUF
Text Generation
•
Updated
May 31
•
1.5k
•
4
legraphista/K2-IMat-GGUF
Text Generation
•
Updated
May 31
•
2.08k
•
2
legraphista/Llama-3-8B-Instruct-MopeyMule-IMat-GGUF
Text Generation
•
Updated
May 31
•
1.91k
•
1
legraphista/Higgs-Llama-3-70B-IMat-GGUF
Text Generation
•
Updated
27 days ago
•
2.5k
•
6
legraphista/Qwen2-7B-Instruct-IMat-GGUF
Text Generation
•
Updated
27 days ago
•
6.33k
•
3
legraphista/Qwen2-57B-A14B-Instruct-IMat-GGUF
Text Generation
•
Updated
12 days ago
•
27.8k
•
3
legraphista/Qwen2-72B-Instruct-IMat-GGUF
Text Generation
•
Updated
26 days ago
•
1.79k
•
1
legraphista/DeepSeek-Coder-V2-Instruct-IMat-GGUF
Text Generation
•
Updated
14 days ago
•
1.02k
•
3
legraphista/glm-4-9b-chat-IMat-GGUF
Text Generation
•
Updated
13 days ago
•
19.4k
•
2
legraphista/RoLlama3-8b-Instruct-IMat-GGUF
Text Generation
•
Updated
10 days ago
•
20.7k
•
1
legraphista/llm-compiler-7b-ftd-IMat-GGUF
Text Generation
•
Updated
5 days ago
•
25.4k
•
1
legraphista/Gemma-2-9B-It-SPPO-Iter3-IMat-GGUF
Text Generation
•
Updated
2 days ago
•
50.1k
•
1
ethzanalytics/gpt-j-6B-8bit-sharded
Text Generation
•
Updated
Nov 27, 2022
•
3
•
7
ethzanalytics/gpt-j-8bit-daily_dialogues
Text Generation
•
Updated
Nov 27, 2022
•
6
•
4
ethzanalytics/gpt-j-8bit-KILT_WoW_10k_steps
Text Generation
•
Updated
Nov 27, 2022
•
2
Previous
1
2
3
4
Next