Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Reset Other
quantized
text-generation-inference
4-bit precision
AutoTrain Compatible
Inference Endpoints
8-bit precision
Merge
Eval Results
Mixture of Experts
custom_code
Carbon Emissions
text-embeddings-inference
Apply filters
Models
1,390
Full-text search
Edit filters
Sort: Trending
Active filters:
quantized
Clear all
MaziyarPanahi/mergekit-slerp-kxzcrwh-GGUF
Text Generation
•
Updated
11 days ago
•
1.78k
•
1
MaziyarPanahi/mergekit-slerp-zzizhry-GGUF
Text Generation
•
Updated
10 days ago
•
1.12k
•
1
MaziyarPanahi/mergekit-slerp-fcxoywi-GGUF
Text Generation
•
Updated
10 days ago
•
1.52k
•
1
MaziyarPanahi/mergekit-slerp-gpprpds-GGUF
Text Generation
•
Updated
10 days ago
•
1.6k
•
1
legraphista/glm-4-9b-chat-IMat-GGUF
Text Generation
•
Updated
9 days ago
•
16.9k
•
2
legraphista/RoLlama3-8b-Instruct-IMat-GGUF
Text Generation
•
Updated
6 days ago
•
20.4k
•
1
MaziyarPanahi/Qwen2-72B-Instruct-v0.1-GGUF
Text Generation
•
Updated
about 23 hours ago
•
18.4k
•
1
MaziyarPanahi/Qwen2-7B-Instruct-v0.3-GGUF
Text Generation
•
Updated
1 day ago
•
8.61k
•
1
legraphista/gemma-2-9b-it-IMat-GGUF
Text Generation
•
Updated
about 23 hours ago
•
26.5k
•
1
legraphista/llm-compiler-7b-ftd-IMat-GGUF
Text Generation
•
Updated
1 day ago
•
24.4k
•
1
Lewdiculous/EndlessRP-v3-7B-GGUF-Imatrix
Text Generation
•
Updated
Feb 27
•
225
•
10
Lewdiculous/InfinityRP-v1-7B-GGUF-IQ-Imatrix
Updated
May 4
•
885
•
34
ravenscroftj/CodeGen-350M-multi-ggml-quant
Text Generation
•
Updated
Apr 24, 2023
•
2
ravenscroftj/CodeGen-2B-multi-ggml-quant
Text Generation
•
Updated
Aug 5, 2023
•
2
ravenscroftj/CodeGen-6B-multi-ggml-quant
Text Generation
•
Updated
Apr 24, 2023
•
9
ethzanalytics/dolly-v2-12b-sharded-8bit
Text Generation
•
Updated
Apr 29, 2023
•
11
•
4
ethzanalytics/dolly-v2-7b-sharded-8bit
Text Generation
•
Updated
Jun 28, 2023
•
13
•
1
pszemraj/long-t5-tglobal-xl-16384-book-summary-8bit
Summarization
•
Updated
May 5, 2023
•
31
ethzanalytics/stablelm-tuned-alpha-7b-sharded-8bit
Text Generation
•
Updated
May 4, 2023
•
10
•
2
rozek/OpenLLaMA_7B_300BT_q4
Text Generation
•
Updated
May 5, 2023
•
1
ethzanalytics/stablelm-tuned-alpha-3b-gptq-4bit-128g
Text Generation
•
Updated
May 7, 2023
•
1
rirv938/GPTQ-LLaMa-65B-4bit-triton
Text Generation
•
Updated
May 25, 2023
kyo-takano/open-calm-7b-8bit
Text Generation
•
Updated
May 28, 2023
•
5
•
10
CalderaAI/13B-Ouroboros-GPTQ4bit-128g-CUDA
Text Generation
•
Updated
Jul 20, 2023
CONCISE/LLaMa_V2-13B-Chat-Uncensored-GGML
Text Generation
•
Updated
Aug 7, 2023
•
1
•
7
CONCISE/LLaMa_V2-13B-Instruct-Uncensored-GGML
Text Generation
•
Updated
Aug 17, 2023
•
22
•
5
rozek/LLaMA-2-7B-32K_GGUF
Text Generation
•
Updated
Aug 31, 2023
•
1.54k
•
9
rozek/LLaMA-2-7B-32K-Instruct_GGUF
Text Generation
•
Updated
Aug 31, 2023
•
1.34k
•
5
neuralmagic/bge-small-en-v1.5-quant
Feature Extraction
•
Updated
Nov 13, 2023
•
10.7k
•
9
neuralmagic/bge-base-en-v1.5-quant
Feature Extraction
•
Updated
Nov 13, 2023
•
5.79k
•
4
Previous
1
2
3
4
5
6
...
47
Next