README.md

---
pretty_name: quantized-models
license: mit
language:
- en
tags:
- gguf
- exl2
- large language model
- text-generation-inference
- transformers
library_name: transformers
pipeline_tag: text-generation
---

# About

Quantized models collected from various sources for ease of use.

# Sources

Some models have been quantized by me. And others:

- GGUF: [TheBloke](https://huggingface.co/TheBloke), [ollama.ai/library](https://ollama.ai/library), [Undi95](https://huggingface.co/Undi95), [LoneStriker](https://huggingface.co/LoneStriker), [s3nh](https://huggingface.co/s3nh), [athirdpath](https://huggingface.co/athirdpath), [Sao10K](https://huggingface.co/Sao10K), [maddes8cht](https://huggingface.co/maddes8cht), [Kquant03](https://huggingface.co/Kquant03), [ikawrakow](https://huggingface.co/ikawrakow), [nakodanei](https://huggingface.co/nakodanei), [NousResearch](https://huggingface.co/NousResearch), [second-state](https://huggingface.co/second-state), [wolfram](https://huggingface.co/wolfram), [Weyaxi](https://huggingface.co/Weyaxi), [bartowski](https://huggingface.co/bartowski), [FPHam](https://huggingface.co/FPHam), [teknium](https://huggingface.co/teknium), [nold](https://huggingface.co/nold), [NeverSleep](https://huggingface.co/NeverSleep), [MaziyarPanahi](https://huggingface.co/MaziyarPanahi), [migtissera](https://huggingface.co/migtissera), [openerotica](https://huggingface.co/openerotica), [DavidAU](https://huggingface.co/DavidAU), [QuantFactory](https://huggingface.co/QuantFactory), [RobertSinclair](https://huggingface.co/RobertSinclair), [mradermacher](https://huggingface.co/mradermacher), [BeaverAI](https://huggingface.co/BeaverAI), [TheDrummer](https://huggingface.co/TheDrummer), [grimjim](https://huggingface.co/grimjim), [city96](https://huggingface.co/city96), [HuggingFaceTB](https://huggingface.co/HuggingFaceTB), [liminerity](https://huggingface.co/liminerity)
- EXL2: [LoneStriker](https://huggingface.co/LoneStriker)
- HQQ+ (HQQ + LoRA adapter): [Mobius Labs GmbH](https://huggingface.co/mobiuslabsgmbh)
- AWQ: ToDO
- GPTQ: ToDo

## Disclaimer

These models are provided "as-is" without any warranty. The respective licenses apply to each model, and it is the user's responsibility to comply with the terms of these licenses.