Edit Models filters

Inference Providers

HF Inference API

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

2,045

Full-text search

Active filters: 6-bit

MaziyarPanahi/Arch-Function-3B-GGUF

Text Generation • Updated Oct 30, 2024 • 86

MaziyarPanahi/Qwen2.5-Math-7B-Instruct-GGUF

Text Generation • Updated Oct 30, 2024 • 89

MaziyarPanahi/Llama-3.1-Hawkish-8B-GGUF

Text Generation • Updated Oct 30, 2024 • 114

MaziyarPanahi/sarvam-1-GGUF

Text Generation • Updated Oct 30, 2024 • 87

MaziyarPanahi/L3-8B-Everything-COT-GGUF

Text Generation • Updated Oct 30, 2024 • 86

MaziyarPanahi/llama3-8B-DarkIdol-2.2-Uncensored-1048K-GGUF

Text Generation • Updated Oct 30, 2024 • 61

MaziyarPanahi/llama3-8B-DarkIdol-2.1-Uncensored-1048K-GGUF

Text Generation • Updated Oct 30, 2024 • 45

MaziyarPanahi/llama3-8B-DarkIdol-2.1-Uncensored-32K-GGUF

Text Generation • Updated Oct 31, 2024 • 69

MaziyarPanahi/llama3-8B-DarkIdol-1.2-GGUF

Text Generation • Updated Oct 31, 2024 • 93

MaziyarPanahi/llama3-8B-DarkIdol-1.1-GGUF

Text Generation • Updated Oct 31, 2024 • 106

Statuo/Starcannon-Unleashed-12b-EXL2-6bpw

Text Generation • Updated Oct 31, 2024 • 6

MaziyarPanahi/llama3-8B-DarkIdol-1.0-GGUF

Text Generation • Updated Oct 31, 2024 • 80

MaziyarPanahi/Llama-3-8B-Sydney-GGUF

Text Generation • Updated Oct 31, 2024 • 114

MaziyarPanahi/llama3-8B-cn-rochat-v1-GGUF

Text Generation • Updated Oct 31, 2024 • 114

MaziyarPanahi/Colibri_8b_v0.1-GGUF

Text Generation • Updated Oct 31, 2024 • 86

MaziyarPanahi/openchat-3.6-8b-20240522-GGUF

Text Generation • Updated Oct 31, 2024 • 151

MaziyarPanahi/llama-3-8b-instruct-262k-chinese-GGUF

Text Generation • Updated Oct 31, 2024 • 51

MaziyarPanahi/Llama-3-8B-LexiFun-Uncensored-V1-GGUF

Text Generation • Updated Oct 31, 2024 • 65

MaziyarPanahi/Llama-3-KafkaLM-8B-v0.1-GGUF

Text Generation • Updated Oct 31, 2024 • 52

MaziyarPanahi/Llama-3-8B-Lexi-Uncensored-GGUF

Text Generation • Updated Oct 31, 2024 • 127

MaziyarPanahi/Llama3-Chinese-8B-Instruct-GGUF

Text Generation • Updated Oct 31, 2024 • 63

MaziyarPanahi/Mistral-NeMo-Minitron-8B-Instruct-GGUF

Text Generation • Updated Oct 31, 2024 • 74

MaziyarPanahi/IceWhiskeyRP-7b-GGUF

Text Generation • Updated Oct 31, 2024 • 76

MaziyarPanahi/uncertain_mistral_7b-GGUF

Text Generation • Updated Oct 31, 2024 • 91 • 1

MaziyarPanahi/BADMISTRAL-1.5B-GGUF

Text Generation • Updated Oct 31, 2024 • 84

MaziyarPanahi/MistralNemoTiny-GGUF

Text Generation • Updated Oct 31, 2024 • 61

MaziyarPanahi/Flammades-Mistral-7B-GGUF

Text Generation • Updated Oct 31, 2024 • 93

MaziyarPanahi/Hermes2-Gutenberg2-Mistral-7B-GGUF

Text Generation • Updated Oct 31, 2024 • 161

MaziyarPanahi/MathCoder2-Mistral-7B-GGUF

Text Generation • Updated Oct 31, 2024 • 45

MaziyarPanahi/IceMartiniV1RP-7b-GGUF

Text Generation • Updated Nov 1, 2024 • 51