Edit Models filters

Inference status

Misc

arxiv: 2309.00071

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

449

Full-text search

Active filters: 2309.00071

TheBloke/alfred-40B-1023-AWQ

Text Generation • Updated Nov 17, 2023 • 18 • 5

maddes8cht/lightonai-alfred-40b-1023-gguf

Updated Nov 22, 2023 • 113

TheBloke/Yarn-Llama-2-70B-32k-AWQ

Text Generation • Updated Nov 21, 2023 • 20 • 2

TheBloke/Yarn-Llama-2-70B-32k-GPTQ

Text Generation • Updated Nov 21, 2023 • 23

TheBloke/Yarn-Llama-2-70B-32k-GGUF

Updated Nov 20, 2023 • 177 • 9

LoneStriker/Yarn-Llama-2-70b-32k-2.4bpw-h6-exl2

Text Generation • Updated Nov 22, 2023 • 25

LoneStriker/Yarn-Llama-2-70b-32k-4.0bpw-h6-exl2

Text Generation • Updated Nov 22, 2023 • 11 • 1

LoneStriker/Yarn-Llama-2-70b-32k-4.65bpw-h6-exl2

Text Generation • Updated Nov 22, 2023 • 11

LoneStriker/Yarn-Llama-2-70b-32k-2.55bpw-h6-exl2

Text Generation • Updated Nov 22, 2023 • 11

LoneStriker/Yarn-Llama-2-70b-32k-6.0bpw-h6-exl2

Text Generation • Updated Nov 22, 2023 • 12 • 1

LoneStriker/Yarn-Llama-2-70b-32k-5.15bpw-h6-exl2

Text Generation • Updated Nov 22, 2023 • 13

MaziyarPanahi/Yarn-Mistral-7b-64k-Mistral-7B-Instruct-v0.1

Text Generation • Updated Jan 16 • 88 • 1

NousResearch/Yarn-Solar-10b-64k

Text Generation • Updated Jan 18 • 221 • 15

NousResearch/Yarn-Solar-10b-32k

Text Generation • Updated Jan 18 • 688 • 10

MaziyarPanahi/Yarn-Mistral-7b-64k-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • Updated Jan 26 • 86 • 4

tdh87/Yarn-Solar-10b-64k-SafeTensors

Updated Jan 29 • 13

MaziyarPanahi/Yarn-Solar-10b-64k-GGUF

Text Generation • Updated Feb 25 • 57 • 1

MaziyarPanahi/Yarn-Solar-10b-32k-GGUF

Text Generation • Updated Feb 26 • 64 • 1

LoneStriker/Llama-3-8B-Instruct-262k-GGUF

Text Generation • Updated Apr 26 • 11 • 2

LoneStriker/Llama-3-8B-Instruct-262k-3.0bpw-h6-exl2

Text Generation • Updated Apr 26 • 16

LoneStriker/Llama-3-8B-Instruct-262k-4.0bpw-h6-exl2

Text Generation • Updated Apr 26 • 8

LoneStriker/Llama-3-8B-Instruct-262k-5.0bpw-h6-exl2

Text Generation • Updated Apr 26 • 9

LoneStriker/Llama-3-8B-Instruct-262k-6.0bpw-h6-exl2

Text Generation • Updated Apr 26 • 7

LoneStriker/Llama-3-8B-Instruct-262k-8.0bpw-h8-exl2

Text Generation • Updated Apr 26 • 8

bullerwins/gradientai_Llama-3-8B-Instruct-262k_exl2_8.0bpw

Text Generation • Updated Apr 26 • 12 • 3

bullerwins/gradientai_Llama-3-8B-Instruct-262k_exl2_6.0bpw

Text Generation • Updated Apr 26 • 6

bullerwins/gradientai_Llama-3-8B-Instruct-262k_exl2_5.0bpw

Text Generation • Updated Apr 26 • 8

QuantFactory/Llama-3-8B-Instruct-262k-GGUF

Text Generation • Updated Apr 26 • 200

LiteLLMs/Llama-3-8B-Instruct-262k-GGUF

Text Generation • Updated Apr 29 • 29 • 1

blockblockblock/Llama-3-8B-Instruct-Gradient-1048k-bpw2.25-exl2

Text Generation • Updated May 9 • 10 • 1