Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

4-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

3,677

Full-text search

Active filters: exl2

bullerwins/Hermes-2-Theta-Llama-3-70B-32k-exl2_5.0bpw

Text Generation • Updated Jun 27 • 2

bullerwins/Hermes-2-Theta-Llama-3-70B-32k-exl2_4.0bpw

Text Generation • Updated Jun 27 • 3

agentlans/Llama3-Prime-EXL2-4bpw

Text Generation • Updated Jun 27 • 7

agentlans/Llama3-Prime-EXL2-5bpw

Text Generation • Updated Jun 27 • 2

BigHuggyD/cohereforai_c4ai-command-r-plus_exl2_8.0bpw_h8

Text Generation • Updated Jun 28 • 9

BigHuggyD/cohereforai_c4ai-command-r-plus_exl2_7.5bpw_h8

Text Generation • Updated Jun 28 • 2

blockblockblock/Llama-3-Instruct-8B-SPPO-Iter3-bpw6-exl2

Text Generation • Updated Jun 28 • 7

BigHuggyD/cohereforai_c4ai-command-r-plus_exl2_7.0bpw_h8

Text Generation • Updated Jun 28 • 2

luijait/Phi-3-14b-128k-8bits

Text Generation • Updated Jun 28 • 2

BigHuggyD/cohereforai_c4ai-command-r-plus_exl2_6.5bpw_h8

Text Generation • Updated Jun 28 • 2

BigHuggyD/cohereforai_c4ai-command-r-plus_exl2_6.0bpw_h8

Text Generation • Updated Jun 28 • 2

blockblockblock/Llama-3-Instruct-8B-SPPO-Iter3-bpw4-exl2

Text Generation • Updated Jun 29 • 9

blockblockblock/Llama-3-Instruct-8B-SPPO-Iter3-bpw4.6-exl2

Text Generation • Updated Jun 28 • 4

blockblockblock/Llama-3-Instruct-8B-SPPO-Iter3-bpw5-exl2

Text Generation • Updated Jun 28 • 3

BigHuggyD/cohereforai_c4ai-command-r-plus_exl2_5.5bpw_h8

Text Generation • Updated Jun 29 • 7

BigHuggyD/cohereforai_c4ai-command-r-plus_exl2_5.0bpw_h8

Text Generation • Updated Jun 29 • 2

BigHuggyD/cohereforai_c4ai-command-r-plus_exl2_4.5bpw_h8

Text Generation • Updated Jun 29 • 2

ParasiticRogue/RPStew-v2.5-34B-4.65-exl2-alt

Text Generation • Updated Jun 29 • 2 • 1

DeusImperator/sunfall-midnight-miqu-v0.2-v1.5-70B_exl2_2.4bpw

Text Generation • Updated Jun 29 • 4

BigHuggyD/cohereforai_c4ai-command-r-plus_exl2_4.0bpw_h8

Text Generation • Updated Jun 29 • 4

blockblockblock/Arcee-Spark-bpw3-exl2

Text Generation • Updated Jun 30 • 2

blockblockblock/Arcee-Spark-bpw3.5-exl2

Text Generation • Updated Jun 30 • 2

blockblockblock/Arcee-Spark-bpw4-exl2

Text Generation • Updated Jun 30 • 2

blockblockblock/Arcee-Spark-bpw4.4-exl2

Text Generation • Updated Jun 30 • 2

blockblockblock/Arcee-Spark-bpw4.8-exl2

Text Generation • Updated Jun 30 • 4

blockblockblock/Arcee-Spark-bpw5-exl2

Text Generation • Updated Jun 30 • 2

blockblockblock/Arcee-Spark-bpw5.5-exl2

Text Generation • Updated Jun 30 • 2

blockblockblock/Arcee-Spark-bpw6-exl2

Text Generation • Updated Jun 30 • 2

ZeroFLN/Lunaris

Text Generation • Updated Jun 30 • 4

bigstorm/dolphin-2.9.2-qwen2-72b-7.0bpw-8hb-exl2

Text Generation • Updated Jul 1 • 8 • 2