Edit Models filters

Inference status

Misc

compressed-tensors

AutoTrain Compatible

Inference Endpoints

text-generation-inference

Misc with no match

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

29

Full-text search

Active filters: compressed-tensors

nm-testing/llama7b-one-shot-2_4-w4a16-marlin24

Text Generation • Updated Jun 4 • 6

nm-testing/llama7b-one-shot-2_4-w4a16-group128-packed

Text Generation • Updated Jun 4 • 3

nm-testing/tinyllama-oneshot-w8a8-static-v3

Text Generation • Updated Jun 17 • 12

nm-testing/tinyllama-oneshot-w8a8-dynamic-token-v3

Text Generation • Updated Jun 17 • 5

nm-testing/tinyllama-oneshot-w4a16-group128-v3

Text Generation • Updated Aug 19 • 11

nm-testing/tinyllama-oneshot-w4a16-channel-v3

Text Generation • Updated Jun 7 • 2

nm-testing/tinyllama-oneshot-w8a8-test-static-shape-change-v3

Text Generation • Updated 29 days ago • 27

nm-testing/Meta-Llama-3-8B-Instruct-fp8-hf_compat

Updated 29 days ago • 133

nm-testing/TinyLlama-1.1B-Chat-v1.0-W4A16_channel-e2e

Text Generation • Updated about 12 hours ago • 275

nm-testing/TinyLlama-1.1B-Chat-v1.0-W4A16-e2e

Text Generation • Updated about 12 hours ago • 40

nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A16_channel-e2e

Text Generation • Updated about 12 hours ago • 277

nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A16-e2e

Text Generation • Updated about 12 hours ago • 40

nm-testing/TinyLlama-1.1B-Chat-v1.0-FP8A16_channel-e2e

Text Generation • Updated about 12 hours ago • 30

nm-testing/TinyLlama-1.1B-Chat-v1.0-FP8A16_tensor-e2e

Text Generation • Updated about 12 hours ago • 32

nm-testing/TinyLlama-1.1B-Chat-v1.0-FP8-e2e

Text Generation • Updated about 12 hours ago • 110

nm-testing/TinyLlama-1.1B-Chat-v1.0-FP8_DYNAMIC-e2e

Text Generation • Updated about 12 hours ago • 32

nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A8-e2e

Text Generation • Updated about 12 hours ago • 30

nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A8_tensor_weight_static_per_tensor_act-e2e

Text Generation • Updated about 12 hours ago • 97

nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A8_channel_weight_static_per_tensor-e2e

Text Generation • Updated about 12 hours ago • 104

nm-testing/TinyLlama-1.1B-Chat-v1.0-actorder-weight-e2e

Text Generation • Updated about 12 hours ago • 119

nm-testing/TinyLlama-1.1B-Chat-v1.0-actorder-group-e2e

Text Generation • Updated about 11 hours ago • 61

nm-testing/tinyllama-fp8-dynamic-compressed-hf-quantizer

Updated 17 days ago • 4

nm-testing/tinyllama-w4a16-compressed-hf-quantizer

Updated 17 days ago • 9

nm-testing/tinyllama-w8a8-compressed-hf-quantizer

Updated 17 days ago • 9

nm-testing/tinyllama-w8a16-dense-hf-quantizer

Updated 17 days ago • 5

nm-testing/Meta-Llama-3.1-8B-Instruct-FP8-hf

Text Generation • Updated 4 days ago • 12

neuralmagic/Llama-3.2-1B-Instruct-FP8

Text Generation • Updated about 16 hours ago • 16

nm-testing/tiny-llama-w4a16-new-key

Updated 1 day ago • 28

neuralmagic/Phi-3.5-mini-instruct-FP8-KV

Text Generation • Updated about 17 hours ago