Tanvir1337
/

quantized-models

Text Generation

large language model

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

quantized-models / 3B

Commit History

Upload Llama-3.2-3B-Instruct-SpinQuant_INT4_EO8.pth

4c99798
verified

Tanvir1337 commited on 23 days ago

Upload 5 files

e0791b6
verified

Tanvir1337 commited on 23 days ago

add lmcocktail-phi-2-v1.Q8_0.gguf

085a913
unverified

Tanvir commited on Jan 18

add bling-stable-lm-3b-4e1t-v0.Q8_0.gguf

2cd8960
unverified

Tanvir commited on Jan 17

add stablelm-zephyr-3b.Q8_0.gguf

78b3bd4
unverified

Tanvir commited on Jan 17

add stable-code-3b.Q8_0.gguf

f64bba7
unverified

Tanvir commited on Jan 17

add zephyr-quiklang-3b-4k.Q8_0.gguf

606d52d
unverified

Tanvir commited on Jan 17