AI-Sweden-Models
/

gpt-sw3-6.7b-v2-instruct-4bit-gptq

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

gpt-sw3-6.7b-v2-instruct-4bit-gptq / quantize_config.json

Commit History

Create quantize_config.json

6f72481

Ekgren commited on Dec 1, 2023