ldilov
/

stablelm-tuned-alpha-7b-4bit-128g-descact-sym-true-sequential

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

stablelm-tuned-alpha-7b-4bit-128g-descact-sym-true-sequential / quantize_config.json

ldilov's picture

Upload GPTNeoXGPTQForCausalLM

43e5008 over 1 year ago

122 Bytes

	{
	"bits": 4,
	"group_size": 128,
	"damp_percent": 0.01,
	"desc_act": true,
	"sym": true,
	"true_sequential": true
	}