yichunkuo
/

falcon-rw-1b-gptq

GPTQ quantized falcon-rw-1b

Branch	Bits	GS	Act Order	Damp %	GPTQ Dataset	Seq Len	Size	ExLlama	Desc
main	2048	--	No	8-bit, without Act Order and no grouop size.

Safetensors

Model size

407M params

Tensor type

I32

FP16

Inference Providers NEW

This model is not currently available via any of the supported Inference Providers.