Falcon 180B Chat - GPTQ

Description

This repo contains GPTQ model files for Technology Innovation Institute's Falcon 180B Chat. with correct chat template inside tokenizer_config.json

Safetensors

Model size

24.7B params

Tensor type

I32

FP16

Inference Providers NEW

This model is not currently available via any of the supported Inference Providers.

The model cannot be deployed to the HF Inference API: The model authors have turned it off explicitly.

Base model

Quantized

(5)

this model