jiyuanq's picture
Update README.md
c4047a7
|
raw
history blame
265 Bytes
metadata
library_name: transformers
pipeline_tag: text-generation

falcon-40b-instruct quantized with GPTQ using the script in https://github.com/huggingface/text-generation-inference/pull/438

  • group size: 128
  • act order: true
  • nsamples: 128
  • dataset: wikitext2