LoneStriker
/

Yi-6B-200K-8.0bpw-h8-exl2

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

Yi-6B-200K-8.0bpw-h8-exl2 / generation_config.json

Commit History

Upload folder using huggingface_hub

731f728
verified

LoneStriker commited on Mar 16

ExLLaMA V2 quant of Yi-6B-200K-8.0bpw-h8-exl2

c68be37

LoneStriker commited on Nov 7, 2023