MaziyarPanahi
/

WizardLM-2-8x22B-GGUF

Text Generation

4-bit precision

8-bit precision

arxiv:2304.12244

arxiv:2306.08568

arxiv:2308.09583

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

WizardLM-2-8x22B-GGUF

Commit History

add example how to download splits for 1 quant

33cff3d
verified

MaziyarPanahi commited on Apr 15, 2024

Upload folder using huggingface_hub (#3)

4a6e8ed
verified

MaziyarPanahi commited on Apr 15, 2024

add shareded model example (#5)

1ac430a
verified

MaziyarPanahi commited on Apr 15, 2024

Fix the wrong base model (#4)

d43d716
verified

MaziyarPanahi commited on Apr 15, 2024

Upload folder using huggingface_hub (#1)

25f2341
verified

MaziyarPanahi commited on Apr 15, 2024

Create README.md (#2)

d1876e7
verified

MaziyarPanahi commited on Apr 15, 2024

initial commit

c202160
verified

MaziyarPanahi commited on Apr 15, 2024