Update README.md
Browse files
README.md
CHANGED
@@ -11,7 +11,12 @@ The code for merging is provided in the [WizardLM official Github repo](https://
|
|
11 |
|
12 |
## WizardLM-7B 4bit GPTQ
|
13 |
|
14 |
-
This repo contains 4bit GPTQ models, quantised using [GPTQ-for-LLaMa](https://github.com/qwopqwop200/GPTQ-for-LLaMa).
|
|
|
|
|
|
|
|
|
|
|
15 |
|
16 |
## GIBBERISH OUTPUT IN `text-generation-webui`?
|
17 |
|
|
|
11 |
|
12 |
## WizardLM-7B 4bit GPTQ
|
13 |
|
14 |
+
This repo contains 4bit GPTQ models for GPU inference, quantised using [GPTQ-for-LLaMa](https://github.com/qwopqwop200/GPTQ-for-LLaMa).
|
15 |
+
|
16 |
+
## Other repositories available
|
17 |
+
|
18 |
+
* [4bit GGML models for CPU inference](https://huggingface.co/TheBloke/wizardLM-7B-GGML)
|
19 |
+
* [Unquantised model in HF format](https://huggingface.co/TheBloke/wizardLM-7B-HF)
|
20 |
|
21 |
## GIBBERISH OUTPUT IN `text-generation-webui`?
|
22 |
|