TheBloke commited on
Commit
d7dadd2
·
1 Parent(s): a528afe

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -7,13 +7,13 @@ license: other
7
 
8
  These files are GPTQ 4bit model files for [Tim Dettmers' Guanaco 33B](https://huggingface.co/timdettmers/guanaco-65b).
9
 
10
- It is the result of quantising to 4bit using [GPTQ-for-LLaMa](https://github.com/qwopqwop200/GPTQ-for-LLaMa).
11
 
12
  ## Other repositories available
13
 
14
  * [4-bit GPTQ models for GPU inference](https://huggingface.co/TheBloke/TheBloke/guanaco-65B-GPTQ)
15
  * [4-bit, 5-bit and 8-bit GGML models for CPU(+GPU) inference](https://huggingface.co/TheBloke/guanaco-65B-GGML)
16
- * [Original unquantised fp16 model in HF format](https://huggingface.co/timdettmers/guanaco-65b)
17
 
18
  ## How to easily download and use this model in text-generation-webui
19
 
 
7
 
8
  These files are GPTQ 4bit model files for [Tim Dettmers' Guanaco 33B](https://huggingface.co/timdettmers/guanaco-65b).
9
 
10
+ It is the result of merging the LoRA then quantising to 4bit using [GPTQ-for-LLaMa](https://github.com/qwopqwop200/GPTQ-for-LLaMa).
11
 
12
  ## Other repositories available
13
 
14
  * [4-bit GPTQ models for GPU inference](https://huggingface.co/TheBloke/TheBloke/guanaco-65B-GPTQ)
15
  * [4-bit, 5-bit and 8-bit GGML models for CPU(+GPU) inference](https://huggingface.co/TheBloke/guanaco-65B-GGML)
16
+ * [Original unquantised fp16 model in HF format](https://huggingface.co/TheBloke/guanaco-65B-HF)
17
 
18
  ## How to easily download and use this model in text-generation-webui
19