Update README.md
Browse files
README.md
CHANGED
@@ -23,6 +23,22 @@ model-index:
|
|
23 |
|
24 |
This modelcard aims to be a base template for new models. It has been generated using [this raw template](https://github.com/huggingface/huggingface_hub/blob/main/src/huggingface_hub/templates/modelcard_template.md?plain=1).
|
25 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
26 |
## Model Details
|
27 |
|
28 |
### Model Description
|
|
|
23 |
|
24 |
This modelcard aims to be a base template for new models. It has been generated using [this raw template](https://github.com/huggingface/huggingface_hub/blob/main/src/huggingface_hub/templates/modelcard_template.md?plain=1).
|
25 |
|
26 |
+
# Quantizationed versions
|
27 |
+
|
28 |
+
Quantizationed versions of this model are available thanks to [TheBloke](https://hf.co/TheBloke).
|
29 |
+
|
30 |
+
##### GPTQ
|
31 |
+
|
32 |
+
- [TheBloke/vicuna-33B-coder-GPTQ](https://huggingface.co/TheBloke/vicuna-33B-coder-GPTQ)
|
33 |
+
|
34 |
+
##### GGUF
|
35 |
+
|
36 |
+
- [TheBloke/vicuna-33B-coder-GGUF](https://huggingface.co/TheBloke/vicuna-33B-coder-GGUF)
|
37 |
+
|
38 |
+
##### AWQ
|
39 |
+
|
40 |
+
- [TheBloke/vicuna-33B-coder-AWQ](https://huggingface.co/TheBloke/vicuna-33B-coder-AWQ)
|
41 |
+
|
42 |
## Model Details
|
43 |
|
44 |
### Model Description
|