Commit
•
93b1c30
1
Parent(s):
a0b7213
add images to readme
Browse files
README.md
CHANGED
@@ -48,9 +48,11 @@ and you can view http://localhost:8000/docs to see the swagger UI.
|
|
48 |
|
49 |
## Provided images
|
50 |
|
51 |
-
| Name
|
52 |
-
|
|
53 |
-
| `shaowenchen/vicuna-7b-v1.5-16k-gguf` | Q2_K |
|
|
|
|
|
54 |
|
55 |
Usage:
|
56 |
|
|
|
48 |
|
49 |
## Provided images
|
50 |
|
51 |
+
| Name | Quant method | Compressed Size |
|
52 |
+
| ------------------------------------------ | ------------ | --------------- |
|
53 |
+
| `shaowenchen/vicuna-7b-v1.5-16k-gguf:Q2_K` | Q2_K | 2.88 GB |
|
54 |
+
| `shaowenchen/vicuna-7b-v1.5-16k-gguf:Q3_K` | Q3_K | 3.3 GB |
|
55 |
+
| `shaowenchen/vicuna-7b-v1.5-16k-gguf:Q4_K` | Q4_K | 4 GB |
|
56 |
|
57 |
Usage:
|
58 |
|