Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,13 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
language:
|
3 |
+
- en
|
4 |
+
---
|
5 |
+
This is a GPTQ quantized version of [Nous-Hermes-limarp-l2-13B](https://huggingface.co/kingbri/Nous-Hermes-limarp-l2-13B)
|
6 |
+
|
7 |
+
Please refer to the original creator for more information.
|
8 |
+
|
9 |
+
Branches:
|
10 |
+
|
11 |
+
- main: 4 bits, groupsize 128, act order false
|
12 |
+
- 4bit-128g-actorder: 4 bits, groupsize 128, act order true
|
13 |
+
- 4bit-32g-actorder: 4 bits, groupsize 32, act order true
|