Update README.md
Browse files
README.md
CHANGED
@@ -26,4 +26,13 @@ This model is for personal use, made for myself as experiment. I would like to m
|
|
26 |
|
27 |
### Settings
|
28 |
|
29 |
-
Setting from Midnight-Rose should work. This is almost same what I use for testing.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
26 |
|
27 |
### Settings
|
28 |
|
29 |
+
Setting from Midnight-Rose should work. This is almost same what I use for testing.
|
30 |
+
|
31 |
+
I use max_seq_len 8K with alpha_value 2,65.
|
32 |
+
|
33 |
+
### Quants
|
34 |
+
|
35 |
+
- [3.92](https://huggingface.co/altomek/CodeRosa-70B-AB1-3.92bpw-EXL2) --> 40GB VRAM
|
36 |
+
|
37 |
+
### PS
|
38 |
+
I welcome your comments about this model.
|