Update README.md
Browse files
README.md
CHANGED
@@ -21,11 +21,11 @@ This version has the same context length (16k) and RoPE base frequency (1000000)
|
|
21 |
```
|
22 |
> ./perplexity -m eurus:70b-nca-fixed-q8_0.gguf -f wiki.test.raw -c 4096
|
23 |
|
24 |
-
Final estimate: 5.4451 +/- 0.03053
|
25 |
|
26 |
> ./perplexity -m eurus:70b-nca-fixed-q8_0.gguf -f wiki.test.raw -c 16384
|
27 |
|
28 |
-
Final estimate: 5.2458 +/- 0.02892
|
29 |
```
|
30 |
|
31 |
I have also tested it with multi-turn conversations for 10k+ context and it has remained perfectly coherent.
|
@@ -35,7 +35,7 @@ It even looks to be fine for use with a context length of 32k:
|
|
35 |
```
|
36 |
> ./perplexity -m eurus:70b-nca-fixed-q8_0.gguf -f wiki.test.raw -c 32768
|
37 |
|
38 |
-
Final estimate: 5.0394 +/- 0.02719
|
39 |
```
|
40 |
|
41 |
---
|
|
|
21 |
```
|
22 |
> ./perplexity -m eurus:70b-nca-fixed-q8_0.gguf -f wiki.test.raw -c 4096
|
23 |
|
24 |
+
Final estimate: PPL = 5.4451 +/- 0.03053
|
25 |
|
26 |
> ./perplexity -m eurus:70b-nca-fixed-q8_0.gguf -f wiki.test.raw -c 16384
|
27 |
|
28 |
+
Final estimate: PPL = 5.2458 +/- 0.02892
|
29 |
```
|
30 |
|
31 |
I have also tested it with multi-turn conversations for 10k+ context and it has remained perfectly coherent.
|
|
|
35 |
```
|
36 |
> ./perplexity -m eurus:70b-nca-fixed-q8_0.gguf -f wiki.test.raw -c 32768
|
37 |
|
38 |
+
Final estimate: PPL = 5.0394 +/- 0.02719
|
39 |
```
|
40 |
|
41 |
---
|