nisten commited on
Commit
bbcded8
1 Parent(s): 4dd721e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -2
README.md CHANGED
@@ -58,9 +58,13 @@ perplexity EdgeQuant iq4-ns edgequant (no imatrix) 84.45 seconds per pass - FILE
58
  [1]2.7195,[2]3.1821,[3]3.7177,[4]3.3017,[5]2.8012,[6]2.6034,[7]2.4318,[8]2.3747,[9]2.4160,[10]2.3931,[11]2.4023,[12]2.4013,
59
  Final estimate: PPL = 2.4013 +/- 0.07116
60
 
61
- perplexity EdgeQuant iq4-ns edgequant (WITH imatrix) 75626 MB: 82.76 seconds per pass - FILESIZE 75626 MB ( mix4ns.gguf )
62
  [1]2.7175,[2]3.1616,[3]3.6859,[4]3.3012,[5]2.7780,[6]2.5755,[7]2.4093,[8]2.3523,[9]2.3885,[10]2.3757,[11]2.3859,[12]2.3843,
63
- Final estimate: PPL = 2.3843 +/- 0.07036
 
 
 
 
64
  ```
65
 
66
  ![image/png](https://cdn-uploads.huggingface.co/production/uploads/6379683a81c1783a4a2ddba8/tNd_wHwdbgRGx28ZgBHGq.png)
 
58
  [1]2.7195,[2]3.1821,[3]3.7177,[4]3.3017,[5]2.8012,[6]2.6034,[7]2.4318,[8]2.3747,[9]2.4160,[10]2.3931,[11]2.4023,[12]2.4013,
59
  Final estimate: PPL = 2.4013 +/- 0.07116
60
 
61
+ perplexity EdgeQuant iq4-ns edgequant (WITH imatrix) 82.76 seconds per pass - FILESIZE 75626 MB ( mix4ns.gguf )
62
  [1]2.7175,[2]3.1616,[3]3.6859,[4]3.3012,[5]2.7780,[6]2.5755,[7]2.4093,[8]2.3523,[9]2.3885,[10]2.3757,[11]2.3859,[12]2.3843,
63
+ Final estimate: PPL = 2.3843 +/- 0.07036
64
+
65
+ perplexity 2K (no imatrix) 207.70 seconds per pass - FILESIZE 47564MB (mix2k-noimatrix-but-usable-reference.gguf)
66
+ [1]2.9401,[2]3.4224,[3]4.0174,[4]3.8503,[5]3.5607,[6]3.4449,[7]3[9]3.5589,[10]3.6546,[11]3.7810,[12]3.7733,
67
+ Final estimate: PPL = 3.7733 +/- 0.13299
68
  ```
69
 
70
  ![image/png](https://cdn-uploads.huggingface.co/production/uploads/6379683a81c1783a4a2ddba8/tNd_wHwdbgRGx28ZgBHGq.png)