hfl
/

chinese-alpaca-2-1.3b-rlhf-gguf

Inference Endpoints

Model card Files Files and versions Community

hfl-rc commited on Jan 24, 2024

Commit

b880ba8

·

verified ·

1 Parent(s): 23bddf0

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -26,6 +26,7 @@ Metric: PPL, lower is better
 | Q5_K | 15.3198 +/- 0.23627 | 15.4791 +/- 0.23959 |
 | Q6_K | 15.3718 +/- 0.23764 | 15.2572 +/- 0.23549 |
 | Q8_0 | 15.3302 +/- 0.23727 | - |
 *The model with `-im` suffix is generated with important matrix, which has generally better performance (not always though).*

 | Q5_K | 15.3198 +/- 0.23627 | 15.4791 +/- 0.23959 |
 | Q6_K | 15.3718 +/- 0.23764 | 15.2572 +/- 0.23549 |
 | Q8_0 | 15.3302 +/- 0.23727 | - |
+| F16 | 15.3291 +/- 0.23728 | - |
 *The model with `-im` suffix is generated with important matrix, which has generally better performance (not always though).*