Update README.md
Browse files
README.md
CHANGED
|
@@ -6,4 +6,6 @@ FP16 model of airoboros 70b 1.4.1 (https://huggingface.co/jondurbin/airoboros-l2
|
|
| 6 |
|
| 7 |
It can also be used to load faster at FP16 using transformers.
|
| 8 |
|
| 9 |
-
There is a script inside bin2safetensors folder, that you can use to convert .bin files into .safetensor ones for other models.
|
|
|
|
|
|
|
|
|
| 6 |
|
| 7 |
It can also be used to load faster at FP16 using transformers.
|
| 8 |
|
| 9 |
+
There is a script inside bin2safetensors folder, that you can use to convert .bin files into .safetensor ones for other models.
|
| 10 |
+
|
| 11 |
+
Also, I included 2 measurements.json to be used to quant. First one was made with https://huggingface.co/datasets/EleutherAI/the_pile_deduplicated/blob/refs%2Fconvert%2Fparquet/default/train/0000.parquet and first exllamav2 version, and the second one is a cleaned pippa, with good formatting on 17/09/2023 exllamav2.
|