Thireus
/

WizardLM-70B-V1.0-HF-5.0bpw-h6-exl2

Text Generation

Model card Files Files and versions Community

Thireus commited on Sep 18, 2023

Commit

d42e01d

•

1 Parent(s): 1c8e88d

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -19,7 +19,7 @@ quantized_by: Thireus
 | ------ | --------- | --------------- | ------------------------ | ----------- | ---------------- | ---- | ------- | ------------------ | ---- |------------------ | ------------------ |
 | [here](https://huggingface.co/Thireus/WizardLM-70B-V1.0-HF-4.0bpw-h6-exl2/) | 4.0 | 6 | 2048 | 2048 | [0000.parquet](https://huggingface.co/datasets/wikitext/tree/refs%2Fconvert%2Fparquet/wikitext-2-raw-v1/train)* | 35GB | [0.0.1](https://github.com/turboderp/exllamav2/commit/aee7a281708d5faff2ad0ea4b3a3a4b754f458f3) | 4096 | 79 | 40GB | 44GB |
 | [here](https://huggingface.co/Thireus/WizardLM-70B-V1.0-HF-5.0bpw-h6-exl2/) | 5.0 | 6 | 2048 | 2048 | [0000.parquet](https://huggingface.co/datasets/wikitext/tree/refs%2Fconvert%2Fparquet/wikitext-2-raw-v1/train)* | 44GB | [0.0.1](https://github.com/turboderp/exllamav2/commit/aee7a281708d5faff2ad0ea4b3a3a4b754f458f3) | 4096 | 79 | 48GB | 52GB |
-| _soon_ | 6.0 | 6 | 2048 | 2048 | [0000.parquet](https://huggingface.co/datasets/wikitext/tree/refs%2Fconvert%2Fparquet/wikitext-2-raw-v1/train)* | 49GB | [0.0.2](https://github.com/turboderp/exllamav2/commit/fae6fb296c6db4e3b1314c49c030541bed98acb9) | 4096 | 79 | 56GB | 60GB |
 \* wikitext-2-raw-v1

 | ------ | --------- | --------------- | ------------------------ | ----------- | ---------------- | ---- | ------- | ------------------ | ---- |------------------ | ------------------ |
 | [here](https://huggingface.co/Thireus/WizardLM-70B-V1.0-HF-4.0bpw-h6-exl2/) | 4.0 | 6 | 2048 | 2048 | [0000.parquet](https://huggingface.co/datasets/wikitext/tree/refs%2Fconvert%2Fparquet/wikitext-2-raw-v1/train)* | 35GB | [0.0.1](https://github.com/turboderp/exllamav2/commit/aee7a281708d5faff2ad0ea4b3a3a4b754f458f3) | 4096 | 79 | 40GB | 44GB |
 | [here](https://huggingface.co/Thireus/WizardLM-70B-V1.0-HF-5.0bpw-h6-exl2/) | 5.0 | 6 | 2048 | 2048 | [0000.parquet](https://huggingface.co/datasets/wikitext/tree/refs%2Fconvert%2Fparquet/wikitext-2-raw-v1/train)* | 44GB | [0.0.1](https://github.com/turboderp/exllamav2/commit/aee7a281708d5faff2ad0ea4b3a3a4b754f458f3) | 4096 | 79 | 48GB | 52GB |
+| [here](https://huggingface.co/Thireus/WizardLM-70B-V1.0-HF-4.0bpw-h6-exl2/) | 6.0 | 6 | 2048 | 2048 | [0000.parquet](https://huggingface.co/datasets/wikitext/tree/refs%2Fconvert%2Fparquet/wikitext-2-raw-v1/train)* | 49GB | [0.0.2](https://github.com/turboderp/exllamav2/commit/fae6fb296c6db4e3b1314c49c030541bed98acb9) | 4096 | 79 | 56GB | 60GB |
 \* wikitext-2-raw-v1