Inferless
/

SOLAR-10.7B-Instruct-v1.0-GPTQ

Text Generation

text-generation-inference

Model card Files Files and versions Community

rbgo commited on Jan 2

Commit

5de8b0b

•

1 Parent(s): 62be699

Update README.md

Files changed (1) hide show

README.md +2 -4

README.md CHANGED Viewed

@@ -68,15 +68,13 @@ It is supported by:
 <!-- description end -->
 <!-- repositories-available start -->
-## Provided files, and AWQ parameters
-I currently release 128g GEMM models only. The addition of group_size 32 models, and GEMV kernel models, is being actively considered.
 Models are released as sharded safetensors files.
 | Branch | Bits | GS | AWQ Dataset | Seq Len | Size |
 | ------ | ---- | -- | ----------- | ------- | ---- |
-| [main](https://huggingface.co/TheBloke/Nous-Hermes-2-SOLAR-10.7B-AWQ/tree/main) | 4 | 128 | [VMware Open Instruct](https://huggingface.co/datasets/VMware/open-instruct/viewer/) | 4096 | 5.96 GB
 <!-- README_AWQ.md-provided-files end -->

 <!-- description end -->
 <!-- repositories-available start -->
+## Shared files, and GPTQ parameters
 Models are released as sharded safetensors files.
 | Branch | Bits | GS | AWQ Dataset | Seq Len | Size |
 | ------ | ---- | -- | ----------- | ------- | ---- |
+| [main](https://huggingface.co/Inferless/SOLAR-10.7B-Instruct-v1.0-GPTQ/tree/main) | 4 | 128 | [VMware Open Instruct](https://huggingface.co/datasets/VMware/open-instruct/viewer/) | 4096 | 5.96 GB
 <!-- README_AWQ.md-provided-files end -->