BelleGroup
/

BELLE-7B-gptq

Text2Text Generation

feature-extraction

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

mabaochang commited on Mar 25, 2023

Commit

5681744

•

1 Parent(s): dfc7369

Update README.md

Files changed (1) hide show

README.md +6 -4

README.md CHANGED Viewed

@@ -18,9 +18,11 @@ The code of inference can be found in our Github project repository: https://git
 ## Model list
-| model name       |  file size | GPU memory |
 | -------------------------------------------------- |  ------------------- | ------------------ |
-|           bloom7b-2m-8bit-128g.pt                  |          9.7G        |       11G          |
-|           bloom7b-2m-4bit-128g.pt                  |          6.9G        |        8G          |
-|           bloom7b-2m-3bit-128g.pt                  |          6.2G        |        7.7G        |

 ## Model list
+| model name       |  file size | GPU memory usage |
 | -------------------------------------------------- |  ------------------- | ------------------ |
+|           base                 |          27G        |       ~28.2G         |
+|           bloom7b-2m-8bit-128g.pt                  |          9.7G        |       ~11.4G          |
+|           bloom7b-2m-4bit-128g.pt                  |          6.9G        |        ~8.4G          |
+|           bloom7b-0.2m-8bit-128g.pt                  |          9.7G        |       ~11.4G          |
+|           bloom7b-0.2m-4bit-128g.pt                  |          6.9G        |        ~8.4G          |