dfurman
/

Falcon-7B-Chat-v0.1

Text Generation

Model card Files Files and versions Community

dfurman commited on May 31, 2023

Commit

d0fa7b9

•

1 Parent(s): cbc3abb

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -89,9 +89,9 @@ We recommend users of this model to develop guardrails and to take appropriate p
 !pip install -q -U git+https://github.com/huggingface/accelerate.git
 ```
-### GPU Inference in 4-bit
-This requires a GPU with at least XXGB of memory.
 ```python
 import torch

 !pip install -q -U git+https://github.com/huggingface/accelerate.git
 ```
+### GPU Inference in 8-bit
+This requires a GPU with at least 12 GB of memory.
 ```python
 import torch