Hugging Face's logo

michaelfeil
/
ct2fast-dolly-v2-7b

Transformers
ctranslate2
Inference Endpoints
Model card Files Community
michaelfeil commited on
Commit
42a3895
•
1 Parent(s): 76033bc

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -14,7 +14,7 @@ pip install hf_hub_ctranslate2>=1.0.0 ctranslate2>=3.13.0
14
 
15
  Checkpoint compatible to [ctranslate2](https://github.com/OpenNMT/CTranslate2) and [hf-hub-ctranslate2](https://github.com/michaelfeil/hf-hub-ctranslate2)
16
  - `compute_type=int8_float16` for `device="cuda"`
17
- - `compute_type=int8` for `device="cuda"`
18
 
19
  ```python
20
  from hf_hub_ctranslate2 import TranslatorCT2fromHfHub, GeneratorCT2fromHfHub
 
14
 
15
  Checkpoint compatible to [ctranslate2](https://github.com/OpenNMT/CTranslate2) and [hf-hub-ctranslate2](https://github.com/michaelfeil/hf-hub-ctranslate2)
16
  - `compute_type=int8_float16` for `device="cuda"`
17
+ - `compute_type=int8` for `device="cpu"`
18
 
19
  ```python
20
  from hf_hub_ctranslate2 import TranslatorCT2fromHfHub, GeneratorCT2fromHfHub