Habana
/

distilbert-base-uncased

Model card Files Files and versions Community

jwieczorekhabana commited on Jul 21, 2023

Commit

98d2604

•

1 Parent(s): d0b8563

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -21,7 +21,7 @@ This enables to specify:
 The model is instantiated the same way as in the Transformers library.
 The only difference is that there are a few new training arguments specific to HPUs.\
-This model is supported only in mixed precision training with bf16 type.
 [Here](https://github.com/huggingface/optimum-habana/blob/main/examples/question-answering/run_qa.py) is a question-answering example script to fine-tune a model on SQuAD. You can run it with DistilBERT with the following command:
 ```bash

 The model is instantiated the same way as in the Transformers library.
 The only difference is that there are a few new training arguments specific to HPUs.\
+It is strongly recommended to train this model doing bf16 mixed-precision training for optimal performance and accuracy.
 [Here](https://github.com/huggingface/optimum-habana/blob/main/examples/question-answering/run_qa.py) is a question-answering example script to fine-tune a model on SQuAD. You can run it with DistilBERT with the following command:
 ```bash