Text2Text Generation
NeMo
PyTorch
English
causal-lm
okuchaiev commited on
Commit
2d335ea
1 Parent(s): d1b529c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -0
README.md CHANGED
@@ -105,6 +105,10 @@ The model was trained on ["The Piles" dataset prepared by Eleuther.AI](https://p
105
  | ------------- | -------- | ----------- | --------- | ---------- | --- | ------ | --------- | ---- |
106
  | 0.3012 | 0.4596 | 0.459 | 0.3797 | 0.5343 | 0.5451 | 0.5979 | 0.4443 | 0.6834 |
107
 
 
 
 
 
108
  ## References
109
 
110
  [1] [Improving Language Understanding by Generative Pre-Training](https://s3-us-west-2.amazonaws.com/openai-assets/research-covers/language-unsupervised/language_understanding_paper.pdf)
 
105
  | ------------- | -------- | ----------- | --------- | ---------- | --- | ------ | --------- | ---- |
106
  | 0.3012 | 0.4596 | 0.459 | 0.3797 | 0.5343 | 0.5451 | 0.5979 | 0.4443 | 0.6834 |
107
 
108
+ ## Limitations
109
+
110
+ The model was trained on the data originally crawled from the Internet. This data contains toxic language and societal biases. Therefore, the model may amplify those biases and return toxic responses especially when prompted with toxic prompts.
111
+
112
  ## References
113
 
114
  [1] [Improving Language Understanding by Generative Pre-Training](https://s3-us-west-2.amazonaws.com/openai-assets/research-covers/language-unsupervised/language_understanding_paper.pdf)