ringoreality
commited on
Commit
•
12c73e8
1
Parent(s):
9d69232
Update README.md
Browse files
README.md
CHANGED
@@ -28,7 +28,7 @@ It is also possible to evaluate the model with https://github.com/EleutherAI/lm-
|
|
28 |
## Training
|
29 |
- For the Llama2 training data, we refer the user to https://huggingface.co/meta-llama/Llama-2-70b-hf.
|
30 |
- For continued pretraining, 4.2B climate domain tokens (tokenized by the Llama tokenizer) are used.
|
31 |
-
- For instruction finetuning, about
|
32 |
|
33 |
## Environmental Impact
|
34 |
- **Hardware Type:** H100
|
|
|
28 |
## Training
|
29 |
- For the Llama2 training data, we refer the user to https://huggingface.co/meta-llama/Llama-2-70b-hf.
|
30 |
- For continued pretraining, 4.2B climate domain tokens (tokenized by the Llama tokenizer) are used.
|
31 |
+
- For instruction finetuning, about 272K instruction-completion pairs (both in the climate domain but also general domain) are used.
|
32 |
|
33 |
## Environmental Impact
|
34 |
- **Hardware Type:** H100
|