Update README.md
Browse files
README.md
CHANGED
|
@@ -7,9 +7,7 @@ language:
|
|
| 7 |
|
| 8 |
From BKAI Vietnamese LLama2 120GB 7B, I pretrain on law/online public services crawl on VBPL
|
| 9 |
|
| 10 |
-
###
|
| 11 |
-
We conduct a single-epoch continual pretraining using the Llama2-7B model.
|
| 12 |
-
|
| 13 |
The model is pretrain on a single A600 system.
|
| 14 |
|
| 15 |
Hyperparameters are set as follows:
|
|
|
|
| 7 |
|
| 8 |
From BKAI Vietnamese LLama2 120GB 7B, I pretrain on law/online public services crawl on VBPL
|
| 9 |
|
| 10 |
+
### Training process
|
|
|
|
|
|
|
| 11 |
The model is pretrain on a single A600 system.
|
| 12 |
|
| 13 |
Hyperparameters are set as follows:
|