Update README.md
Browse files
README.md
CHANGED
@@ -4,9 +4,9 @@ Author: Jan Kocoń 🔗[LinkedIn](https://www.linkedin.com/in
|
|
4 |
|
5 |
Changes concerning [Neuronovo/neuronovo-7B-v0.2](https://huggingface.co/Neuronovo/neuronovo-7B-v0.2):
|
6 |
|
7 |
-
1. **Training Dataset**: In addition to the
|
8 |
|
9 |
-
2. **Tokenizer and Formatting**: The tokenizer now originates directly from the
|
10 |
|
11 |
3. **Training Configuration**: The training approach has shifted from using `max_steps=200` to `num_train_epochs=1`. This represents a change in the training strategy, focusing on epoch-based training rather than a fixed number of steps.
|
12 |
|
|
|
4 |
|
5 |
Changes concerning [Neuronovo/neuronovo-7B-v0.2](https://huggingface.co/Neuronovo/neuronovo-7B-v0.2):
|
6 |
|
7 |
+
1. **Training Dataset**: In addition to the [Intel/orca_dpo_pairs](Intel/orca_dpo_pairs) dataset, this version incorporates a [mlabonne/chatml_dpo_pairs](https://huggingface.co/datasets/mlabonne/chatml_dpo_pairs). The combined datasets enhance the model's capabilities in dialogues and interactive scenarios, further specializing it in natural language understanding and response generation.
|
8 |
|
9 |
+
2. **Tokenizer and Formatting**: The tokenizer now originates directly from the [Neuronovo/neuronovo-7B-v0.2](https://huggingface.co/Neuronovo/neuronovo-7B-v0.2) model.
|
10 |
|
11 |
3. **Training Configuration**: The training approach has shifted from using `max_steps=200` to `num_train_epochs=1`. This represents a change in the training strategy, focusing on epoch-based training rather than a fixed number of steps.
|
12 |
|