amasi/biomistral-gptq-ft
Browse files
README.md
CHANGED
@@ -16,7 +16,7 @@ should probably proofread and complete it, then remove this comment. -->
|
|
16 |
|
17 |
This model is a fine-tuned version of [LoneStriker/BioMistral-7B-SLERP-GPTQ](https://huggingface.co/LoneStriker/BioMistral-7B-SLERP-GPTQ) on the None dataset.
|
18 |
It achieves the following results on the evaluation set:
|
19 |
-
- Loss: 1.
|
20 |
|
21 |
## Model description
|
22 |
|
@@ -51,9 +51,9 @@ The following hyperparameters were used during training:
|
|
51 |
|
52 |
| Training Loss | Epoch | Step | Validation Loss |
|
53 |
|:-------------:|:-----:|:----:|:---------------:|
|
54 |
-
| 1.
|
55 |
-
| 1.
|
56 |
-
| 1.
|
57 |
|
58 |
|
59 |
### Framework versions
|
|
|
16 |
|
17 |
This model is a fine-tuned version of [LoneStriker/BioMistral-7B-SLERP-GPTQ](https://huggingface.co/LoneStriker/BioMistral-7B-SLERP-GPTQ) on the None dataset.
|
18 |
It achieves the following results on the evaluation set:
|
19 |
+
- Loss: 1.3391
|
20 |
|
21 |
## Model description
|
22 |
|
|
|
51 |
|
52 |
| Training Loss | Epoch | Step | Validation Loss |
|
53 |
|:-------------:|:-----:|:----:|:---------------:|
|
54 |
+
| 1.9096 | 1.0 | 62 | 1.3700 |
|
55 |
+
| 1.3713 | 1.99 | 124 | 1.3455 |
|
56 |
+
| 1.3253 | 2.99 | 186 | 1.3391 |
|
57 |
|
58 |
|
59 |
### Framework versions
|