AmelieSchreiber
commited on
Commit
•
4d0ba55
1
Parent(s):
0b6b91e
Update README.md
Browse files
README.md
CHANGED
@@ -14,7 +14,7 @@ tags:
|
|
14 |
|
15 |
These are the checkpoints for the first ever QLoRA for ESM-2! They haven't been checked for overfitting yet, so use with caution!
|
16 |
You can load and use them similarly to the LoRA models. This is the smallest `esm2_t6_8M_UR50D` model, so the metrics aren't great.
|
17 |
-
Scaling to larger models for better metrics is in progress.
|
18 |
|
19 |
## QLoRA Info
|
20 |
|
|
|
14 |
|
15 |
These are the checkpoints for the first ever QLoRA for ESM-2! They haven't been checked for overfitting yet, so use with caution!
|
16 |
You can load and use them similarly to the LoRA models. This is the smallest `esm2_t6_8M_UR50D` model, so the metrics aren't great.
|
17 |
+
Scaling to larger models for better metrics is in progress. These checkpoints were trained using [the 600K dataset](https://huggingface.co/datasets/AmelieSchreiber/600K_data).
|
18 |
|
19 |
## QLoRA Info
|
20 |
|