ctheodoris
commited on
Commit
•
0a8c47b
1
Parent(s):
f89f796
Update model card with information about fine-tuning
Browse files
README.md
CHANGED
@@ -27,4 +27,6 @@ cd Geneformer
|
|
27 |
pip install .
|
28 |
```
|
29 |
|
30 |
-
For usage, see [examples](https://huggingface.co/ctheodoris/Geneformer/tree/main/examples) for pretraining
|
|
|
|
|
|
27 |
pip install .
|
28 |
```
|
29 |
|
30 |
+
For usage, see [examples](https://huggingface.co/ctheodoris/Geneformer/tree/main/examples) for tokenizing, pretraining, fine-tuning, hyperparameter tuning, and in silico perturbation. Please note that the fine-tuning examples are meant to be generally applicable and the input datasets and labels will vary dependent on the downstream task. Example input files for a few of the downstream tasks demonstrated in the manuscript are located within the [example_input_files directory](https://huggingface.co/datasets/ctheodoris/Genecorpus-30M/tree/main/example_input_files) in the dataset repository, but these only represent a few example fine-tuning applications.
|
31 |
+
|
32 |
+
Please note that GPU resources are required for efficient usage of Geneformer. Additionally, we strongly recommend tuning hyperparameters for each downstream fine-tuning application as this can significantly boost predictive potential in the downstream task (e.g. max learning rate, learning schedule, number of layers to freeze, etc.).
|