File size: 589 Bytes
45ebf9e
 
3fe3e61
ccee91f
 
 
 
 
 
 
45ebf9e
 
 
95f68f6
eb9c35d
 
 
 
 
 
 
 
 
 
45ebf9e
daf15c9
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
---
license: mit
tags:
- dna
- language-model
- variant-effect-prediction
- biology
- genomics
datasets:
- songlab/genomes-brassicales-balanced-v1
---
# GPN trained on *Arabidopsis thaliana* and 7 other Brassicales
See https://github.com/songlab-cal/gpn for more details.

Basic usage:
```python
import gpn.model
from transformers import AutoModel, AutoModelForMaskedLM

model = AutoModel.from_pretrained("songlab/gpn-brassicales")
# or
model = AutoModelForMaskedLM.from_pretrained("songlab/gpn-brassicales")
```

## Some hparams:
* repeat_weight: 0.1
* lr: 120k at 1e-3 + 30k cosine decay