Update README.md
Browse files
README.md
CHANGED
@@ -7,7 +7,10 @@ language:
|
|
7 |
|
8 |
# test of ModernBERT2Olmo-large_1b
|
9 |
|
10 |
-
experimental
|
|
|
|
|
|
|
11 |
|
12 |
```py
|
13 |
from transformers import AutoTokenizer, AutoModelForSeq2SeqLM
|
@@ -33,4 +36,3 @@ generated_text = tokenizer.batch_decode(generated_ids, skip_special_tokens=True)
|
|
33 |
print(generated_text)
|
34 |
```
|
35 |
|
36 |
-
Output is currently gibberish bc cross attn needs training
|
|
|
7 |
|
8 |
# test of ModernBERT2Olmo-large_1b
|
9 |
|
10 |
+
experimental seq2seq with EncoderDecoderModel. You will need to patch `modeling_llama.py` with [this code](https://gist.github.com/pszemraj/a15219f33d94dc53a6e270c0c81360ec) for it work
|
11 |
+
|
12 |
+
> [!WARNING]
|
13 |
+
> WIP + output of this model is gibberish bc cross attn needs training
|
14 |
|
15 |
```py
|
16 |
from transformers import AutoTokenizer, AutoModelForSeq2SeqLM
|
|
|
36 |
print(generated_text)
|
37 |
```
|
38 |
|
|