pszemraj commited on
Commit
24e5ada
·
verified ·
1 Parent(s): 7ae6c6e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -2
README.md CHANGED
@@ -7,7 +7,10 @@ language:
7
 
8
  # test of ModernBERT2Olmo-large_1b
9
 
10
- experimental seq2aeq with EncoderDecoderModel. You will need to patch `modeling_llama.py` with [this code](https://gist.github.com/pszemraj/a15219f33d94dc53a6e270c0c81360ec) for it work
 
 
 
11
 
12
  ```py
13
  from transformers import AutoTokenizer, AutoModelForSeq2SeqLM
@@ -33,4 +36,3 @@ generated_text = tokenizer.batch_decode(generated_ids, skip_special_tokens=True)
33
  print(generated_text)
34
  ```
35
 
36
- Output is currently gibberish bc cross attn needs training
 
7
 
8
  # test of ModernBERT2Olmo-large_1b
9
 
10
+ experimental seq2seq with EncoderDecoderModel. You will need to patch `modeling_llama.py` with [this code](https://gist.github.com/pszemraj/a15219f33d94dc53a6e270c0c81360ec) for it work
11
+
12
+ > [!WARNING]
13
+ > WIP + output of this model is gibberish bc cross attn needs training
14
 
15
  ```py
16
  from transformers import AutoTokenizer, AutoModelForSeq2SeqLM
 
36
  print(generated_text)
37
  ```
38