Panchovix commited on
Commit
da86bfd
1 Parent(s): 7e08fc5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -1
README.md CHANGED
@@ -11,4 +11,8 @@ Use (max_seq_len = context):
11
 
12
  If max_seq_len = 4096, compress_pos_emb = 2
13
 
14
- If max_seq_len = 8192, compress_pos_emb = 4
 
 
 
 
 
11
 
12
  If max_seq_len = 4096, compress_pos_emb = 2
13
 
14
+ If max_seq_len = 8192, compress_pos_emb = 4
15
+
16
+ If you have 2x24 GB VRAM GPUs cards, to not get Out of Memory errors at 8192 context, use:
17
+
18
+ gpu_split: 9,21