huseinzol05 commited on
Commit
c28cf33
·
verified ·
1 Parent(s): c0a4afe

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -0
README.md CHANGED
@@ -345,6 +345,11 @@ Bah, kunuk sia mau bilang pasal bah, mungkin ada buyuk-buyuk yang nda kasi baik
345
  ------
346
  ```
347
 
 
 
 
 
 
348
  ## how to finetune your own dataset?
349
 
350
  We finetuned using T5 SDPA multipacking forked at https://github.com/mesolitica/t5-sdpa-multipack, super undocumented, but scripts from https://github.com/huggingface/transformers/tree/main/examples/pytorch/translation should work also.
 
345
  ------
346
  ```
347
 
348
+ ## speed up inference
349
+
350
+ Use SDPA fork at https://github.com/mesolitica/t5-sdpa,
351
+ Or you can finish the PR at https://github.com/huggingface/transformers/pull/31167 lol.
352
+
353
  ## how to finetune your own dataset?
354
 
355
  We finetuned using T5 SDPA multipacking forked at https://github.com/mesolitica/t5-sdpa-multipack, super undocumented, but scripts from https://github.com/huggingface/transformers/tree/main/examples/pytorch/translation should work also.