huseinzol05
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -345,6 +345,11 @@ Bah, kunuk sia mau bilang pasal bah, mungkin ada buyuk-buyuk yang nda kasi baik
|
|
345 |
------
|
346 |
```
|
347 |
|
|
|
|
|
|
|
|
|
|
|
348 |
## how to finetune your own dataset?
|
349 |
|
350 |
We finetuned using T5 SDPA multipacking forked at https://github.com/mesolitica/t5-sdpa-multipack, super undocumented, but scripts from https://github.com/huggingface/transformers/tree/main/examples/pytorch/translation should work also.
|
|
|
345 |
------
|
346 |
```
|
347 |
|
348 |
+
## speed up inference
|
349 |
+
|
350 |
+
Use SDPA fork at https://github.com/mesolitica/t5-sdpa,
|
351 |
+
Or you can finish the PR at https://github.com/huggingface/transformers/pull/31167 lol.
|
352 |
+
|
353 |
## how to finetune your own dataset?
|
354 |
|
355 |
We finetuned using T5 SDPA multipacking forked at https://github.com/mesolitica/t5-sdpa-multipack, super undocumented, but scripts from https://github.com/huggingface/transformers/tree/main/examples/pytorch/translation should work also.
|