|
--- |
|
language: |
|
- en |
|
- ja |
|
license: apache-2.0 |
|
tags: |
|
- text-generation-inference |
|
- transformers |
|
- unsloth |
|
- llama |
|
- trl |
|
base_model: NilanE/tinyllama-relora-merge |
|
datasets: |
|
- NilanE/SmallParallelDocs-Ja_En-6k-preChunkedForTinyllama |
|
--- |
|
|
|
In-progess long-context Japanese-English translation model based on tinyllama. Input should be 500-1000 tokens long. Make sure to set 'do_sample = False' if using HF transformers for inference, or otherwise set temperature to 0 for deterministic outputs. |
|
|
|
## Prompt format |
|
"""Translate this from Japanese to English:\n### JAPANESE: {source text} \n### ENGLISH: """ |
