---
language:
- en
- ja
license: apache-2.0
tags:
- text-generation-inference
- transformers
- unsloth
- llama
- trl
base_model: NilanE/tinyllama-relora-merge
datasets:
- NilanE/SmallParallelDocs-Ja_En-6k-preChunkedForTinyllama
---

In-progess long-context Japanese-English translation model based on tinyllama. Input should be 500-1000 tokens long. Make sure to set 'do_sample = False' if using HF transformers for inference, or otherwise set temperature to 0 for deterministic outputs.

## Prompt format
"""Translate this from Japanese to English:\n### JAPANESE: {source text} \n### ENGLISH: """