mcganiz commited on
Commit
2ba2b76
1 Parent(s): 1fb203f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -6,15 +6,15 @@ base_model: unsloth/llama-3-8b-bnb-4bit
6
 
7
  # VeriUS LLM 8b v0.2
8
 
9
- VeriUS LLM is a generative model that is fine-tuned on Llama-3-8B (Unsloth).
10
 
11
 
12
  ## Model Details
13
  Base Model: unsloth/llama-3-8b-bnb-4bit
14
 
15
- Training Dataset: A combined dataset of alpaca, dolly and bactrainx which is translated to turkish.
16
 
17
- Training Method: Fine-tuned with Unsloth, QLoRA and ORPO
18
 
19
  #TrainingArguments\
20
  PER_DEVICE_BATCH_SIZE: 2\
 
6
 
7
  # VeriUS LLM 8b v0.2
8
 
9
+ VeriUS LLM is a instruct following large language model supporting Turkish language based on llama3-8B.
10
 
11
 
12
  ## Model Details
13
  Base Model: unsloth/llama-3-8b-bnb-4bit
14
 
15
+ Training Dataset: A carefully curated general domain Turkish instruction dataset.
16
 
17
+ Training Method: Fine-tuned using QLoRA and ORPO
18
 
19
  #TrainingArguments\
20
  PER_DEVICE_BATCH_SIZE: 2\