afrizalha commited on
Commit
9743cea
1 Parent(s): bf095ec

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -5
README.md CHANGED
@@ -9,6 +9,8 @@ tags:
9
  - qwen2
10
  - trl
11
  - sft
 
 
12
  ---
13
  <!DOCTYPE html>
14
  <html lang="en">
@@ -39,11 +41,13 @@ Bakpia V1 is a family of Javanese language models. It is fine-tuned from availab
39
 
40
  This repository contains the fp16 version of Bakpia V1 1.5B.
41
 
42
- | Version | Base Model | URL |
43
- |---------|------------|-----|
44
- | V1 0.5B | Qwen 2 0.5B Instruct | [fp16](huggingface.co/afrizalha/Bakpia-V1-0.5B-Javanese/) |
45
- | V1 1.5B | Qwen 2 1.5B Instruct | [fp16](huggingface.co/afrizalha/Bakpia-V1-1.5B-Javanese/) |
46
- | V1 9B | Gemma 2 9B Instruct | [fp16](huggingface.co/afrizalha/Bakpia-V1-9B-Javanese-fp16)/[4bit](huggingface.co/afrizalha/Bakpia-V1-9B-Javanese-4bit/) |
 
 
47
 
48
  ## Version 1.0
49
 
 
9
  - qwen2
10
  - trl
11
  - sft
12
+ datasets:
13
+ - afrizalha/Gatra-2-Javanese
14
  ---
15
  <!DOCTYPE html>
16
  <html lang="en">
 
41
 
42
  This repository contains the fp16 version of Bakpia V1 1.5B.
43
 
44
+ | Version | Base Model | URL | Training |
45
+ |---------|------------|-----|----------|
46
+ | V1 0.5B | Qwen 2 0.5B Instruct | [fp16](huggingface.co/afrizalha/Bakpia-V1-0.5B-Javanese/) | Epoch = 1, Batch = 16\*8, lr = 5e-5, linear schedule|
47
+ | V1 1.5B | Qwen 2 1.5B Instruct | [fp16](huggingface.co/afrizalha/Bakpia-V1-1.5B-Javanese/) | Epoch = 1, Batch = 16\*8, lr = 5e-5, linear schedule|
48
+ | V1 9B | Gemma 2 9B Instruct | [fp16](huggingface.co/afrizalha/Bakpia-V1-9B-Javanese-fp16)/[4bit](huggingface.co/afrizalha/Bakpia-V1-9B-Javanese-4bit/) |Batch size = 16\*8, lr = 4e-5, linear schedule|
49
+
50
+ Training data is accessible here: [URL](https://huggingface.co/datasets/afrizalha/Gatra-2-Javanese)
51
 
52
  ## Version 1.0
53