kimhyeongjun commited on
Commit
18eea68
โ€ข
1 Parent(s): 5255cd3

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +11 -7
README.md CHANGED
@@ -8,20 +8,20 @@ tags:
8
  - unsloth
9
  - generated_from_trainer
10
  model-index:
11
- - name: kimhyeongjun/Hermes-3-Llama-3.1-8B-Ko-Finance-Advisors
12
  results: []
13
  ---
14
 
15
 
16
- # kimhyeongjun/Hermes-3-Llama-3.1-8B-Ko-Finance-Advisors
17
 
18
- This is a toy project to appease the feeling of being free during Chuseok(Korean Thanksgiving Day).
19
 
20
  This model is a fine-tuned version of [NousResearch/Hermes-3-Llama-3.1-8B](https://huggingface.co/NousResearch/Hermes-3-Llama-3.1-8B) on the Korean_synthetic_financial_dataset_21K.
21
 
22
- ์ถ”์„๊ธฐ๊ฐ„ ๋ฌด๋ฃŒํ•จ์„ ๋‹ฌ๋ž˜๊ธฐ์œ„ํ•œ ํ† ์ด ํ”„๋กœ์ ํŠธ ์ž…๋‹ˆ๋‹ค.
23
 
24
- ์ด ๋ชจ๋ธ์€ ํ•œ๊ตญ_ํ•ฉ์„ฑ_๊ธˆ์œต_๋ฐ์ดํ„ฐ์…‹_21K์˜ [NousResearch/Hermes-3-Llama-3.1-8B](https://huggingface.co/NousResearch/Hermes-3-Llama-3.1-8B)๋ฅผ ๋ฏธ์„ธ ์กฐ์ •ํ•œ ๋ฒ„์ „์ž…๋‹ˆ๋‹ค.
25
 
26
  ## Model description
27
 
@@ -31,11 +31,15 @@ We then used 'Alibaba-NLP/gte-large-en-v1.5' to extract embeddings and applied F
31
 
32
  ์›น์—์„œ ์ง์ ‘ ์ˆ˜์ง‘ํ•œ ๊ธˆ์œต ๊ด€๋ จ PDF ๋ฐ์ดํ„ฐ๋ฅผ ๊ธฐ๋ฐ˜์œผ๋กœ, 'meta-llama/Meta-Llama-3.1-70B-Instruct' ๋ชจ๋ธ์„ ํ™œ์šฉํ•˜์—ฌ ์›์‹œ ๋ฐ์ดํ„ฐ๋ฅผ ์ •์ œํ•˜์˜€์Šต๋‹ˆ๋‹ค.
33
  ์ •์ œ๋œ ๋ฐ์ดํ„ฐ๋ฅผ ๋ฐ”ํƒ•์œผ๋กœ ํ•ฉ์„ฑ ๋ฐ์ดํ„ฐ๋ฅผ ์ƒ์„ฑํ•œ ํ›„, 'meta-llama/Llama-Guard-3-8B' ๋ฐ 'RLHFlow/ArmoRM-Llama3-8B-v0.1' ๋ชจ๋ธ์„ ํ†ตํ•ด ์ƒ์„ฑ๋œ ๋ฐ์ดํ„ฐ์˜ ํ’ˆ์งˆ์„ ์‹ฌ์ธต์ ์œผ๋กœ ํ‰๊ฐ€ํ•˜์˜€์Šต๋‹ˆ๋‹ค.
34
- ์ด์–ด์„œ 'Alibaba-NLP/gte-large-en-v1.5'๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ์ž„๋ฒ ๋”ฉ์„ ์ถ”์ถœํ•˜๊ณ , Faiss๋ฅผ ์ ์šฉํ•˜์—ฌ ์ž์นด๋“œ ๊ฑฐ๋ฆฌ ๊ธฐ๋ฐ˜์˜ ๊ทผ์ ‘ ์ด์›ƒ ๋ถ„์„์„ ์ˆ˜ํ–‰ํ•จ์œผ๋กœ์จ ๋‹ค์ฐจ์›์ ์ด๊ณ  ์ •๊ตํ•œ ์ตœ์ข… ๋ฐ์ดํ„ฐ์…‹ 21k์„ ๊ตฌ์„ฑํ•˜์˜€์Šต๋‹ˆ๋‹ค.
35
 
36
  ## Task duration
37
- 3days (20240914-20240916)
38
 
 
 
 
 
39
 
40
  ## sample
41
 
 
8
  - unsloth
9
  - generated_from_trainer
10
  model-index:
11
+ - name: kimhyeongjun/Hermes-3-Llama-3.1-8B-Kor-Finance-Advisor
12
  results: []
13
  ---
14
 
15
 
16
+ # kimhyeongjun/Hermes-3-Llama-3.1-8B-Kor-Finance-Advisor
17
 
18
+ This is my personal toy project for Chuseok(Korean Thanksgiving Day).
19
 
20
  This model is a fine-tuned version of [NousResearch/Hermes-3-Llama-3.1-8B](https://huggingface.co/NousResearch/Hermes-3-Llama-3.1-8B) on the Korean_synthetic_financial_dataset_21K.
21
 
22
+ ์ถ”์„๊ธฐ๊ฐ„ ์ง„ํ–‰๋œ ๊ฐœ์ธ ํ† ์ด ํ”„๋กœ์ ํŠธ ์ž…๋‹ˆ๋‹ค.
23
 
24
+ ์ด ๋ชจ๋ธ์€ ์ˆ˜์ œ ํ•œ๊ตญ_ํ•ฉ์„ฑ_๊ธˆ์œต_๋ฐ์ดํ„ฐ์…‹_21K์˜ [NousResearch/Hermes-3-Llama-3.1-8B](https://huggingface.co/NousResearch/Hermes-3-Llama-3.1-8B)๋ฅผ ๋ฏธ์„ธ ์กฐ์ •ํ•œ ๋ฒ„์ „์ž…๋‹ˆ๋‹ค.
25
 
26
  ## Model description
27
 
 
31
 
32
  ์›น์—์„œ ์ง์ ‘ ์ˆ˜์ง‘ํ•œ ๊ธˆ์œต ๊ด€๋ จ PDF ๋ฐ์ดํ„ฐ๋ฅผ ๊ธฐ๋ฐ˜์œผ๋กœ, 'meta-llama/Meta-Llama-3.1-70B-Instruct' ๋ชจ๋ธ์„ ํ™œ์šฉํ•˜์—ฌ ์›์‹œ ๋ฐ์ดํ„ฐ๋ฅผ ์ •์ œํ•˜์˜€์Šต๋‹ˆ๋‹ค.
33
  ์ •์ œ๋œ ๋ฐ์ดํ„ฐ๋ฅผ ๋ฐ”ํƒ•์œผ๋กœ ํ•ฉ์„ฑ ๋ฐ์ดํ„ฐ๋ฅผ ์ƒ์„ฑํ•œ ํ›„, 'meta-llama/Llama-Guard-3-8B' ๋ฐ 'RLHFlow/ArmoRM-Llama3-8B-v0.1' ๋ชจ๋ธ์„ ํ†ตํ•ด ์ƒ์„ฑ๋œ ๋ฐ์ดํ„ฐ์˜ ํ’ˆ์งˆ์„ ์‹ฌ์ธต์ ์œผ๋กœ ํ‰๊ฐ€ํ•˜์˜€์Šต๋‹ˆ๋‹ค.
34
+ ์ด์–ด์„œ 'Alibaba-NLP/gte-large-en-v1.5'๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ์ž„๋ฒ ๋”ฉ์„ ์ถ”์ถœํ•˜๊ณ , Faiss๋ฅผ ์ ์šฉํ•˜์—ฌ ์ž์นด๋“œ ๊ฑฐ๋ฆฌ ๊ธฐ๋ฐ˜์˜ ๊ทผ์ ‘ ์ด์›ƒ ๋ถ„์„์„ ์ˆ˜ํ–‰ํ•จ์œผ๋กœ์จ ๋‹ค์ฐจ์›์ ์ด๊ณ  ์ •๊ตํ•œ ์ตœ์ข… ๋ฐ์ดํ„ฐ์…‹ 21k์„ ์ง์ ‘ ๊ตฌ์„ฑํ•˜์˜€์Šต๋‹ˆ๋‹ค.
35
 
36
  ## Task duration
37
+ 3days (20240914~20240916)
38
 
39
+ ## evaluation
40
+ I had to take the Thanksgiving holiday off.
41
+
42
+ ์ถ”์„์—ฐํœด ์‰ฌ์–ด์•ผ๋˜์„œ ์—†์Šต๋‹ˆ๋‹ค.
43
 
44
  ## sample
45