PEFT
code
instruct
mistral
souvik0306 commited on
Commit
e556c0c
1 Parent(s): 624be22

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -6
README.md CHANGED
@@ -3,7 +3,7 @@ library_name: peft
3
  tags:
4
  - code
5
  - instruct
6
- - llama2
7
  datasets:
8
  - HuggingFaceH4/no_robots
9
  base_model: mistralai/Mistral-7B-v0.1
@@ -25,14 +25,14 @@ license: apache-2.0
25
  With the utilization of [MonsterAPI](https://monsterapi.ai)'s [LLM finetuner](https://docs.monsterapi.ai/fine-tune-a-large-language-model-llm), this finetuning:
26
 
27
  - Was achieved with great cost-effectiveness.
28
- - Completed in a total duration of 36mins 27secs for 1 epoch using an A6000 48GB GPU.
29
- - Costed `$1.212` for the entire epoch.
30
 
31
  #### Hyperparameters & Additional Details:
32
 
33
  - **Epochs:** 2
34
- - **Cost Per Epoch:** $1.212
35
- - **Total Finetuning Cost:** $1.212
36
  - **Model Path:** mistralai/Mistral-7B-v0.1
37
  - **Learning Rate:** 0.0002
38
  - **Data Split:** 100% train
@@ -46,6 +46,6 @@ With the utilization of [MonsterAPI](https://monsterapi.ai)'s [LLM finetuner](ht
46
  ```
47
  #### Train loss :
48
 
49
- ![eval loss](https://cdn-uploads.huggingface.co/production/uploads/63ba46aa0a9866b28cb19a14/WDbw92-Vmuc7QttRHvJU6.png)
50
 
51
  license: apache-2.0
 
3
  tags:
4
  - code
5
  - instruct
6
+ - mistral
7
  datasets:
8
  - HuggingFaceH4/no_robots
9
  base_model: mistralai/Mistral-7B-v0.1
 
25
  With the utilization of [MonsterAPI](https://monsterapi.ai)'s [LLM finetuner](https://docs.monsterapi.ai/fine-tune-a-large-language-model-llm), this finetuning:
26
 
27
  - Was achieved with great cost-effectiveness.
28
+ - Completed in a total duration of 1h 15m 3s for 2 epochs using an A6000 48GB GPU.
29
+ - Costed `$2.525` for the entire epoch.
30
 
31
  #### Hyperparameters & Additional Details:
32
 
33
  - **Epochs:** 2
34
+ - **Cost Per Epoch:** $1.26
35
+ - **Total Finetuning Cost:** $2.525
36
  - **Model Path:** mistralai/Mistral-7B-v0.1
37
  - **Learning Rate:** 0.0002
38
  - **Data Split:** 100% train
 
46
  ```
47
  #### Train loss :
48
 
49
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/63ba46aa0a9866b28cb19a14/Badi_wgZLBsUdeIScEKs9.png)
50
 
51
  license: apache-2.0