Hugging Face's logo

Weni
/
ZeroShot-Multilanguage-Zephyr-7B

PEFT
PyTorch
English
Portuguese
mistral
Model card Files Community
2
Mel-Iza0 commited on
Commit
5c69ed7
•
1 Parent(s): f1579f1

Training in progress, epoch 2, checkpoint

Browse files
Files changed (6) hide show
  1. checkpoint-1838/README.md +0 -26
  2. checkpoint-1838/adapter_model.bin +1 -1
  3. checkpoint-1838/optimizer.pt +1 -1
  4. checkpoint-1838/scheduler.pt +1 -1
  5. checkpoint-1838/trainer_state.json +0 -0
  6. checkpoint-1838/training_args.bin +1 -1
checkpoint-1838/README.md CHANGED
@@ -4,30 +4,6 @@ library_name: peft
4
  ## Training procedure
5
 
6
 
7
- The following `bitsandbytes` quantization config was used during training:
8
- - quant_method: bitsandbytes
9
- - load_in_8bit: False
10
- - load_in_4bit: True
11
- - llm_int8_threshold: 6.0
12
- - llm_int8_skip_modules: None
13
- - llm_int8_enable_fp32_cpu_offload: False
14
- - llm_int8_has_fp16_weight: False
15
- - bnb_4bit_quant_type: nf4
16
- - bnb_4bit_use_double_quant: True
17
- - bnb_4bit_compute_dtype: bfloat16
18
-
19
- The following `bitsandbytes` quantization config was used during training:
20
- - quant_method: bitsandbytes
21
- - load_in_8bit: False
22
- - load_in_4bit: True
23
- - llm_int8_threshold: 6.0
24
- - llm_int8_skip_modules: None
25
- - llm_int8_enable_fp32_cpu_offload: False
26
- - llm_int8_has_fp16_weight: False
27
- - bnb_4bit_quant_type: nf4
28
- - bnb_4bit_use_double_quant: True
29
- - bnb_4bit_compute_dtype: bfloat16
30
-
31
  The following `bitsandbytes` quantization config was used during training:
32
  - quant_method: bitsandbytes
33
  - load_in_8bit: False
@@ -53,8 +29,6 @@ The following `bitsandbytes` quantization config was used during training:
53
  - bnb_4bit_compute_dtype: bfloat16
54
  ### Framework versions
55
 
56
- - PEFT 0.4.0
57
- - PEFT 0.4.0
58
  - PEFT 0.4.0
59
 
60
  - PEFT 0.4.0
 
4
  ## Training procedure
5
 
6
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
7
  The following `bitsandbytes` quantization config was used during training:
8
  - quant_method: bitsandbytes
9
  - load_in_8bit: False
 
29
  - bnb_4bit_compute_dtype: bfloat16
30
  ### Framework versions
31
 
 
 
32
  - PEFT 0.4.0
33
 
34
  - PEFT 0.4.0
checkpoint-1838/adapter_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b31a0e1c9c827d22be801bfcc5ce6e1f13b3be6d3428b45d5ecfe70fb9c55375
3
  size 109098378
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4ba03bb1d3b33a7102635a45bf52c0318a1852bffed4512793c1fb792dbbcd7d
3
  size 109098378
checkpoint-1838/optimizer.pt CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:09e46657c8993c73091cbaf7238a1df24deefad9ca2c41c294408426aae41a8d
3
  size 218211962
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:11b5151f029f4761b4aacfede33f9f79f2063b72fb8019ec689289ed7d2ff76e
3
  size 218211962
checkpoint-1838/scheduler.pt CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3fa90ea085bfd0d6896e62475ae00bdb78d441c7b944d7db5e68a19d8191e3b0
3
  size 1064
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:723448a0118f7755fb455c9c1e2c045c143640ef77b054b582ef61dd3e283efb
3
  size 1064
checkpoint-1838/trainer_state.json CHANGED
The diff for this file is too large to render. See raw diff
 
checkpoint-1838/training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:75c3f8568aaf8b5dfbcb892da714ab8dbe1198201deb9ebda1b395708f7006af
3
  size 4856
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5e1fde683410a24e241e9f6c20bab29175de26c53191b73f8124d15838780ad1
3
  size 4856