ssmits commited on
Commit
6747538
1 Parent(s): d381f0f

Upload output-Llama-3.1-Nemotron-93B-Instruct-HF-late/mergekit_config.yml with huggingface_hub

Browse files
output-Llama-3.1-Nemotron-93B-Instruct-HF-late/mergekit_config.yml ADDED
@@ -0,0 +1,33 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ dtype: bfloat16
2
+ merge_method: passthrough
3
+ slices:
4
+ - sources:
5
+ - layer_range:
6
+ - 0
7
+ - 55
8
+ model: nvidia/Llama-3.1-Nemotron-70B-Instruct-HF
9
+ - sources:
10
+ - layer_range:
11
+ - 50
12
+ - 60
13
+ model: nvidia/Llama-3.1-Nemotron-70B-Instruct-HF
14
+ - sources:
15
+ - layer_range:
16
+ - 55
17
+ - 65
18
+ model: nvidia/Llama-3.1-Nemotron-70B-Instruct-HF
19
+ - sources:
20
+ - layer_range:
21
+ - 60
22
+ - 70
23
+ model: nvidia/Llama-3.1-Nemotron-70B-Instruct-HF
24
+ - sources:
25
+ - layer_range:
26
+ - 65
27
+ - 75
28
+ model: nvidia/Llama-3.1-Nemotron-70B-Instruct-HF
29
+ - sources:
30
+ - layer_range:
31
+ - 70
32
+ - 80
33
+ model: nvidia/Llama-3.1-Nemotron-70B-Instruct-HF