ssmits commited on
Commit
4d6918c
1 Parent(s): 02019c4

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -2
README.md CHANGED
@@ -20,6 +20,7 @@ language:
20
  - pl
21
  - ro
22
  - it
 
23
  ---
24
  # sliced
25
 
@@ -52,9 +53,9 @@ merge_method: passthrough
52
  dtype: bfloat16
53
  ```
54
 
55
- [PruneMe](https://github.com/arcee-ai/PruneMe) has been utilized using the wikimedia/wikipedia subsets of 10 languages by investigating layer similarity with 2000 samples per language. The layer ranges for pruning were determined based on the averages of each language analysis to maintain performance while reducing model size.
56
 
57
- ![Layer Similarity Plot](https://cdn-uploads.huggingface.co/production/uploads/660c0a02cf274b3ab77dd6b7/A-5Wz8FyUKa0mvqbWdDeu.png)
58
 
59
  ## Direct Use
60
  Research on large language models; as a foundation for further specialization and finetuning for specific usecases (e.g., summarization, text generation, chatbot, etc.)
 
20
  - pl
21
  - ro
22
  - it
23
+ - es
24
  ---
25
  # sliced
26
 
 
53
  dtype: bfloat16
54
  ```
55
 
56
+ [PruneMe](https://github.com/arcee-ai/PruneMe) has been utilized using the wikimedia/wikipedia subsets of 11 languages by investigating layer similarity with 2000 samples per language. The layer ranges for pruning were determined based on the averages of each language analysis to maintain performance while reducing model size.
57
 
58
+ ![Layer Similarity Plot](https://cdn-uploads.huggingface.co/production/uploads/660c0a02cf274b3ab77dd6b7/47CiSRvJpmKGGfF-eUY6U.png)
59
 
60
  ## Direct Use
61
  Research on large language models; as a foundation for further specialization and finetuning for specific usecases (e.g., summarization, text generation, chatbot, etc.)