Update README.md
Browse files
README.md
CHANGED
@@ -20,6 +20,7 @@ language:
|
|
20 |
- pl
|
21 |
- ro
|
22 |
- it
|
|
|
23 |
---
|
24 |
# sliced
|
25 |
|
@@ -52,9 +53,9 @@ merge_method: passthrough
|
|
52 |
dtype: bfloat16
|
53 |
```
|
54 |
|
55 |
-
[PruneMe](https://github.com/arcee-ai/PruneMe) has been utilized using the wikimedia/wikipedia subsets of
|
56 |
|
57 |
-
![Layer Similarity Plot](https://cdn-uploads.huggingface.co/production/uploads/660c0a02cf274b3ab77dd6b7/
|
58 |
|
59 |
## Direct Use
|
60 |
Research on large language models; as a foundation for further specialization and finetuning for specific usecases (e.g., summarization, text generation, chatbot, etc.)
|
|
|
20 |
- pl
|
21 |
- ro
|
22 |
- it
|
23 |
+
- es
|
24 |
---
|
25 |
# sliced
|
26 |
|
|
|
53 |
dtype: bfloat16
|
54 |
```
|
55 |
|
56 |
+
[PruneMe](https://github.com/arcee-ai/PruneMe) has been utilized using the wikimedia/wikipedia subsets of 11 languages by investigating layer similarity with 2000 samples per language. The layer ranges for pruning were determined based on the averages of each language analysis to maintain performance while reducing model size.
|
57 |
|
58 |
+
![Layer Similarity Plot](https://cdn-uploads.huggingface.co/production/uploads/660c0a02cf274b3ab77dd6b7/47CiSRvJpmKGGfF-eUY6U.png)
|
59 |
|
60 |
## Direct Use
|
61 |
Research on large language models; as a foundation for further specialization and finetuning for specific usecases (e.g., summarization, text generation, chatbot, etc.)
|