Update README.md
Browse files
README.md
CHANGED
@@ -8,9 +8,11 @@ datasets:
|
|
8 |
---
|
9 |
## Quick Summary
|
10 |
|
11 |
-
This model is
|
12 |
|
13 |
-
![image/
|
|
|
|
|
14 |
|
15 |
### Model Description
|
16 |
|
|
|
8 |
---
|
9 |
## Quick Summary
|
10 |
|
11 |
+
This model is
|
12 |
|
13 |
+
![image/png](https://cdn-uploads.huggingface.co/production/uploads/654aa1d86167ff03f70e32f9/zQFDg3iLKaks-GTAfppVA.png)
|
14 |
+
|
15 |
+
an adaptation of the `mistralai/Mistral-7B-Instruct-v0.2`, refined through the application of layer pruning techniques as detailed in the paper "The Unreasonable Ineffectiveness of the Deeper Layers." It incorporates methodologies from the `MergeKit` and `PruneMe` repositories to optimize its structure, focusing on reducing redundancy within the model's deeper layers without compromising its ability to generate coherent text. The model is maintained by Arcee-ai and represents a practical implementation of computational efficiency improvements in Large Language Models (LLMs), aiming to balance performance with resource usage effectively.
|
16 |
|
17 |
### Model Description
|
18 |
|