kaykyramos
commited on
Commit
•
e18d189
1
Parent(s):
50b6ba8
Update README.md
Browse files
README.md
CHANGED
@@ -11,7 +11,9 @@ base_model:
|
|
11 |
---
|
12 |
|
13 |
# Attention
|
14 |
-
**
|
|
|
|
|
15 |
|
16 |
# DepthWise Algorithm (Executed Twice)
|
17 |
|
|
|
11 |
---
|
12 |
|
13 |
# Attention
|
14 |
+
**This is a DepthWised upscaled model from 8B to 16B. This model still needs a continued pre-train to recover full knowledge and precision**
|
15 |
+
|
16 |
+
**The continued-pretrained version will be available soon!**
|
17 |
|
18 |
# DepthWise Algorithm (Executed Twice)
|
19 |
|