ZhengyanZhang
commited on
Commit
•
95ff654
1
Parent(s):
a0a6cd6
Update README.md
Browse files
README.md
CHANGED
@@ -7,4 +7,7 @@ sdk: static
|
|
7 |
pinned: false
|
8 |
---
|
9 |
|
10 |
-
|
|
|
|
|
|
|
|
7 |
pinned: false
|
8 |
---
|
9 |
|
10 |
+
The organization is founded by [THUNLP](https://nlp.csai.tsinghua.edu.cn/) and [ModelBest](modelbest.cn) with the help of [IPADS](https://ipads.se.sjtu.edu.cn/zh/index.html), aimed at promoting the development of Sparse Large Language Models (SparseLLMs). By utilizing the sparsity of LLMs, we can significantly reduce the computational cost of inference. Currently, the organization is mainly focused on the ReLU-activated LLMs, which are converted from existing LLMs through fine-tuning.
|
11 |
+
|
12 |
+
The LLaMA series within it is provided by [THUNLP](https://nlp.csai.tsinghua.edu.cn/) and [ModelBest](modelbest.cn). Additionally, [IPADS](https://ipads.se.sjtu.edu.cn/zh/index.html) contributed the falcon model, and participation from other institutions is also welcomed.
|
13 |
+
|