SparseLLMs

SparseLLM's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts

Raincleared 

in SparseLLM/ReluLLaMA-7B 4 days ago

Adding `safetensors` variant of this model

#3 opened 4 days ago by

SFconvertbot

Raincleared 

in SparseLLM/sparsing-law-0.1b-relu 11 days ago

Adding `safetensors` variant of this model

#1 opened 11 days ago by

SFconvertbot

demerzel-iv 

authored a paper about 1 month ago

Sparsing Law: Towards Large Language Models with Greater Activation Sparsity

Paper • 2411.02335 • Published Nov 4 • 11

demerzel-iv 

updated 8 models about 2 months ago

SparseLLM/sparsing-law-1.2b-silu

Text Generation • Updated Nov 8 • 3

SparseLLM/sparsing-law-0.8b-silu

Text Generation • Updated Nov 8 • 5

SparseLLM/sparsing-law-0.4b-silu

Text Generation • Updated Nov 8 • 5

SparseLLM/sparsing-law-0.2b-silu

Text Generation • Updated Nov 8 • 5

SparseLLM/sparsing-law-1.2b-relu

Text Generation • Updated Nov 8 • 4

SparseLLM/sparsing-law-0.4b-relu

Text Generation • Updated Nov 7 • 4

SparseLLM/sparsing-law-0.8b-relu

Text Generation • Updated Nov 7 • 7

SparseLLM/sparsing-law-0.2b-relu

Text Generation • Updated Nov 7 • 3

Raincleared 

authored a paper about 2 months ago

Sparsing Law: Towards Large Language Models with Greater Activation Sparsity

Paper • 2411.02335 • Published Nov 4 • 11

demerzel-iv 

updated a model about 2 months ago

SparseLLM/sparsing-law-0.1b-silu

Text Generation • Updated Nov 5 • 6

Raincleared 

updated a model about 2 months ago

SparseLLM/sparsing-law-0.1b-relu

Text Generation • Updated 11 days ago • 42 • 1

demerzel-iv 

updated a model about 2 months ago

SparseLLM/sparsing-law-0.1b-relu

Text Generation • Updated 11 days ago • 42 • 1

Raincleared 

authored a paper 4 months ago

Configurable Foundation Models: Building LLMs from a Modular Perspective

Paper • 2409.02877 • Published Sep 4 • 27

ZhengyanZhang 

authored a paper 4 months ago

Configurable Foundation Models: Building LLMs from a Modular Perspective

Paper • 2409.02877 • Published Sep 4 • 27

ZhengyanZhang 

authored a paper 6 months ago

Turbo Sparse: Achieving LLM SOTA Performance with Minimal Activated Parameters

Paper • 2406.05955 • Published Jun 10 • 22

yixinsong 

authored 2 papers 6 months ago

Turbo Sparse: Achieving LLM SOTA Performance with Minimal Activated Parameters

Paper • 2406.05955 • Published Jun 10 • 22

ReLU$^2$ Wins: Discovering Efficient Activation Functions for Sparse LLMs

Paper • 2402.03804 • Published Feb 6 • 2