Junxiong Wang

JunxiongWang's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

updated 3 models about 1 month ago

JunxiongWang/Llama3.2-Mamba-3B-dpo

Updated Nov 17 • 31

JunxiongWang/Llama3.2-Mamba-3B-distill

Updated Nov 17 • 59

JunxiongWang/Llama3.2-Mamba2-3B-distill

Updated Nov 17 • 282

updated a collection about 1 month ago

Mamba2InLlama3.2-3B

Collection

Mamba distilled from Llama3.2 3B Instruct. The Mamba in the Llama: Distilling and Accelerating Hybrid Models (https://arxiv.org/abs/2408.15237). • 4 items • Updated Nov 17

updated a model about 1 month ago

JunxiongWang/Llama3.2-Mamba2-3B-dpo

Updated Nov 17 • 14

updated 2 collections about 1 month ago

MambaInLlama-dpo

Collection

Directly distill from Llama, the finetune in DPO • 4 items • Updated Nov 17

MambaInLlama-distill

Collection

Directly distill from Llama without doing SFT and DPO • 4 items • Updated Nov 17

updated 4 models about 1 month ago

JunxiongWang/Llama3.1-Mamba2-8B-dpo

Updated Nov 17 • 7

JunxiongWang/Llama3.1-Mamba-8B-dpo

Updated Nov 17 • 7

JunxiongWang/Llama3.1-Mamba2-8B-distill

Updated Nov 17 • 24

JunxiongWang/Llama3.1-Mamba-8B-distill

Updated Nov 17 • 20

updated a collection about 1 month ago

MambaInLlama-distill

Collection

Directly distill from Llama without doing SFT and DPO • 4 items • Updated Nov 17

updated a collection 2 months ago

Mamba2InLlama3.2-3B

Collection

Mamba distilled from Llama3.2 3B Instruct. The Mamba in the Llama: Distilling and Accelerating Hybrid Models (https://arxiv.org/abs/2408.15237). • 4 items • Updated Nov 17