Jialiang Cheng

Julius-L's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

upvoted a paper 3 days ago

NeuZip: Memory-Efficient Training and Inference with Dynamic Compression of Neural Networks

Paper • 2410.20650 • Published 10 days ago • 13

upvoted 2 papers 6 days ago

A Survey of Small Language Models

Paper • 2410.20011 • Published 12 days ago • 36

COAT: Compressing Optimizer states and Activation for Memory-Efficient FP8 Training

Paper • 2410.19313 • Published 13 days ago • 18

upvoted 3 papers 13 days ago

The Llama 3 Herd of Models

Paper • 2407.21783 • Published Jul 31 • 105

SemiEvol: Semi-supervised Fine-tuning for LLM Adaptation

Paper • 2410.14745 • Published 20 days ago • 45

Why Does the Effective Context Length of LLMs Fall Short?

Paper • 2410.18745 • Published 13 days ago • 16

upvoted a paper 14 days ago

MiniPLM: Knowledge Distillation for Pre-Training Language Models

Paper • 2410.17215 • Published 15 days ago • 12

upvoted a paper 16 days ago

Baichuan Alignment Technical Report

Paper • 2410.14940 • Published 19 days ago • 47

upvoted 5 papers 28 days ago

Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunities

Paper • 2408.07666 • Published Aug 14 • 2

Memory-Efficient LLM Training with Online Subspace Descent

Paper • 2408.12857 • Published Aug 23 • 11

Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolution

Paper • 2409.12191 • Published Sep 18 • 73

Scaling Smart: Accelerating Large Language Model Pre-training with Small Model Initialization

Paper • 2409.12903 • Published Sep 19 • 21

Differential Transformer

Paper • 2410.05258 • Published about 1 month ago • 165

upvoted 2 papers 29 days ago

What Matters for Model Merging at Scale?

Paper • 2410.03617 • Published Oct 4 • 8

SageAttention: Accurate 8-Bit Attention for Plug-and-play Inference Acceleration

Paper • 2410.02367 • Published Oct 3 • 45

upvoted 3 papers 30 days ago

MM1.5: Methods, Analysis & Insights from Multimodal LLM Fine-tuning

Paper • 2409.20566 • Published Sep 30 • 51

MaskLLM: Learnable Semi-Structured Sparsity for Large Language Models

Paper • 2409.17481 • Published Sep 26 • 46

VPTQ: Extreme Low-bit Vector Post-Training Quantization for Large Language Models

Paper • 2409.17066 • Published Sep 25 • 27