Marc Sun's picture

Marc Sun

marcsun13

·

AI & ML interests

LLM, Quantization, Training, Inference

Recent Activity

updated a Space 9 days ago

DDUF/dduf-check

upvoted a paper 10 days ago

LoftQ: LoRA-Fine-Tuning-Aware Quantization for Large Language Models

updated a model 11 days ago

DDUF/FLUX.1-dev-DDUF

View all activity

Articles

Introducing SynthID Text

Fine-tuning LLMs to 1.58bit: extreme quantization made easy

Accelerate 1.0.0

Llama 3.1 - 405B, 70B & 8B with multilinguality and long context

quanto: a pytorch quantization toolkit

Overview of natively supported quantization schemes in 🤗 Transformers

Making LLMs lighter with AutoGPTQ and transformers

Organizations

models 14

marcsun13/Meta-Llama-3-8B-torchao-int8_weight_only

Updated Oct 18 • 5

marcsun13/sft_openassistant-guanaco

Text Generation • Updated Jul 5 • 15

marcsun13/gemma-2-27b-it-bnb-colab

Text Generation • Updated Jul 4 • 13

marcsun13/gemma-2-9b-it-GPTQ

Text Generation • Updated Jul 3 • 439 • 3

marcsun13/test_push_checkpoint

Fill-Mask • Updated Jun 28 • 72

marcsun13/Mixtral-8x7B-v0.1-GPTQ

Text Generation • Updated Dec 11, 2023 • 13

marcsun13/Mixtral-tiny-GPTQ

Text Generation • Updated Dec 11, 2023 • 26

marcsun13/Llama-2-13B-AWQ

Text Generation • Updated Nov 6, 2023 • 17

marcsun13/opt-125m-awq

Text Generation • Updated Oct 30, 2023 • 22

marcsun13/opt-350m-gptq-4bit

Text Generation • Updated Jul 31, 2023 • 2.04k

datasets

None public yet