Hugging Face's logo

hugging-quants
/
Meta-Llama-3.1-8B-Instruct-AWQ-INT4

Text Generation
Transformers
Safetensors
llama
llama-3.1
meta
autoawq
conversational
text-generation-inference
4-bit precision
awq
Model card Files Community
17

Finetuning AWQ model

#17
by zaidawan - opened
Discussion
zaidawan

can we finetune LORA Adapters using quant AWQ model as base model

zaidawan

Hello, Can we do finetune of LORA Adpater using this model as a base model ?

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment