Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
ISTA-DASLab
/
Llama-3.2-3B-Instruct-AQLM-PV-2Bit-2x8
like
0
Follow
IST Austria Distributed Algorithms and Systems Lab
52
Text Generation
Transformers
Safetensors
llama
aqlm
facebook
meta
llama-3
conversational
text-generation-inference
Inference Endpoints
8-bit precision
arxiv:
2401.06118
arxiv:
2405.14852
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
Llama-3.2-3B-Instruct-AQLM-PV-2Bit-2x8
Commit History
Added evaluation metrics
49bdc4c
verified
SpiridonSunRotator
commited on
Nov 8
Upload folder using huggingface_hub
17bdd1d
verified
SpiridonSunRotator
commited on
Nov 8
initial commit
3211194
verified
SpiridonSunRotator
commited on
Nov 8