Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
abhinavkulkarni
/
meta-llama-Llama-2-7b-chat-hf-w4-g128-awq
like
6
Text Generation
Transformers
PyTorch
English
llama
facebook
meta
llama-2
AWQ
text-generation-inference
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
d4e8573
meta-llama-Llama-2-7b-chat-hf-w4-g128-awq
File size: 58 Bytes
b539f96
1
2
3
4
5
{
"bits"
:
4
,
"group_size"
:
128
,
"zero_point"
:
true
}