Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
ModelCloud
/
Meta-Llama-3.1-70B-Instruct-gptq-4bit
like
4
Follow
ModelCloud.AI
36
Text Generation
Transformers
Safetensors
llama
gptq
4bit
int4
gptqmodel
modelcloud
llama-3.1
70b
instruct
conversational
text-generation-inference
Inference Endpoints
4-bit precision
License:
llama3.1
Model card
Files
Files and versions
Community
5
Train
Deploy
Use this model
refs/pr/1
Meta-Llama-3.1-70B-Instruct-gptq-4bit
3 contributors
History:
8 commits
lrl-modelcloud
2c75765e7e3f20446f27f26ac61eb1cfe46ce71d6ec165d20e7e9981c8e2f500
0ba78b0
verified
6 months ago
.gitattributes
1.52 kB
initial commit
6 months ago
README.md
1.24 kB
Create README.md
6 months ago
config.json
1.32 kB
2c75765e7e3f20446f27f26ac61eb1cfe46ce71d6ec165d20e7e9981c8e2f500
6 months ago
model-00001-of-00005.safetensors
7.96 GB
LFS
d3ed644a00c0c354dbfe032c27cd03bc058b40b04ce21cbec387e5cb6c1d03eb
6 months ago
model-00002-of-00005.safetensors
7.97 GB
LFS
4867c5f3d46349d7303348fde6d7a7cc48d17648181e3a40cb2dcf85ac35f440
6 months ago
model-00003-of-00005.safetensors
8 GB
LFS
2276fb16ba4e2e44ed9c3ea723ddc1d5c7650f6e106187767686c39737968715
6 months ago
model-00004-of-00005.safetensors
7.97 GB
LFS
90809e1bc510dcb2e72c80551f0adbfbd1dd72df4684f3501ba0d4a03f38a64f
6 months ago
model-00005-of-00005.safetensors
7.88 GB
LFS
31084b96d92301fe56c84675a0d68eab5a91875ee514236f6f17fc616caa8909
6 months ago
model.safetensors.index.json
196 kB
2c75765e7e3f20446f27f26ac61eb1cfe46ce71d6ec165d20e7e9981c8e2f500
6 months ago
quantize_config.json
345 Bytes
2c75765e7e3f20446f27f26ac61eb1cfe46ce71d6ec165d20e7e9981c8e2f500
6 months ago
special_tokens_map.json
340 Bytes
2c75765e7e3f20446f27f26ac61eb1cfe46ce71d6ec165d20e7e9981c8e2f500
6 months ago
tokenizer.json
9.08 MB
2c75765e7e3f20446f27f26ac61eb1cfe46ce71d6ec165d20e7e9981c8e2f500
6 months ago
tokenizer_config.json
50.9 kB
2c75765e7e3f20446f27f26ac61eb1cfe46ce71d6ec165d20e7e9981c8e2f500
6 months ago
