Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
llmixer
/
Meta-Llama-3-70B-Instruct-8.0bpw-h8-exl2
like
2
Text Generation
Transformers
Safetensors
llama
conversational
text-generation-inference
Inference Endpoints
8-bit precision
exl2
License:
llama3
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
4c6717f
Meta-Llama-3-70B-Instruct-8.0bpw-h8-exl2
1 contributor
History:
3 commits
llmixer
Re-quant with exllamav2 0.0.19, fixed EOS token ID
4c6717f
verified
7 months ago
.gitattributes
1.52 kB
initial commit
7 months ago
LICENSE
7.8 kB
Model upload
7 months ago
USE_POLICY.md
4.7 kB
Model upload
7 months ago
config.json
971 Bytes
Re-quant with exllamav2 0.0.19, fixed EOS token ID
7 months ago
generation_config.json
126 Bytes
Model upload
7 months ago
model.safetensors.index.json
59.6 kB
Model upload
7 months ago
output-00001-of-00009.safetensors
8.59 GB
LFS
Re-quant with exllamav2 0.0.19, fixed EOS token ID
7 months ago
output-00002-of-00009.safetensors
8.46 GB
LFS
Re-quant with exllamav2 0.0.19, fixed EOS token ID
7 months ago
output-00003-of-00009.safetensors
8.55 GB
LFS
Re-quant with exllamav2 0.0.19, fixed EOS token ID
7 months ago
output-00004-of-00009.safetensors
8.44 GB
LFS
Re-quant with exllamav2 0.0.19, fixed EOS token ID
7 months ago
output-00005-of-00009.safetensors
8.46 GB
LFS
Re-quant with exllamav2 0.0.19, fixed EOS token ID
7 months ago
output-00006-of-00009.safetensors
8.46 GB
LFS
Re-quant with exllamav2 0.0.19, fixed EOS token ID
7 months ago
output-00007-of-00009.safetensors
8.55 GB
LFS
Re-quant with exllamav2 0.0.19, fixed EOS token ID
7 months ago
output-00008-of-00009.safetensors
8.44 GB
LFS
Re-quant with exllamav2 0.0.19, fixed EOS token ID
7 months ago
output-00009-of-00009.safetensors
4.77 GB
LFS
Re-quant with exllamav2 0.0.19, fixed EOS token ID
7 months ago
special_tokens_map.json
73 Bytes
Model upload
7 months ago
tokenizer.json
9.08 MB
Model upload
7 months ago
tokenizer_config.json
50.9 kB
Model upload
7 months ago