ISTA-DASLab
/

Meta-Llama-3-70B-AQLM-2Bit-1x16

Text Generation

text-generation-inference

Model card Files Files and versions Community

Meta-Llama-3-70B-AQLM-2Bit-1x16

1 contributor

History: 9 commits

SpiridonSunRotator's picture

SpiridonSunRotator

Updated metrics

ddb56ce verified 11 months ago

.gitattributes

1.52 kB

initial commit 11 months ago
README.md

711 Bytes

Updated metrics 11 months ago
config.json

9.38 kB

Uploaded improved version of quantized model 11 months ago
generation_config.json

126 Bytes

Uploaded Meta-Llama-3-70B with AQLM 1x16 quantization 11 months ago
model-00001-of-00005.safetensors

5 GB
LFS

Uploaded improved version of quantized model 11 months ago
model-00002-of-00005.safetensors

4.96 GB
LFS

Uploaded improved version of quantized model 11 months ago
model-00003-of-00005.safetensors

4.99 GB
LFS

Uploaded improved version of quantized model 11 months ago
model-00004-of-00005.safetensors

4.87 GB
LFS

Uploaded improved version of quantized model 11 months ago
model-00005-of-00005.safetensors

2.1 GB
LFS

Uploaded improved version of quantized model 11 months ago
model.safetensors.index.json

152 kB

Uploaded Meta-Llama-3-70B with AQLM 1x16 quantization 11 months ago
special_tokens_map.json

73 Bytes

Uploaded tokenizer 11 months ago
tokenizer.json

9.08 MB

Uploaded tokenizer 11 months ago
tokenizer_config.json

50.6 kB

Uploaded tokenizer 11 months ago