osllmai-community
/

Meta-Llama-3.1-70B-bnb-4bit

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Meta-Llama-3.1-70B-bnb-4bit

1 contributor

History: 16 commits

alinemati's picture

Upload README.md with huggingface_hub

e38b2e1 verified 25 days ago

.gitattributes

1.52 kB

initial commit 3 months ago
README.md

2.06 kB

Upload README.md with huggingface_hub 25 days ago
config.json

1.41 kB

Upload config.json 3 months ago
generation_config.json

230 Bytes

Upload generation_config.json 3 months ago
model-00001-of-00006.safetensors

7 GB
LFS

Upload model-00001-of-00006.safetensors 3 months ago
model-00002-of-00006.safetensors

6.9 GB
LFS

Upload model-00002-of-00006.safetensors 3 months ago
model-00003-of-00006.safetensors

6.94 GB
LFS

Upload model-00003-of-00006.safetensors 3 months ago
model-00004-of-00006.safetensors

6.94 GB
LFS

Upload model-00004-of-00006.safetensors 3 months ago
model-00005-of-00006.safetensors

6.99 GB
LFS

Upload model-00005-of-00006.safetensors 3 months ago
model-00006-of-00006.safetensors

4.75 GB
LFS

Upload model-00006-of-00006.safetensors 3 months ago
model.safetensors.index.json

331 kB

Upload model.safetensors.index.json 3 months ago
special_tokens_map.json

345 Bytes

Upload special_tokens_map.json 3 months ago
tokenizer.json

9.09 MB

Upload tokenizer.json 3 months ago
tokenizer_config.json

50.6 kB

Upload tokenizer_config.json 3 months ago