Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
AIFunOver
/
Llama-3.1-70B-Instruct-openvino-4bit
like
0
Text Generation
Transformers
Safetensors
OpenVINO
PyTorch
8 languages
llama
facebook
meta
llama-3
nncf
4-bit precision
conversational
text-generation-inference
Inference Endpoints
License:
llama3.1
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
Llama-3.1-70B-Instruct-openvino-4bit
1 contributor
History:
15 commits
AIFunOver
Upload README.md with huggingface_hub
127ff3e
verified
9 days ago
.gitattributes
1.52 kB
initial commit
9 days ago
README.md
14.6 kB
Upload README.md with huggingface_hub
9 days ago
config.json
930 Bytes
Upload config.json with huggingface_hub
9 days ago
generation_config.json
184 Bytes
Upload generation_config.json with huggingface_hub
9 days ago
model.safetensors.index.json
59.6 kB
Upload model.safetensors.index.json with huggingface_hub
9 days ago
openvino_config.json
581 Bytes
Upload openvino_config.json with huggingface_hub
9 days ago
openvino_detokenizer.bin
1.35 MB
LFS
Upload openvino_detokenizer.bin with huggingface_hub
9 days ago
openvino_detokenizer.xml
14.3 kB
Upload openvino_detokenizer.xml with huggingface_hub
9 days ago
openvino_model.bin
37.7 GB
LFS
Upload openvino_model.bin with huggingface_hub
9 days ago
openvino_model.xml
6.9 MB
Upload openvino_model.xml with huggingface_hub
9 days ago
openvino_tokenizer.bin
5.64 MB
LFS
Upload openvino_tokenizer.bin with huggingface_hub
9 days ago
openvino_tokenizer.xml
28.6 kB
Upload openvino_tokenizer.xml with huggingface_hub
9 days ago
special_tokens_map.json
296 Bytes
Upload special_tokens_map.json with huggingface_hub
9 days ago
tokenizer.json
9.09 MB
Upload tokenizer.json with huggingface_hub
9 days ago
tokenizer_config.json
55.4 kB
Upload tokenizer_config.json with huggingface_hub
9 days ago