Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Nexesenex
/
Meta-Llama-3.1-70b-instruct-bf16-iMat-CQ-GGUF
like
0
GGUF
Inference Endpoints
imatrix
conversational
License:
llama3.1
Model card
Files
Files and versions
Community
Deploy
Use this model
main
Meta-Llama-3.1-70b-instruct-bf16-iMat-CQ-GGUF
1 contributor
History:
9 commits
Nexesenex
Update README.md
8927d68
verified
7 days ago
.gitattributes
Safe
2.16 kB
Upload meta-llama-3.1-70b-instruct-bf16-iMat-IQ5_K_viq4k_viq6k.gguf
7 days ago
README.md
Safe
80 Bytes
Update README.md
7 days ago
meta-llama-3.1-70b-instruct-bf16-iMat-IQ3_ML.gguf
Safe
33.5 GB
LFS
Upload meta-llama-3.1-70b-instruct-bf16-iMat-IQ3_ML.gguf
3 months ago
meta-llama-3.1-70b-instruct-bf16-iMat-IQ3_XL_line.gguf
Safe
34.4 GB
LFS
Upload meta-llama-3.1-70b-instruct-bf16-iMat-IQ3_XL_line.gguf
3 months ago
meta-llama-3.1-70b-instruct-bf16-iMat-IQ3_XXL_line.gguf
Safe
35.1 GB
LFS
Upload meta-llama-3.1-70b-instruct-bf16-iMat-IQ3_XXL_line.gguf
3 months ago
meta-llama-3.1-70b-instruct-bf16-iMat-IQ3_XXXL_line.gguf
Safe
35.9 GB
LFS
Upload meta-llama-3.1-70b-instruct-bf16-iMat-IQ3_XXXL_line.gguf
3 months ago
meta-llama-3.1-70b-instruct-bf16-iMat-IQ4_XSR.gguf
Safe
38.1 GB
LFS
Upload meta-llama-3.1-70b-instruct-bf16-iMat-IQ4_XSR.gguf
3 months ago
meta-llama-3.1-70b-instruct-bf16-iMat-IQ5_K_viq4k_viq6k.gguf
48.2 GB
LFS
Upload meta-llama-3.1-70b-instruct-bf16-iMat-IQ5_K_viq4k_viq6k.gguf
7 days ago
meta-llama-3.1-70b-instruct-bf16-iMat-Q5_K_S_q4v6.gguf
Safe
48.1 GB
LFS
Upload meta-llama-3.1-70b-instruct-bf16-iMat-Q5_K_S_q4v6.gguf
3 months ago
