Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Posts
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

Nexesenex
/
meta-llama-3.1-70b-instruct-bf16-iMat-GGUF

GGUF
Inference Endpoints
imatrix
conversational
Model card Files Files and versions Community
meta-llama-3.1-70b-instruct-bf16-iMat-GGUF
  • 1 contributor
History: 7 commits
Nexesenex's picture
Nexesenex
Upload meta-llama-3.1-70b-instruct-bf16-iMat-IQ4_XSR.gguf
8532a6b verified 3 months ago
  • .gitattributes
    2.06 kB
    Upload meta-llama-3.1-70b-instruct-bf16-iMat-IQ4_XSR.gguf 3 months ago
  • README.md
    29 Bytes
    initial commit 3 months ago
  • meta-llama-3.1-70b-instruct-bf16-iMat-IQ3_ML.gguf
    33.5 GB
    LFS
    Upload meta-llama-3.1-70b-instruct-bf16-iMat-IQ3_ML.gguf 3 months ago
  • meta-llama-3.1-70b-instruct-bf16-iMat-IQ3_XL_line.gguf
    34.4 GB
    LFS
    Upload meta-llama-3.1-70b-instruct-bf16-iMat-IQ3_XL_line.gguf 3 months ago
  • meta-llama-3.1-70b-instruct-bf16-iMat-IQ3_XXL_line.gguf
    35.1 GB
    LFS
    Upload meta-llama-3.1-70b-instruct-bf16-iMat-IQ3_XXL_line.gguf 3 months ago
  • meta-llama-3.1-70b-instruct-bf16-iMat-IQ3_XXXL_line.gguf
    35.9 GB
    LFS
    Upload meta-llama-3.1-70b-instruct-bf16-iMat-IQ3_XXXL_line.gguf 3 months ago
  • meta-llama-3.1-70b-instruct-bf16-iMat-IQ4_XSR.gguf
    38.1 GB
    LFS
    Upload meta-llama-3.1-70b-instruct-bf16-iMat-IQ4_XSR.gguf 3 months ago
  • meta-llama-3.1-70b-instruct-bf16-iMat-Q5_K_S_q4v6.gguf
    48.1 GB
    LFS
    Upload meta-llama-3.1-70b-instruct-bf16-iMat-Q5_K_S_q4v6.gguf 3 months ago