Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
yayoimizuha
/
Nemotron-4-340B-Instruct-imatrix-GGUF
like
0
Text Generation
GGUF
TFMC/imatrix-dataset-for-japanese-llm
Inference Endpoints
imatrix
License:
nvidia-open-model-license
Model card
Files
Files and versions
Community
Deploy
Use this model
3ad815d
Nemotron-4-340B-Instruct-imatrix-GGUF
1 contributor
History:
6 commits
yayoimizuha
Update README.md
3ad815d
verified
4 months ago
.gitattributes
Safe
3.25 kB
Upload folder using huggingface_hub
4 months ago
Nemotron-4-340B-Instruct-IQ2_XXS-00001-of-00002.gguf
Safe
48.9 GB
LFS
Upload folder using huggingface_hub
4 months ago
Nemotron-4-340B-Instruct-IQ2_XXS-00002-of-00002.gguf
Safe
42.5 GB
LFS
Upload folder using huggingface_hub
4 months ago
Nemotron-4-340B-Instruct-Q3_K_M-00001-of-00004.gguf
Safe
48.9 GB
LFS
Upload folder using huggingface_hub
4 months ago
Nemotron-4-340B-Instruct-Q3_K_M-00002-of-00004.gguf
Safe
48.9 GB
LFS
Upload folder using huggingface_hub
4 months ago
Nemotron-4-340B-Instruct-Q3_K_M-00003-of-00004.gguf
Safe
48.6 GB
LFS
Upload folder using huggingface_hub
4 months ago
Nemotron-4-340B-Instruct-Q3_K_M-00004-of-00004.gguf
Safe
29.7 GB
LFS
Upload folder using huggingface_hub
4 months ago
Nemotron-4-340B-Instruct-Q4_K_M-00001-of-00005.gguf
Safe
48.2 GB
LFS
Upload folder using huggingface_hub
4 months ago
Nemotron-4-340B-Instruct-Q4_K_M-00002-of-00005.gguf
Safe
48.6 GB
LFS
Upload folder using huggingface_hub
4 months ago
Nemotron-4-340B-Instruct-Q4_K_M-00003-of-00005.gguf
Safe
48.6 GB
LFS
Upload folder using huggingface_hub
4 months ago
Nemotron-4-340B-Instruct-Q4_K_M-00004-of-00005.gguf
Safe
48.9 GB
LFS
Upload folder using huggingface_hub
4 months ago
Nemotron-4-340B-Instruct-Q4_K_M-00005-of-00005.gguf
Safe
20.3 GB
LFS
Upload folder using huggingface_hub
4 months ago
Nemotron-4-340B-Instruct-Q8_0-00001-of-00008.gguf
Safe
48.6 GB
LFS
Upload folder using huggingface_hub
4 months ago
Nemotron-4-340B-Instruct-Q8_0-00002-of-00008.gguf
Safe
48.1 GB
LFS
Upload folder using huggingface_hub
4 months ago
Nemotron-4-340B-Instruct-Q8_0-00003-of-00008.gguf
Safe
47.7 GB
LFS
Upload folder using huggingface_hub
4 months ago
Nemotron-4-340B-Instruct-Q8_0-00004-of-00008.gguf
Safe
47.7 GB
LFS
Upload folder using huggingface_hub
4 months ago
Nemotron-4-340B-Instruct-Q8_0-00005-of-00008.gguf
Safe
47.7 GB
LFS
Upload folder using huggingface_hub
4 months ago
Nemotron-4-340B-Instruct-Q8_0-00006-of-00008.gguf
Safe
47.7 GB
LFS
Upload folder using huggingface_hub
4 months ago
Nemotron-4-340B-Instruct-Q8_0-00007-of-00008.gguf
Safe
47.7 GB
LFS
Upload folder using huggingface_hub
4 months ago
Nemotron-4-340B-Instruct-Q8_0-00008-of-00008.gguf
Safe
27 GB
LFS
Upload folder using huggingface_hub
4 months ago
Nemotron-4-340B-Instruct-Q8_0.imatrix
Safe
49.6 MB
LFS
Upload folder using huggingface_hub
4 months ago
README.md
Safe
706 Bytes
Update README.md
4 months ago